This was made possible, by adding two subdomains (v4.ip.zuim.de and v6.ip.zuim.de), which only have a DNS record for the respective IP version. This forces the browser to use the specified protocol without relying on directly accessing the server by its IP. This is important, because using the addresses directly would not support https. Now everything is sent over https!
In this guide I will explain how to set up wake on lan over the internet without introducing security vulnerabilities. This will be done by allowing only one peer with a static ip to access the device from the internet.