Hetzner DIY Private Networking with Tinc(romantomjak.com)
romantomjak.com
Hetzner DIY Private Networking with Tinc
https://romantomjak.com/posts/hetzner-private-networking.html
6 comments
Running Kube on their cloud servers? Well have fun with that, the "vCore" is a very inconsistent unit unless you get their dedicated core servers. I moved back to Hetzner Bare Metal because you can't have anything that will push the resource boundaries on these boxes.
Also regarding Wireguard, I really like how tinc will find a new path and allows you to route over other nodes as needed. Wireguard can't really do that out of the box, every link is 1:1. You can of course setup something on top of that, but I miss the ease with which tinc does this.
Also regarding Wireguard, I really like how tinc will find a new path and allows you to route over other nodes as needed. Wireguard can't really do that out of the box, every link is 1:1. You can of course setup something on top of that, but I miss the ease with which tinc does this.
along the lines of automatically re-routing, tinc also has some neat anycast-like capabilities -- you can assign the same ip to multiple nodes, and the lowest latency/shortest route node wins
I was actually surprised at the lackluster performance on the cloud products as well and recently spun up a dedicated box for a workload that actually required consistent performance. I never expected the performance to match a bare metal option of course, but coming from any of the other cloud providers I expected it to be more equivalent than it turned out to be.
I was considering using autossh to create a private link between servers, because in my case it's only a handful of servers.
Can you comment on how stable a Wireguard tunnel is? Did you manage to get the link/VPN to stay up permanently with little to no maintenance?
Can you comment on how stable a Wireguard tunnel is? Did you manage to get the link/VPN to stay up permanently with little to no maintenance?
I would use WireGuard tbh, but I use pfSense for Networking and there doesn't seem to be a userspace implementation available that runs on it (I did try some FreeBSD binary that I copied over but that didn't quite work out).
The -go version should work, though (if compiled correctly). https://git.zx2c4.com/wireguard-go/
I hope https://github.com/gsliepen/tinc/issues/179 becomes a reality: tinc ui and features on top of wireguard!
I did know about this, but it looks very interesting! Will defo check it out, thanks!
You can achieve something similar with Hetzner's recently introduced "vSwitch feature". Works across their different DCs, which is nice. Some docs here: https://wiki.hetzner.de/index.php/Vswitch/en
I've been using ZeroTier to give a common backplane to my Hetzner servers, DO droplets and AWS instances.
I've been using ZeroTier to give a common backplane to my Hetzner servers, DO droplets and AWS instances.
I understand this may not be an issue in your case, but vSwitches won't encrypt your data in transit between servers, unlike a VPN or ssh tunnel.
It depends. I've seen some shit on cheap bare metal providers, including getting ARP poisoned on Online.net.
Hetzner has been great overall. They've been very very helpful in documenting me reacting to abuse emails too when I got into some user-generated-content related legal trouble.
Hetzner has been great overall. They've been very very helpful in documenting me reacting to abuse emails too when I got into some user-generated-content related legal trouble.
I really have to second the praise of Hetzner overall here. I have run a couple of their dedicated machines for several years and have nothing but good things to say about them and their service.
vSwitch is only, AFAIK, available on their dedicated servers (well, anything in Robot... which also includes their legacy virtualized product). OP is using their new cloud offering, which doesn't have an equivalent option.
[deleted]
> Normally you only get one public IP and no private interfaces.
From my understanding, this statement is not quite correct, as Hetzner allows you to set up VLANs:
> With the vSwitch feature, you can connect your dedicated root servers in multiple locations to each other using VLAN via the administration interface Robot.
You probably still want to encrypt the traffic passing through those VLANs.
They also offer the option to install custom hardware, so you might even be able to get a second NIC connected to your own private switch.
From my understanding, this statement is not quite correct, as Hetzner allows you to set up VLANs:
> With the vSwitch feature, you can connect your dedicated root servers in multiple locations to each other using VLAN via the administration interface Robot.
You probably still want to encrypt the traffic passing through those VLANs.
They also offer the option to install custom hardware, so you might even be able to get a second NIC connected to your own private switch.
That only applies to their dedicated servers. OP is using their cloud offering, which doesn't support this feature or custom hardware.
Isn't the point of DO's private networking that you don't need to encrypt the traffic? Or is it just internal, but not private?
I’ve heard DOs internal traffic is internal not private. You’ve got to lock your boxes down anyways.
This changed a few months ago. You still share the same private network with everyone else in the DC, but only machines on your account can communicate with each other.
that's good to know! thanks for this information.
Well private just means it’s isolated from other networks - it doesn’t mean that your ‘private’ network can’t be snooped (by Hetzner, hackers, etc.)
We’re experimenting with Wireguard on all internal hosts and disabling SSL.
We’re experimenting with Wireguard on all internal hosts and disabling SSL.
Yeah, I found that an odd comparison to make as well. If you want encrypted traffic that's all well and good, but there's no reason to assume that the private network is going to be any different performance wise than the exact same encrypted solution over the public interface - a network is a network is a network in this case.
Since the goal was to have a private network between your own boxes, the encryption was only really "required" to protect private data because it had to transit the public network in Hetzner. Since DO provides a private network natively there's (in theory) no justification for the encryption, which means you'd get native performance, hence the advantage.
Since the goal was to have a private network between your own boxes, the encryption was only really "required" to protect private data because it had to transit the public network in Hetzner. Since DO provides a private network natively there's (in theory) no justification for the encryption, which means you'd get native performance, hence the advantage.
Are you sure DO's private network traffic is actually encrypted or even isolated? Back some time ago, any host within the same private network could be reached. I wasn't surprised to see connection attempts from random hosts on eth1.
Other comment there talks about it, they changed it a while ago and now it's isolated, but not encrypted.
What about Zerotier with Hetzner?
Yeah I'm not sure why zerotier is not getting enough credits here on HN. It works flawlessly, is super fast, easy, works on iphone, and they have a small hardware box now.
Zerotier doesn't do PFS Perfect Forward Secrecy... and somehow it is too easy to add new clients to the network without you noticing.
IIRC in Zerotier new clients are easily added, but traffic to and from them is blocked by default, until you approve them in the web interface.
New clients have to be approved before they can join. How would you not notice?
Where do you approve them?
The online control panel where you setup your private network in the first place. This is where you configure the IP range and other settings, and accept any devices that try to join.
It's too bad you mae these comments without actually having tried it.
[1] https://www.wireguard.com/ [2] https://github.com/hobby-kube/guide#wireguard-setup
Edit: Benchmarks on Hetzner Cloud (1vCPU, 2GB)