Replies: 2 comments 16 replies
-
|
@Aubermean We would love to support this if implemented neatly. There have been others that were able to get something to work even before Hetzner merging in the new functionality. Please don't hesitate to tag them in, I'm sure they will appreciate the initiative. |
Beta Was this translation helpful? Give feedback.
-
|
yes, but it required a custom wirgeguard overlay network (or any other VPN technology) for the control plane since Hetzners vSwitch (that connects bare metal servers to private networks) is too slow according some comments on the internet. Ultimately, I had a fork of this repo that is non-compatible with upstream which I more and more began to dislike. Although, I'd really love to use bare metal for cheap base load, I came to the conclusion that I'd rather pay more money for cloud nodes that are tightly integrated with this repo to maintain ability to upgrade. additionally, by using bare-metal, you loose all the automated stuff and e.g. recreating a new cluster from scratch becomes tedious. |
Beta Was this translation helpful? Give feedback.
-
|
But @maaft, recently Hetzner added the possility to connect metal nodes to cloud private networks directly, so I guess without vswitch. |
Beta Was this translation helpful? Give feedback.
-
|
oh really? That's indeed highly interesting, but the other points still stand I guess. Although it would be probably also possible to integrate provisioning of those also in this repo, right? anyway, thanks for the heads up :) |
Beta Was this translation helpful? Give feedback.
-
|
If it's not too convoluted, would love to support in this repo, at the very least have an example in the examples folder. |
Beta Was this translation helpful? Give feedback.
-
|
@maaft you are right about it being too tedious for stateless app workloads However if you ever want to make a stateful db workload for eg a crunchy postgres deployment with anything more than a tb of storage you are kind of screwed with the vps instances. so I still think its valuable to have a standard approach even if its outside of this projects scope. ie: have a standard way to add workers manually. Also with regards to the speed. It's determined by the network interface you purchase so you have to do your own duedeligenoe which I think its understandable as its a more advanced use case. |
Beta Was this translation helpful? Give feedback.
-
|
I wanted to post a new discussion about this but maybe here is more appropriate. I have a working cluster that uses cilium. Now I'd like to join the servers equipped with GPUs to the cluster... vswitch? Wireguard? What options are there? Is using cilium with this requirements a good idea or am I shooting myself in the feet? |
Beta Was this translation helpful? Give feedback.
-
|
@mysticaltech yes I noticed loadbalancer services received an IP and then discovered about the klipper feature :D
Surprises me as well but it does publish subnets with flannel 🤷♂️ I did not find the line of code that does it though, I wanted to understand wether it was k3s or flannel doing the trick.
this would be great but unfortunately my servers are not Robot ones, they are in a colocation not managed by Hetzner! |
Beta Was this translation helpful? Give feedback.
-
|
this might sound out of left field but im planning on not using kipper or Hetzner LB im planning to use Cloudflare tunnel service and use a lb on the cloudflare side 5 bucks but it kills a lot of birds. (Im aware about their shitty sales practices. do not consider this an endorsement you can pull a similar stunt with fly.io or fastly) you can't really use a dedicated server as a control plane without loosing your mind but I feel thats just life atm |
Beta Was this translation helpful? Give feedback.
-
|
@BuddhiAbeyratne I love cloudflare tunnels myself, but never used them on kube directly, but the thought had crossed my mind more than once. When you get this setup, it would be super cool if you could PR in a guide to the examples section and folder 🙏 |
Beta Was this translation helpful? Give feedback.
-
Far better write up than mine would ever be |
Beta Was this translation helpful? Give feedback.
-
You may want to have a look at liqo |
Beta Was this translation helpful? Give feedback.
-
Since the issue discussing this is burried and hard to find, I thought I should open up a discussion here.
4 months ago Hetzner merged the features from the Syself fork into hcloud-cloud-controller-manager (HCCM), that allows management of dedicated/Robot servers alongside cloud ones. They released it in v1.19.0.
Hetzner say that many customers use clusters on hybrid cloud/dedicated, and it was their reason behind adding the feature. But this project does not currently have support. I don't have the depth of knowledge required to implement it, but I imagine that many seasoned k3s/hcloud people have, and maybe we can discuss the steps or work involved to implement the feature.
Beta Was this translation helpful? Give feedback.
All reactions