I want to use cloud servers with dedicated boxes

[ghost]

So in short, my control plane, auto scaling nodes and so on are cloud machines
While also running one or more dedicated boxes (in the same data center) for stateless workloads.
I imagine this wouldn't be much of an issue - I've already done something in this direction, but using a different k8s distro.
There is the odd manual step, on the dedicated side - setting up the networking, but that's pretty much a one off and not hard to do at all.

So... my question: would I be able to just add another metal box to the cluster, after initially setting it up?

And a sidenote - I had a loooot of issues with volumes on hetzner with k3s and hetzner csi (which is why I stopped using it on hetzner) -have you not had issues, at all? (issues were volumes wouldn't successfully detach and re-attach to another node)

EDIT: I see there is a similar discussion in issues, where I only searched for this in discussions, so maybe close this

[mysticaltech]

@crisrat Yes, @maaft Got it working, but it's not officially supported for now, #433

About volumes, I did not know of significant issues with HetznerCSI, but it's completely possible indeed. We also support Longhorn, which I think is more flexible. You can check our docs for more details on this.

[mysticaltech]

@crisrat The failure to reattach sounds familiar lol. But there are ways to make it work if I remember correctly! Maybe searching this project will give you solutions.

[ghost]

@mysticaltech I tried lots of things, and searched high and low - on the hetzner-csi repo especially, but with mixed success
For me, if it doesn't work without my intervention, it is not good enough, so I just stopped using k3s on hetzner

[mysticaltech]

@crisrat It's not k3s per se, it's probably just the config of the CSI. You should not have this problem with Longhorn!

[ghost]

@mysticaltech not sure, I've since switched to kubeone and that has no issues at all with mounting volumes - regularly auto scales, I've deleted all nodes just to see how it scales back up and all volumes, always mount. perhaps with the new csi version they released, I think it's at 2 now(?), issues are resolved

[mysticaltech]

@crisrat Interesting, good to know!