GET NEW REDDIT MY SUBREDDITS ?

DITS ? HOME - POPULAR - ALL - RANDOM - USERS | THENETHERLANDS - NETHERLANDS - IBO - ANN EDIT » t-pillai (1) | | | |

COMMENTS

Help Should I go Bare-Metal or VMs for my Kubernetes

4 Cluster self.homelab
Submitted 8 months ago by TheFragan

Hey, /r/Homelab Join

639,701 Labbers
I've a Ryzen 7 5700x PC Build + two old i5-5200U laptops that I'd
like to use as a homelab Kubernetes Cluster.
I was wondering If I should go bare-metal or make some VMs using Search
Proxmox or any other virtualization tool and install my cluster on top
of these VMs.
N/ALink
Submit N/AText
Submit
Is there any pros/cons to go either way knowing my hardware ?
18 comments share save hide report crosspost
This post was submitted on 28 May 2023

all 18 comments
4 points (75% upvoted)
sorted by: best? shortlink: https://redd.it/13u3203
We use cookies on our websites for a number of purposes, including analytics and performance, functionality and
advertising.
Learn more about Reddit's use of cookies. CONTINUE

Please continue to new.reddit.com to set your cookie preferences.

 content policy formatting help Get an ad-free experience with special
SAVE benefits, and directly support Reddit.

Get Reddit Premium

[–] YinzAintClassy • 11 points 8 months ago

Vms all day. Use proxmox and use the all the features. Templates and clones make it
super easy to rebuild stuff if needed. Subreddit Info
Bare metal is cool but unless you need something specific like direct hardware access 1,096 labbers here now
for high performance computing use vms all day Show my flair on this subreddit. It looks like:
permalink embed save report reply (edit)

[–] TheFragan[S] • 2 points 8 months ago

But I've very few ressources haha like 8 core 16 threads on the Ryzen and 2 core
New to Homelab? Start Here!
4 threads on laptops, virtualization will even lower those available resources as it
needs resources to run
permalink embed save parent report reply
Homelab Wiki

[–] paulwipe • 6 points 8 months ago

The overhead on a type 1 hypervisor is not really that significant.

HomelabSales
permalink embed save parent report reply

[–] YinzAintClassy • 2 points 8 months ago

Yeah I was a sweet summer child at one point and thought I needed 3
beasts for my proxmox cluster and realized it really doesn’t take any
resources at all.
I’m sure v center/sphere require more but yeah we tend over analyze what
we think we need
permalink embed save parent report reply

We use cookies on our websites for a number of purposes, including analytics and performance, functionality
Labporn and Diagrams
advertising.
[–] BigIncome0 • 2 points 8 months ago
Learn more about Reddit's use of cookies.
Agree with this 100%. Operationally, proxmox clusters and VMs are easier to
manage than PXE booting on bare metal.
Please continue to new.reddit.com to set your cookie preferences.
permalink embed save parent report reply Tutorials News
 + Subreddit Rules
[–] YinzAintClassy • 3 points 8 months ago
You have 20 threads to work with and is plenty for small clusters and testing.
Use k3s for your k8s cluster and control plane. + Wiki

Standard k8s requires 3 master nodes and then client l/worker nodes.
With k3s you get the benefit of a light kubernetes and should be able to get 6 small + Discord
nodes for all your apps with your cpu count.
Virtualization is more ram intensive than cpu. Plus proxmox allows you to schedule + Related Subreddits
more vcpu than what’s avail in your pool as most of your cpu will be idle.
I had a total of 24 threads for my first cluster and have about 10 vms running with no
issue Message the moderators
permalink embed save report reply

[–] YinzAintClassy • 5 points 8 months ago

For context I was using 3 Lenovo thinkcentre tinys Each had 4 cores/8 threads. I MODERATORS
upgraded the ram to 32gb on each node and 512 nvme storage.
MESSAGE THE MODS
Trust me you will need the features of vm templates for when you break stuff. And
you will break stuff MufffinsBot
permalink embed save parent report reply MonsterMufffin SoftwareDefinedMuffins
Forroden
[–] TheFragan[S] • 1 point 8 months ago Cosmic_Failure
upcboy
Alright, one last question regarding k3s vs k8s. I'm also planning to add few AutoModerator
VMs from the cloud (like oracle cloud free tier, AWS free tier, etc). Should I still RepostSleuthBot
go with k3s knowing I could have 3 masters nodes (1 locally and 2 on the bigDottee Lazy Sysadmin / Lazy Geek
ImpressiveHackintosh
cloud)? DL380e G8 | DL380 G6 | HP 1820-48G
permalink embed save parent report reply bwbloom King of Homelab Noobs
...and 4 more »
[–] YinzAintClassy • 1 point 8 months ago

We use K3s is compliant

cookies k8s but for
on our websites trimmed down
a number ofand made for
purposes, limitedanalytics
including resources.
and performance, functionality and
advertising.
K3s also allows you to schedule apps on the master nodes, I don’t do this
Learn more about Reddit's use of cookies. account activity
but it’s one of the main features of k3s.
As long as
Please continue to your oracle/ec2 are
new.reddit.com in a
to set public
your subnet
cookie or you use a site to site
preferences.
vpn with tailscale there is no difference. A Linux vm is a Linux vm This subreddit uses the /r/Naut theme.
 That would give you a good learning excersize on node labels for assigning
containers to only your cloud instance’s rather your local.
permalink embed save parent report reply

[–] YinzAintClassy • 2 points 8 months ago

I miss read part of that. I would not spread my masters between two
locations.
I would keep everything local for now and grow as needed.
I think your over estimating your needs for your cluster. You can get a
lot done with your setup.
What apps do you plan on running? Docker containers use very little
resources. Especially in a homelab set up with hardly any traffic in the
gran scheme of things.
At one point my 3 nodes had close to 3 dozen containers and had some
room to grow still
permalink embed save parent report reply

[–] TheFragan[S] • 1 point 8 months ago*

I will probably not really need HA but I'll surely want to try and set it
up in the future and having the master nodes spread around
different location is a Big plus, isn't it ?
I'll be running a ScyllaDB cluster, some Rust apps gathering data
from the internet (crypto data from Binance and such) and maybe
some Flink streaming analytics
permalink embed save parent report reply

[–] SnooBeans4154 • 1 point 8 months ago

What model are your lenovo thinkcentres?

We use cookies on our websites for a number of purposes, including analytics and performance, functionality and
permalink embed save parent report reply
advertising.
Learn more about Reddit's
[–] YinzAintClassy use 8ofmonths
• 1 point cookies.
ago
Off the top of my head m900 tinys.
Please continue to new.reddit.com to set your cookie preferences.
Intel 6thgen i7
permalink embed save parent report reply
[–] incognitodw • 3 points 8 months ago
For production, definitely bare metal. As a homelab, go with proxmox cos it's easier
to start afresh if u when u r running some kind of experiment, or when u screw up
permalink embed save report reply

[–] AnyNameFreeGiveIt automate all the things • 2 points 8 months ago

I switched from proxmox to bare metal and am much happier with that setup.
Only thing that hold me back was running other vm's along like opnsense but it was
easy to switch them over to kubevirt.
permalink embed save report reply

[–] SnooBeans4154 • 1 point 8 months ago

What model are your lenovo thinkcentres?
permalink embed save report reply

[–] TheFragan[S] • 3 points 8 months ago

I dont have lenovos, 2 laptops are actual old laptops I think dell inspirons type of
shit
permalink embed save parent report reply

We use cookies on our websites for a number of purposes, including analytics and performance, functionality and
advertising.
Learn more about Reddit's use of cookies.

Please continue to new.reddit.com to set your cookie preferences.

 about help apps & tools <3
blog site rules Reddit for iPhone reddit
about Reddit help Reddit for premium
advertising center Android
careers reddiquette mobile website
mod guidelines
contact us

Use of this site constitutes acceptance of our User Agreement and Privacy Policy. © 2024 reddit inc. All rights reserved.
REDDIT and the ALIEN Logo are registered trademarks of reddit inc.

We use cookies on our websites for a number of purposes, including analytics and performance, functionality and
advertising.
Learn more about Reddit's use of cookies.

Please continue to new.reddit.com to set your cookie preferences.