Live data from Hacker News

Home Lab Beginners guide

linuxblog.io

341–350 of 400 posts

Re: Home Lab Beginners guide

#341

A bit of a tangent but I want to sing the praises of Proxmox for home servers. I've run some sort of Linux server in my home for 25 years now, always hand-managing a single Ubuntu (or whatever) system. It's a huge pain. Proxmox makes it very easy to have multiple containers and VMs on a single hardware device. I started by just virtualizing the one big Ubuntu system. Even that has advantages: backups, high availabili…

As someone still in monolithic home server tech debt I've been meaning to migrate too. The part I always wonder about is storage - said server is a NAS, serving files over SMB and media over Plex. From what I hear some people mount and export their data array [1] directly on Proxmox and only virtualize things above the storage layer, like Plex, while others PCI-passthrough an HBA [2] to a NAS VM. I suppose one advant…

>I also hear some people just go with TrueNAS or Unraid as their bare-metal base and use it for both storage and as a hypervisor, which makes sense. I might have to try the Linux version of TrueNAS now that it's had some time to mature

Unraid is especially meant for that. But TrueNAS Scale is also good, it has Docker and Kubernetes support too.

There is also openmediavault, it's a bit more Linux-y than the Unraid or TrueNAS Scale but a lot of people love it

Re: Home Lab Beginners guide

#342

The article is good, but it is intimidating buy its size and scope. A homelab could be a single NUC on a desk. I have one with 64GB RAM and it could fit so so many things. NUCs are very efficient to run 24/7, but become noisy with sustained CPU load. For that one could grow the setup with OptiPlex or Precision Tower (can haz ECC) SFF from eBay. These Dell SFFs are very good, quite small yet proper desktops/servers wi…

Yep, agreed. When living in a high cost of living area (i.e. where lots of tech professionals tend to live), space is limited. I'm annoyed at the lack of ECC-capable sub-ITX NAS boards. I have a Helios4, but I've no idea what I'll migrate to when that dies.

If you want cheap, but non-performant, there are AMD R-series like found in Dell/Wyse thin clients. They're pretty weak machines though 2-4 cores, but support ECC DDR3 single channel.

Re: Home Lab Beginners guide

#343
post #338

There are a ton of resources about HW aspects of home labs for beginners but not so much for what to run on them and why. There are lists like https://github.com/awesome-selfhosted/awesome-selfhosted but they are confusing for absolute beginners like me. Are there any good SW project guides you know?

I’m running a scraper for Dune movie tickets on mine. Before that I didn’t really have anything to do on it besides learning about Proxmox, VMs, networking, and cloud-init. Maybe try to run something you’d usually spin up a VPS for.

Re: Home Lab Beginners guide

#344
I'll toss mine out there. A single computer. Ryzen 1700 with 128GB RAM, six or seven disks totalling 20TB storage or so. SSD for VM images. Proxmox for OS, on a UPS.

I have one of those SoC Intel boxes with 4x2.5Gb LAN running proxmox, running OPNsense for my router. I had to get a fan to keep it from overheating.

Proxmox is a great SDN/VM host and I haven't fully explored monitoring and automating it.

Re: Home Lab Beginners guide

#345
post #136

Earlier quoted context omitted.

Proxmox is incredibly helpful especially for homelab beginners familiar with Linux. You can easily create and destroy various things as you learn. Only thing that's not so easy to use is storage in general : it's very difficult to truly understand the consequences of various choices and therefore it's kinda difficult to properly set up the backbone of a NAS unless you're fairly comfortable with zfs, lvm, lvm-thin, re…

One thing Proxmox is missing (IMHO) is a simple storage sharing system. I ended up just running the kernel NFS server on my Proxmox hypervisor, then sharing disks via a virtual-only LAN to the guest images. Other folks run an NFS server or a full NAS system in a VM under Proxmox. Proxmox' official solution for this is Ceph but that seems like overkill for a small home setup.

Hyperconverged Ceph is both trivial to set up and amazing. Would highly highly recommend it, it makes everything so much easier when your VMs are backed by RBDs.

Re: Home Lab Beginners guide

#346
post #97

Earlier quoted context omitted.

>Then a third group are people who build a whole data centre at home AND run serious applications on it. These guys need to buy themselves a motorbike or something. I don't think the insult to a generalized group of people is necessary. Some enthusiasts have overkill racks, 40Gbps fiber, enterprise-class switches and vlans, etc, etc ... because it's their enjoyable hobby . The over-the-top components and making it al…

It’s not meant to be insulting, it’s a joke in good spirit I think it communicates the point that their setup requires a level of effort and commitment that’s not for everyone

  > It’s not meant to be insulting, it’s a joke in good spirit
Indeed. That said it rings a bit true for me.

The day I sold my upgraded Macintosh and bought a motorcycle was, in hindsight, one of the best decisions I ever made.

I was without a home computer for about 3 years before I got another one, though I was a programmer by trade.

But the bike, well, just going to say far, far more ups than downs. Never regretted that trade.

Re: Home Lab Beginners guide

#347
post #338

There are a ton of resources about HW aspects of home labs for beginners but not so much for what to run on them and why. There are lists like https://github.com/awesome-selfhosted/awesome-selfhosted but they are confusing for absolute beginners like me. Are there any good SW project guides you know?

Admittedly, it makes way more sense once you have more than one person in your household. I ended up running most things in docker on a Raspberry Pi 4.

Started with

- PiHole to cut down on ads and try to keep the kids from clicking malware links

- added network attached storage to make it easier to share files with the family

- added Jellyfin to share music with people in the house (kids gotta grow up listening to good music)

- added syncthing to be able to ditch dropbox and still keep multiple computer file folders synced

- ran a Minecraft server, then a Terraria server, then shut those down since we moved on to other games

- turned on an ntp server since ddwrt router wasn't getting the time from the internet reliably

- added librespeed and ittools for quick wifi-speed-testing and to convert docker-run commands to docker-compose commands

- needed a webpage with links to start keeping track of all of this, so lighttpd it is...

- smokeping and blip were fired up when the internet got flaky and I needed more data to explain to the ISP what I was seeing

- Got a 3D printer, and Octoprint made it easy to start and monitor prints without having to pull a microSD card out of the socket every time.

- Figured, while we're here, that I might as well explore the smart-home thing with HomeAssistant -- now we have a handful of lightbulbs and smart power switches that mean you don't have to get up to change the lights quite as often (not everything is on a smart control, just a few out-of-the-way things. Oh, yeah, handy during Christmas-time to turn the tree lights on and off without having to fumble behind the tree for the little switch.)

- That, of course, lead to an MQTT broker (mosquitto), which is kind of a budget pub-sub broker

- And now that I have docker logs with things I need to debug, Dozzle serves those logs in a handy webpage. Not secure, but it's not like this is enterprise server.

- Then I wanted to play around with timeseries data (just to learn), so (running out of RAM at this point, so I couldn't just fire up Grafana) kept digging until I found VictoriaMetrics, which was quite happy to catch metrics (fired at it from Benthos) and visualize some 3 years of hourly Beijing weather data. (Seriously, I'm still amazed how lightweight, simple, and easy to use VictoriaMetrics is)

- currently thinking of kicking the tires on the NATS message broker and see if I can get the multi-node clustering to work. No real purpose other than see what it's like and dream about silly developer projects.

- also thinking of exploring SeaweedFS -- might be nice to have horizontally scalable storage, as each of my nodes are scattered around the house depending on where I can put an Ethernet drop.

- after a few years going along this journey, it has the perk of having helped me get my current job, which is pretty cool.

So... it's mostly a plaything, a sandbox, but a handful of things run "in production" at home and make life around the house slightly more convenient and less risky. By being choosy with the software and a bit aggressive on the container RAM limits, I've got 27 containers running on a Raspberry Pi. Hey, gotta take my bragging rights somewhere.

Re: Home Lab Beginners guide

#348
post #39

Earlier quoted context omitted.

In addition to that, I don't think people should overthink the rack as an essential component. I like racks as much as the next guy and homelab racks look really cool but for usability and learning, just go with whatever you like. I personally have 4 boxes stacked in a corner that are connected to a "rack", which is just two rack side panels bolted to the back of a workbench that I screw components into, connected to…

I am honestly kind of anti-rack at this point. "Deals" on used enterprise are IME dreadful unless you can get in on your own employer offloading old stuff, which requires you to a) even have an onprem setup at all and b) be friendly enough with the IT/NOC people that they give you a tip when it's going to happen. (For me b seems to happen naturally so it's really all on a). eBay is a fools game, terrible prices. Crai…

FWIW Supermicro slides work with those 4U Rosewill cases. I was pushed in that direction because my rack is just slightly narrower than 19 inches.

Honestly I don't mind wasting 1 or 2U between machines because the tops of server cases function as great "temporary" shelves.

I do agree the meme of used enterprise deals is completely overblown, unless you actually want 15+ compute nodes and are prepared to suffer power, heat, and noise for the density. Honestly I wish they made those Rosewill cases in 5U so I could put any full height cooler in there instead of being somewhat restricted.

Re: Home Lab Beginners guide

#349

Earlier quoted context omitted.

>Proxmox makes it very easy to have multiple containers and VMs on a single hardware device I just wish there was something like Unraid's Docker support but in a FOSS distro. Proxmox with LXC is just not the same. Unraid is good, love the UI and easyness too but the proprietary paid Linux is just something I don't like.

Especially now with the rumors of Unraid moving from pay-once to an annual subscription model.

I believe this was confirmed and they aim to switch by end of the month. Those interested in Unraid who prefer the old model may wish to pick up a perpetual license now.

https://unraid.net/blog/pricing-change

disclaimer - I'm not an Unraid user.

Re: Home Lab Beginners guide

#350

Earlier quoted context omitted.

I use nix btw. I totally agree. It (nix and nixos) is/are such a pain so often. But, wow... when you get things to work it is glorious. Quickly and easily syncing system/user/application configurations across multiple devices is incredible. The declarative approach means that the often laborious effort it takes me to get things to work pays off when I finally figure it out and realize I never have to do that again -…

I just feel it doesn't have to be this way. We can get the benefits of nix without the hardness of nix. It's just someone hasn't taken the time to make this "thing" yet. It's annoying enough that I won't use nix personally. I've used it at work so I'm quite knowledgeable with it.

> It's just someone hasn't taken the time to make this "thing" yet.

DietPi [1] has one massive (15KLoC) bash script [2] for system config.

[1] https://dietpi.com

[2] https://github.com/MichaIng/DietPi/blob/master/dietpi/dietpi...

Post reply on HN