Live data from Hacker News

Linux Hypervisor Setup (Libvirt/QEMU/KVM)

octetz.com

41–50 of 64 posts

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#41
post #38

Cockpit is a nice web UI for libvirt: https://cockpit-project.org/ On debian add backports then it's as simple as "apt-get install cockpit-machines" then point your browser to http://localhost:9090

Do I guess correctly that you have cockpit running on the host and manage guests via the cockpit-machines plugin? If so, do you have any hints on where to find documentation about that? A cursory glance at the repo didn't produce much information.

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#42

I’ve been using Proxmox community edition for my home datacenter. It’s good to see what this article details into it and how some can pull all this together … for free (or for a small sum). URL: https://proxmox.com/en/proxmox-ve/features

I was recently going to set up Proxmox as well, since I had used it ~7 years ago and it was working well. But I ran into an expectation that I have a drive dedicated to putting ISOs on, in addition to the OS install and the virtual machine storage. I was trying to set it up on a SFF machine and was limited in what I could put into it and I just kind of noped out of it. I couldn't install any VMs until I did this.

I don't recall this being an issue before.

I ended up re-installing TrueNAS Scale beta, which I had installed and tried, but ran into a problem. Ended up finding the solution on the forums, something related to bridged or VLAN interfaces not coming up.

In the end I probably will just install Ubuntu and put Ganeti on these boxes, since that's been really reliable for me at work. I was actually hoping to try out Proxmox to possibly move to at work.

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#43
post #3

I use qemu and never really understood the need for any further abstraction such as libvirt over it's cli usage. Can anyone tell me what there is to be gained other than needing further setup, packages and systemd services?

It's been probably a decade since I've used libvirt, but I can say why I like using ganeti:

- I can get a list of the host machines in my cluster and how much memory and storage they have available.

- I can easily move VMs between hosts if I want to evacuate a host for hardware/software/firmware maintenance.

- It has the ability to set up DRBD backed VMs and live migrate between the host nodes.

- List what machines are running and on what hosts.

- Start and stop commmands don't require me to remember the settings on individual VMs, the qemu commands that get run are something like 700 characters long.

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#44

I’ve been using Proxmox community edition for my home datacenter. It’s good to see what this article details into it and how some can pull all this together … for free (or for a small sum). URL: https://proxmox.com/en/proxmox-ve/features

I was recently going to set up Proxmox as well, since I had used it ~7 years ago and it was working well. But I ran into an expectation that I have a drive dedicated to putting ISOs on, in addition to the OS install and the virtual machine storage. I was trying to set it up on a SFF machine and was limited in what I could put into it and I just kind of noped out of it. I couldn't install any VMs until I did this. I d…

What made you think that you need a separate disk just for ISOs? They can be uploaded to and stored on the default directory storage.

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#46

I’ve been using Proxmox community edition for my home datacenter. It’s good to see what this article details into it and how some can pull all this together … for free (or for a small sum). URL: https://proxmox.com/en/proxmox-ve/features

I was recently going to set up Proxmox as well, since I had used it ~7 years ago and it was working well. But I ran into an expectation that I have a drive dedicated to putting ISOs on, in addition to the OS install and the virtual machine storage. I was trying to set it up on a SFF machine and was limited in what I could put into it and I just kind of noped out of it. I couldn't install any VMs until I did this. I d…

I snapped up an old Dell T710 2-socket, 12 CPU, 24-thread Xeon rack, PERc 6 RAID for $100, populated with cheap Seagate 2TB IronWolf HDs, leftover 1033Mz DDR3 to 96GB for 3 RAID HD groups (RAID 1 for OS, RAID5 for data, and JBOD for VM images.)

Has a pfSense/FreeBSD VM for a gateway and a bunch of VMs on a detached bridge. Also have several more bridges for test VMs for real-world airgapped network setup.

8 different OS distros. Also am tweaking a MIPS and a M1 QEMUs outside of Proxmox .

runs very quiet.

so now it’s my home datacenter.

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#47
post #3

I use qemu and never really understood the need for any further abstraction such as libvirt over it's cli usage. Can anyone tell me what there is to be gained other than needing further setup, packages and systemd services?

It's been probably a decade since I've used libvirt, but I can say why I like using ganeti: - I can get a list of the host machines in my cluster and how much memory and storage they have available. - I can easily move VMs between hosts if I want to evacuate a host for hardware/software/firmware maintenance. - It has the ability to set up DRBD backed VMs and live migrate between the host nodes. - List what machines a…

> - Start and stop commmands don't require me to remember the settings on individual VMs, the qemu commands that get run are something like 700 characters long.

Shouldn't be the case. I put my VM args into a script, but it's only like 20 lines?

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#48

I’ve been using Proxmox community edition for my home datacenter. It’s good to see what this article details into it and how some can pull all this together … for free (or for a small sum). URL: https://proxmox.com/en/proxmox-ve/features

I was recently going to set up Proxmox as well, since I had used it ~7 years ago and it was working well. But I ran into an expectation that I have a drive dedicated to putting ISOs on, in addition to the OS install and the virtual machine storage. I was trying to set it up on a SFF machine and was limited in what I could put into it and I just kind of noped out of it. I couldn't install any VMs until I did this. I d…

(I think) I ran into the same or similar problem you did - there's a partition for the debian OS + iso images of a fixed size (df shows it as /dev/mapper/pce-root -> / ) and all the reallocatable storage used by the VMs comes out of the rest.

Thing is it's hard to re-allocate this partition, and that's where all the iso images, and the backups go.

I tried to migrate a vm and boom - it filled up.

I tried to figure out how to reallocate it, but in the end, I found this (sort of hacky) solution documented:

https://pve.proxmox.com/wiki/Logical_Volume_Manager_(LVM)

basically:

  # lvcreate -n vz -V 200G pve/data
  # mkfs.ext4 /dev/pve/vz
  # echo '/dev/pve/vz /var/lib/vz ext4 defaults 0 2' >> /etc/fstab
you migrate the stuff from /var/lib/vz to the new location and you have 200G for iso images/etc

Why this has to fight for storage from the root system, or why it's not easily expandable is a head-scratcher. I think it might be better to have a dedicated boot debian partition, a resizable/easily growable pve partition, then storage that can be allocated to vms/containers.

but yeah - that stopped me in my tracks, and when I'm doing it on a home machine you just don't have the time to chase this stuff down.

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#49
post #2

What do you all use for quick one-command (non gui) new vm bringup? I haven't had much luck with terraform with libvirt, and I miss Vagrant but don't want to lock myself into its syntax. Maybe I should just start using it again but I feel like there has got to be a good libvirt-based way. Provisioning new test vms with userdata embedded into an kickstart-or-whatever iso that is provided to libvirt also seems clunky.…

Just wanted to chime in and say that, for my purposes, Multipass has been perfect for work and personal use.

https://multipass.run/

(For others, it's a simple-to-use CLI that provisions Ubuntu instances.)

Re: Linux Hypervisor Setup (Libvirt/QEMU/KVM)

#50

Earlier quoted context omitted.

I was recently going to set up Proxmox as well, since I had used it ~7 years ago and it was working well. But I ran into an expectation that I have a drive dedicated to putting ISOs on, in addition to the OS install and the virtual machine storage. I was trying to set it up on a SFF machine and was limited in what I could put into it and I just kind of noped out of it. I couldn't install any VMs until I did this. I d…

I snapped up an old Dell T710 2-socket, 12 CPU, 24-thread Xeon rack, PERc 6 RAID for $100, populated with cheap Seagate 2TB IronWolf HDs, leftover 1033Mz DDR3 to 96GB for 3 RAID HD groups (RAID 1 for OS, RAID5 for data, and JBOD for VM images.) Has a pfSense/FreeBSD VM for a gateway and a bunch of VMs on a detached bridge. Also have several more bridges for test VMs for real-world airgapped network setup. 8 different…

I have something very similar, but an Optiplex.

One thing I had to do recently though is swap pfsense for Untangle because of drastically better FQ-CoDel implementation in Untangle.

Post reply on HN