Live data from Hacker News

Proxmox virtual environment 9.1 available

proxmox.com

61–70 of 81 posts

Re: Proxmox virtual environment 9.1 available

#61

Somehow, their web developer managed to break scrolling on Safari, so I am unable to navigate the linked site. If anyone else was looking for a list of what has changed in recent releases, it can be found at https://pve.proxmox.com/wiki/Roadmap

There’s a cookie popup, so maybe something on your browser is removing the layer and causing all the events to be ignored.

Re: Proxmox virtual environment 9.1 available

#62
post #4

Watching hypervisors slowly improve over the last few years has been amazing. They aren't quite to the point that I will install them under any new hardware I buy and then put my daily driver OS on top, but they are very close. I think a strong focus on creating 'the OS under your OS' experience seamless could open up a lot more here.

I have a PC where I installed Proxmox on bare metal and put a daily-use desktop OS on top. It works surprisingly well, the trickiest part was making sure the desktop OS took control of video/audio/peripherals.

Yup my primary Windows machine is a VM and after passing through all the relevant peripherals (GPU, USB) it’s pretty seamless and you’d never know.

Cool part is I needed a more powerful Linux shell than my regular servers (NUCs, etc.) for a one off project, so I spun up a VM on it and instantly had more than enough compute.

Re: Proxmox virtual environment 9.1 available

#63
post #3

Nah. Incus. Sorry, but I bought Proxmox 7, but it is not comparable. Incus does everything (and more) with better interface, WAY better reliability, and also not like a hundred EUR or whatever. (100 EUR is fine with me if better, but not if not better...)

IncusOS looks pretty interesting. It’s a new immutable distribution designed for Incus.

When it matures I’ll look into switching from Proxmox.

Re: Proxmox virtual environment 9.1 available

#64
post #4

Watching hypervisors slowly improve over the last few years has been amazing. They aren't quite to the point that I will install them under any new hardware I buy and then put my daily driver OS on top, but they are very close. I think a strong focus on creating 'the OS under your OS' experience seamless could open up a lot more here.

For many folk's workflows, I'd wager that hypervisors are there and ready. I had a nice time setting up xcp-ng before deciding microk8s fits my needs more betterer; they're just plum good, well documented, and blazing fast.

I think the possibilities are huge with this area. I'd love to see more 'manager' layers that build on top of any 'cloud' system, even a local one, to give you a standard stack that is easy to move. Imagine something that lives at the hypervisor level (that you trust and was mature) taking control of your various cloud accounts to merge them and make it easy to migrate/leave one provider for another. I know that is the promise of terraform but we all want a good, consistent, interface to play with and then build the automation tools on top of. Maybe that is a good direction for proxmox? integrating with cloud providers in a seamless way. Anyway, a lot of promise in this area no matter the direction it takes.

Re: Proxmox virtual environment 9.1 available

#65

So with support for OCI container images, does this mean I can run docker images as LXCs natively in proxmox? I guess it's an entirely manual process, no mature orchestration like portainer or even docker-compose, no easy upgrades, manually setting up bind mounts, etc. It would be a nice first step.

Also hoping that this work continues and tooling is made available. I suppose eventually someone could even make a wrapper around it that implements Docker's remote API

Re: Proxmox virtual environment 9.1 available

#66
post #4

Watching hypervisors slowly improve over the last few years has been amazing. They aren't quite to the point that I will install them under any new hardware I buy and then put my daily driver OS on top, but they are very close. I think a strong focus on creating 'the OS under your OS' experience seamless could open up a lot more here.

As my main desktop computers I've been using Fedora and Windows (for gaming only) virtualised on top of a single proxmox host with 2 GPUs passed through for more than 10 years... Upgraded all the way to latest versions (guests and hosts) without ever having to reinstall from scratch. I upgraded the hardware a few times (just cloned the disks), and since the desktops are virtualised, Windows always worked fine without complaining about new hardware drivers (only thing to change was GPU driver)

Another benefit is block-level backups of the VMs (either with qcow2 disks files or ZFS block storage, which both support snapshots and easy incremental backups of changed block data only)

Proxmox is great for this, although maybe not on a laptop unless you're ready to do a lot of tweaks for sleep, etc.

Re: Proxmox virtual environment 9.1 available

#67
post #42
post #12

Earlier quoted context omitted.

Talking to midmarket and enterprise customers and nobody is taking Proxmox seriously quite yet, I think due to concerns around support availability and long term viability. Hyper-V and Azure Local come up a lot in these conversations if you run a lot of Windows (Healthcare in the US is nearly entirely Windows based). Have some folks kicking tires on OpenShift, which is a HEAVY lift and not much less expensive than mo…

HPE VM Essentials and Proxmox are just UI/wrappers/+ on top of kvm/virsh/libvirt for the virtualization side. You can grow out of either by just moving to self hosted, or you can avoid both for the virtualization part if you don't care about the VMware like GUI if you are an automation focused company. If we could do it 20 years ago once VT-x for production Oracle EBS instances for a smaller but publicly traded compa…

Correction: In Proxmox VE we're not using virsh/libvirt at all, rather we have our own stack for driving QEMU on a low-level, our in-depth integration, especially with live local storage migration our Backup Servers dirty-bitmap (known as change block tracking in vmware worlds) would be possible in the form we have it. Same w.r.t. our own stack for managing LXC container.

The web UI part is actually one of our smaller code bases relative to the whole API and lower level backend code.

Re: Proxmox virtual environment 9.1 available

#68
post #33

What is this "application containers" BS, just add native docker stack support. Most folks in the self hosting community already deploy nested dockers in LXCs, just add native support so we can cut out the middle man and squeeze out that indirection.

It makes no sense to add an extra layer, and we definitively do not want to make us and our users dependent of docker project.

There exist many OCI runtimes, and our container toolkit already provides a (ball parked) 90% feature overlap with them. Maintaining two stacks here is just needless extra work and asking for extra pain for us devs and our users, so no, thanks.

That said, PVE is not OCI runtime compatible yet, that's why this is marked as tech preview, but it can be still useful for many that control their OCI images themselves or have an existing automation stack that can drive the current implementation. That said, we plan to work more on this in the future, but for the midterm it will be not that interesting for those that want a very simple hand-off approach (let's call it "casual hobby homelabber"), or want to replace some more complex stack with it; but I think we'll get there.

Re: Proxmox virtual environment 9.1 available

#69
post #56
post #42

Earlier quoted context omitted.

HPE VM Essentials and Proxmox are just UI/wrappers/+ on top of kvm/virsh/libvirt for the virtualization side. You can grow out of either by just moving to self hosted, or you can avoid both for the virtualization part if you don't care about the VMware like GUI if you are an automation focused company. If we could do it 20 years ago once VT-x for production Oracle EBS instances for a smaller but publicly traded compa…

KVM is awesome enough that there isn’t a lot of room left to differentiate at the hypervisor level. Now the problem is dealing with thousands of the things, so it’s the management layer where the product space is competing.

Thus why libvirt was added, it works with KVM, Xen, VMware ESXi, QEMU etc... but yes most of the tools like ansible only support libvirt_lxc and libvirt_qemu today but it isn't too hard to use for any modern admin with automation experiance.

Libvirt is the abstraction API that mostly hides the concrete implementation details.

I haven't tried oVirt or the other UIs on top of libvirt, but it seems less painful to me than digging through the Proxmox Perl modules when I hit a limitation of their system, but most people may not.

All of those UI's have to make sacrifices to be usable, I just miss the full power of libvirt/qemu/kvm for placement and reduced latency, especially in the era of p vs e cores, dozen's of numa nodes etc...

I would argue for long lived machines, automation is the trick for dealing with 1000's of things, but I get that is not always true for others use-cases.

I think some people may be supprised by just targeting libvirt vs looking for some web-ui.

Re: Proxmox virtual environment 9.1 available

#70
post #42

Earlier quoted context omitted.

HPE VM Essentials and Proxmox are just UI/wrappers/+ on top of kvm/virsh/libvirt for the virtualization side. You can grow out of either by just moving to self hosted, or you can avoid both for the virtualization part if you don't care about the VMware like GUI if you are an automation focused company. If we could do it 20 years ago once VT-x for production Oracle EBS instances for a smaller but publicly traded compa…

Correction: In Proxmox VE we're not using virsh/libvirt at all, rather we have our own stack for driving QEMU on a low-level, our in-depth integration, especially with live local storage migration our Backup Servers dirty-bitmap (known as change block tracking in vmware worlds) would be possible in the form we have it. Same w.r.t. our own stack for managing LXC container. The web UI part is actually one of our smalle…

Correct sorry I don't use the web-ui's and was confusing oVirt, I forgot that you are using perl modules to call qemu/lxc.

I would strongly suggest more work on your NUMA/cpuset limitations. I know people have been working on it slowly but with the rise of E and P cores, you can't stick to pinning for many use cases and while I get hyperconvergence has it's costs, and platforms have to choose simple, the kernels cpuset proc system works pretty well there and dramatically reduces latency, especially for lakehouse style DP.

I do have customers who would be better served by a proxmox type solution, but need to isolate critical loads and/or avoid the problems with asymmetric cores and non-locality in the OLAP space.

IIRC lots of things that have worked for years in qemu-kvm are ignored when added to .conf etc...

Post reply on HN