Live data from Hacker News

How to run Redis natively on Xen

openfoo.org

1–10 of 20 posts

Re: How to run Redis natively on Xen

#4
post #2

Love it. Will almost certainly never use it (we're not bottlenecking on Redis), but I love projects like this.

I don't think I'd use it even if Redis was a bottleneck [1]. With a performance increase of around 11% for SET/GET commands, I don't think there's that much to gain from running redis without an underlying OS. There's quite a bit to lose, too, because if you think about it, the implications here are that you aren't going to (ever) be able to make your data persist. Redis is a better fit for data that doesn't necessarily require persistence anyway, but putting this all on a scale, 11% don't win me over.

That being said (which is specifically about Redis on Xen), though, I think being able to run other server software without an underlying OS is pretty damn neat.

[1] Redis already scales nicely and with the upcoming Redis Cluster it's going to be trivial to run a fault-tolerant scaleable environment.

Re: How to run Redis natively on Xen

#5
post #2

Love it. Will almost certainly never use it (we're not bottlenecking on Redis), but I love projects like this.

I don't think I'd use it even if Redis was a bottleneck [1]. With a performance increase of around 11% for SET/GET commands, I don't think there's that much to gain from running redis without an underlying OS. There's quite a bit to lose, too, because if you think about it, the implications here are that you aren't going to (ever) be able to make your data persist. Redis is a better fit for data that doesn't necessar…

Well, my assumption is that they think they can get better than 10-13% speedups; but even still. I just like the idea and the hackery.

Re: How to run Redis natively on Xen

#7
Yeah, I've always wondered too that we're running servers with the full OS stack (sometimes horrific beast like Solaris) to operate a single simple program.

What a waste. Xen is looking more interesting every day, with stuff like this and HaLVM.

Re: How to run Redis natively on Xen

#8
Very interesting experiment, but somewhat this is the proof that Redis and any other memory intensive application where memory bandwidth can be one of the most important factors (MySQL is another example, and in general most database systems) are penalized running inside VMs compared to real hardware. 10-20% improvements are small compared to the order of magnitude of difference between real hardware and virtualized hardware.

This does not mean virtualization is in general not a good fit for Redis and other DBs. Actually it is already and with the introduction of Redis Cluster to take many small VMs with 1 or 2 GB each and running a cluster will be the way to go for most users probably (every instance will serve a subset of the queries, and there are cheap VMs with a good amount of memory).

But still, Redis in the most basic of the real-hardware Linux boxes will deliver 100k operations per second per core, while with a small virtualized instance it is an order of magnitude slower. Something to take in mind for deployments.

Re: How to run Redis natively on Xen

#9
post #2

Love it. Will almost certainly never use it (we're not bottlenecking on Redis), but I love projects like this.

I don't think I'd use it even if Redis was a bottleneck [1]. With a performance increase of around 11% for SET/GET commands, I don't think there's that much to gain from running redis without an underlying OS. There's quite a bit to lose, too, because if you think about it, the implications here are that you aren't going to (ever) be able to make your data persist. Redis is a better fit for data that doesn't necessar…

I'm skeptical when anyone says a upcoming product is going to make running a fault-tolerant scalable environment "trivial".
Post reply on HN