Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
highscalability.com
Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
1–10 of 45 posts
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#2TPS as in "Torsonic Polarity Syndrome"?
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#3TPS as in "Torsonic Polarity Syndrome"?
Transactions per second, I think.
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#4Is there a domain where this is applicable outside of high performance trading? I'm trying to think of another use case that would legitimately generate 1M queries/sec.
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#5Is there a domain where this is applicable outside of high performance trading? I'm trying to think of another use case that would legitimately generate 1M queries/sec.
A few off the points is applicable at much lower QPS than 1 million, especially in a virtualized environment such as EC2.
For example, I've had some issues with CPU (on core 0) saturation for soft interrupts on EC2, related to processing network packets.
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#6Is there a domain where this is applicable outside of high performance trading? I'm trying to think of another use case that would legitimately generate 1M queries/sec.
Ad networks.
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#7I'd have to guess that they're limiting themselves to a specific platform (hardware & software). Probably selling an appliance would be best way for them, instead of dealing with sysadmins that don't understand how to properly configure the database on their machines.
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#8Regarding point 9, "IRQ affinity from the NIC".
If one would like to delve a bit deeper into this one can find some info regarding the techniques introduced for linux here: http://lxr.linux.no/linux/Documentation/networking/scaling.t...
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#9Is there a domain where this is applicable outside of high performance trading? I'm trying to think of another use case that would legitimately generate 1M queries/sec.
Some of the larger combats (5000+ ships) in EVE Online might do that.
(I single EVE out because other MMOs generally shard by user-cohort, so having that number of people on one shard is impossible. EVE, meanwhile, shards by location within the virtual world (each star system is a shard), so the entire player-base can "gather" on a single shard for a confrontation.)
Re: Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware
#10>grafting AlchemyDB’s flexible data-modeling capabilities onto Aerospike’s high-velocity horizontally-scalable key-value data-fabric.
It reached an awesome Kps - keywords per sentence count as well.