Sharding and IDs at Instagram • Hacker News Board

Re: Sharding and IDs at Instagram

#51

Post by revorad » Thu, Oct 06, 2011, 12:25 PM UTC

seattlematt wrote: post #48

Back in 2003 I was a developer on a team at Microsoft that was responsible for building a new storage backend for all the MSN Messenger and Hotmail contact lists. This store had to hold data for close to 300 million user accounts, which we sharded out to a few hundred SQL server databases. Our sharding system consisted of a database with a single table with a row for each user that mapped their 128 bit guid user ID t…

Can you share some more details? How many shards did you have? Did it all run on a single machine? How much RAM did it have?

Re: Sharding and IDs at Instagram

#52

Post by [deleted] » Tue, Oct 11, 2011, 5:15 AM UTC

[deleted]

Re: Sharding and IDs at Instagram

#53

Post by pabitas » Tue, Oct 11, 2011, 5:16 AM UTC

Hi, very helpful post. Thank you.

Something still puzzles me though. You wrote a sequence is unique to each table in each schema. However, your example seems to use the same sequence name for all tables within a schema.

Also, shouldn't your mod operation have only one %?

Thanks again!