MongoDB Finds A Major Adopter In Craigslist
java.dzone.com
MongoDB Finds A Major Adopter In Craigslist
1–10 of 22 posts
Re: MongoDB Finds A Major Adopter In Craigslist
#2This video is a presentation by Jeremy Zawodny, who co-wrote O'Reilly's "High Performance MySQL" ( http://oreilly.com/catalog/9780596101718 ). If there's anybody worth watching a video about switching from MySQL to MongoDB, it's that guy.
Re: MongoDB Finds A Major Adopter In Craigslist
#3Not to take away from the substance of the article itself, but is anyone else surprised that they have 2 billion "documents", which presumably means active ads/listings? That seems like an awful lot.
Re: MongoDB Finds A Major Adopter In Craigslist
#4Not to take away from the substance of the article itself, but is anyone else surprised that they have 2 billion "documents", which presumably means active ads/listings? That seems like an awful lot.
I would have expected more, personally. Craigslist is massive, popular, and been around a long time. That ads up to a TON of listings.
Re: MongoDB Finds A Major Adopter In Craigslist
#5It's mind-blowing to read that they could get data in mongoDB faster than to get it out of MySQL. I wonder if their structure was so complex or if the queries were complex as well, or is mongoDB that fast? Anyway, great to see sites like this embracing new technologies and revealing the details.
[edit] I guess watching the video explains a lot more. Do watch!
Re: MongoDB Finds A Major Adopter In Craigslist
#6The link should probably be to this page:
http://blog.mongodb.org/post/5545198613/mongodb-live-at-crai...
Re: MongoDB Finds A Major Adopter In Craigslist
#7This video is a presentation by Jeremy Zawodny, who co-wrote O'Reilly's "High Performance MySQL" ( http://oreilly.com/catalog/9780596101718 ). If there's anybody worth watching a video about switching from MySQL to MongoDB, it's that guy.
For a direct link to the 34 min video: http://www.10gen.com/video/mongosv2010/craigslist
Re: MongoDB Finds A Major Adopter In Craigslist
#8Not to take away from the substance of the article itself, but is anyone else surprised that they have 2 billion "documents", which presumably means active ads/listings? That seems like an awful lot.
MongoDB is being used for historical archiving, not for the live site itself. The big reason being that changing table schemas for very large sets of old data is painful with MySQL. So the 2 billion number would be any ad/listing older than a set amount of time.
The live data is < 1 TB and is still stored in MySQL.
Re: MongoDB Finds A Major Adopter In Craigslist
#9Not to take away from the substance of the article itself, but is anyone else surprised that they have 2 billion "documents", which presumably means active ads/listings? That seems like an awful lot.
This looks like a data warehousing of the archive. The two billion listings probably represents all expired ads ever. There is no way they have 2 billion active ads at any one time.
Re: MongoDB Finds A Major Adopter In Craigslist
#10Not to take away from the substance of the article itself, but is anyone else surprised that they have 2 billion "documents", which presumably means active ads/listings? That seems like an awful lot.
This looks like a data warehousing of the archive. The two billion listings probably represents all expired ads ever. There is no way they have 2 billion active ads at any one time.
The above comment is correct.
The archive does have to be accessed by users though, since users can access listings from many years back.
The entire archive seems to be under 4 TB from what he described in the video (2 billion documents at 2 kilobytes each). They do not retain photos.