When will they unleash the Python?
Youporn.com is now a 100% Redis Site
31–40 of 133 posts
Re: Youporn.com is now a 100% Redis Site
#32Earlier quoted context omitted.
I was afraid to see what youporn is (at work now), so i guess it is really a porn site.
The online porn industry were the first people to really deal with scalability (of managing and serving web content, anyway), the first people to deal with online payments, the first people to come under really heavy, sustained hacking attempts, etc. Don't underestimate how much of what you take for granted technologically in 2012, they pioneered in the mid-90s.
Re: Youporn.com is now a 100% Redis Site
#33That's porn for database geeks: 100 million pageviews per day, 300k requests per second against Redis. The way they use MySQL is also interesting IMHO: they populate a relational database in order to be able to build new indexes in the Redis side, using the relational DB for the stuff it is best at, generating new "views" of the data easily. (Relational DBs are also good to do a zillion more things of course.)
300k requests/sec? Surely that can't be on a single Redis server, is it? Is Redis cluster out yet, or did they implement their own?
It would be mostly reads so could be done with lots of slaves and sharding without redis cluster.
Re: Youporn.com is now a 100% Redis Site
#34For some reason I always imagine porn sites to be run by guys in cheap suits and lots of hair gel. Then I realize that in order to run a site with the kind of traffic that some of them have, you really need to have some decent engineers on staff.
The owner of YouPorn (and many others) is Fabian Thylmann, and he is actually a geek at heart:
http://nymag.com/news/features/70985/index4.html (article)
http://www.cnbc.com/id/45989405/Meet_the_New_King_of_Porn (photo)
Re: Youporn.com is now a 100% Redis Site
#35For some reason I always imagine porn sites to be run by guys in cheap suits and lots of hair gel. Then I realize that in order to run a site with the kind of traffic that some of them have, you really need to have some decent engineers on staff.
First off, I am not saying that youporn guys are not decent but IMHO, people shouldn't get too excited about this. Youporn is somewhat quite a simple site I'd imagine. It's just categorized videos with a bunch of stats (views, related video...), and users. There's almost no social interaction between users (i've just registered an account just to confirm that). That's a very clear (and good) reason why 100% redis sui…
You would imagine wrong. I'm running a video sharing page (think FB&youtube mashed together with a dash of blogger) with about 800k unique/month users and it's no picnic.
Re: Youporn.com is now a 100% Redis Site
#36Earlier quoted context omitted.
You'd be surprised if you went to meetings with porn business companies in Japan. Stylish offices, elegant suits, great manners, no hint of actual porn anywhere. In fact, you could easily confuse the office with an investment bank.
I once had a surreal meeting with a hotel chain where they mentioned they had detailed management reports on stuff like the average time films are watched for and that they had a graph showing how long porn movies are watched for. This was all being discussed in the context of a fairly formal business meeting.
I used to work with a company who provide most of the network/software/hardware for hotels/airports/tran stations/lobbies around the world.
Some very interesting insights from the hotels side of things.
Re: Youporn.com is now a 100% Redis Site
#37Earlier quoted context omitted.
We do the same thing, where we populate a mysql store as a secondary storage for business intelligence -- our Founder, PM, AdOps, etc know enough SQL to be dangerous if we build out more traditional, relational models. It amused me that you were testing a porn site -- the homepage / potentially-misused zrange-issue.
I had to test if it was truly fast...
All in the name of science!
Re: Youporn.com is now a 100% Redis Site
#38"After the switchover we had to add some additional Redis nodes but not because Redis was overworked but because the network cards couldn't keep up with Redis."
Wow!
Re: Youporn.com is now a 100% Redis Site
#39Earlier quoted context omitted.
You know your software is successful when it's used by porn sites :D
I remember in the 90's having a conversation with my friend. We were discussing Linux vs Windows for web hosting. My friend said "tell me if you can find a single porn site that's hosted on Windows." He was right, I couldn't find any.
They do exist. I turned down the chance to interview at one about 6 months ago.
Re: Youporn.com is now a 100% Redis Site
#40For some reason I always imagine porn sites to be run by guys in cheap suits and lots of hair gel. Then I realize that in order to run a site with the kind of traffic that some of them have, you really need to have some decent engineers on staff.
[deleted]