Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Youporn.com is now a 100% Redis Site

groups.google.com

Post reply on HN
Print view View original

71–80 of 133 posts

Re: Youporn.com is now a 100% Redis Site

#71

Post by draegtun »

hercynium wrote: post #69

I'm currently looking into redis for similar needs. I'd be using it from perl and wondered how will it would scale... (IIRC (from people I know who have worked there) youporn/pornhub runs on Catalyst, an MVC-based web framework written in perl.)

Their certainly regarded as probably being one of the busiest Catalyst sites and they were employing Perl/Catalyst developers back in 2009: http://news.ycombinator.com/item?id=565152

NB: The HN article link hits an expired job post. Here is original job ad via WayBackMachine: http://web.archive.org/web/20090418113245/http://jobs.perl.o...

Re: Youporn.com is now a 100% Redis Site

#72

Post by Mikushi »

hercynium wrote: post #69

I'm currently looking into redis for similar needs. I'd be using it from perl and wondered how will it would scale... (IIRC (from people I know who have worked there) youporn/pornhub runs on Catalyst, an MVC-based web framework written in perl.)

Youporn used to work on Catalyst, it's been rewritten using Symfony 2. As for Pornhub it's running a custom PHP framework.

Re: Youporn.com is now a 100% Redis Site

#73

Post by Spearchucker »

gaius wrote: post #28
pellias wrote: post #10

Earlier quoted context omitted.

I was afraid to see what youporn is (at work now), so i guess it is really a porn site.

The online porn industry were the first people to really deal with scalability (of managing and serving web content, anyway), the first people to deal with online payments, the first people to come under really heavy, sustained hacking attempts, etc. Don't underestimate how much of what you take for granted technologically in 2012, they pioneered in the mid-90s.

They were also first at SEO - all of these sites competing for the same words - "sex" and "fuck" being their holy grail.

Re: Youporn.com is now a 100% Redis Site

#74

Post by pavelkaroukin »

johnx123-up wrote: post #67
antirez wrote: post #2

That's porn for database geeks: 100 million pageviews per day, 300k requests per second against Redis. The way they use MySQL is also interesting IMHO: they populate a relational database in order to be able to build new indexes in the Redis side, using the relational DB for the stuff it is best at, generating new "views" of the data easily. (Relational DBs are also good to do a zillion more things of course.)

Do they use any sort of wrapper or architecture around it? Is it in Ruby, BTW?

AFAIK, it is Perl project. And I remember seeing it showcased at Catalyst website, so it likely built on top of Catalyst Framework

Re: Youporn.com is now a 100% Redis Site

#75

Post by roc »

itmag wrote: post #55
badboy wrote: post #3

Earlier quoted context omitted.

You know your software is successful when it's used by porn sites :D

Porn and war drive all innovation. Or so they say.

Sex and war would seem more accurate; porn being just a subset of sex.

And I suppose one could argue that war is often just a manifestation of a desire for sex or power/money as an intermediary to sex.

Re: Youporn.com is now a 100% Redis Site

#76

Post by roc »

gaius wrote: post #28
pellias wrote: post #10

Earlier quoted context omitted.

I was afraid to see what youporn is (at work now), so i guess it is really a porn site.

The online porn industry were the first people to really deal with scalability (of managing and serving web content, anyway), the first people to deal with online payments, the first people to come under really heavy, sustained hacking attempts, etc. Don't underestimate how much of what you take for granted technologically in 2012, they pioneered in the mid-90s.

As well as advertising networks and referral schemes.

Though, oddly, they've been late to the game on social.

Re: Youporn.com is now a 100% Redis Site

#77

Post by vegardx »

exim wrote: post #16

How are you getting the actual content?

If you look at the http headers you'll see that they use varnish to cache the content and nginx as webservers. They probably have a pretty decent CDN to deliver the content to users across the world.

Side-note: I also heard that the founders of Akamai started up after seeing how the porn industry handled all the traffic from geographical different places.

Re: Youporn.com is now a 100% Redis Site

#78

Post by EmielMols »

SafdarIqbal wrote: post #38

"After the switchover we had to add some additional Redis nodes but not because Redis was overworked but because the network cards couldn't keep up with Redis." Wow!

That doesn't seem very special or unique to me though. In almost all settings where some in-memory data is pushed on the network stack, you can expect stuff to be network bound.

Re: Youporn.com is now a 100% Redis Site

#80

Post by povilas »

pavelkaroukin wrote: post #74
johnx123-up wrote: post #67

Earlier quoted context omitted.

Do they use any sort of wrapper or architecture around it? Is it in Ruby, BTW?

AFAIK, it is Perl project. And I remember seeing it showcased at Catalyst website, so it likely built on top of Catalyst Framework

No. It is PHP. https://groups.google.com/d/msg/symfony-devs/WGMooRPjmEY/hwW...
Post reply on HN