Live data from Hacker News

Youporn.com is now a 100% Redis Site

groups.google.com

101–110 of 133 posts

Re: Youporn.com is now a 100% Redis Site

#101
post #62
post #15

Earlier quoted context omitted.

You'd be surprised if you went to meetings with porn business companies in Japan. Stylish offices, elegant suits, great manners, no hint of actual porn anywhere. In fact, you could easily confuse the office with an investment bank.

Well, they almost ARE an investment bank. They've commoditized sex and are now trading it.

In that sense, a company that makes any commodity, like toilet paper or aluminum cans, is "almost" an investment bank.

Re: Youporn.com is now a 100% Redis Site

#102
post #98
post #2

That's porn for database geeks: 100 million pageviews per day, 300k requests per second against Redis. The way they use MySQL is also interesting IMHO: they populate a relational database in order to be able to build new indexes in the Redis side, using the relational DB for the stuff it is best at, generating new "views" of the data easily. (Relational DBs are also good to do a zillion more things of course.)

Sounds like Redis is being put to the role of reader boxes in the older split-head MySQL (or *SQL) architecture "write to master, read from slaves" with a conversion shim between MySQL & Redis..

I'm doing something similar with Dirty Hot Productions (one of my clients). We use MySQL on a separate CMS Rails app to store everything, and all of the websites communicate with the CMS via an API. We use Redis to cache all of the API responses, so effectively everything except the first read (or the first "dirty" read) on a particular query is coming straight from Redis. It works amazingly well, and it doesn't use nearly the amount of RAM I thought it would.

Re: Youporn.com is now a 100% Redis Site

#103
post #92
post #84

Earlier quoted context omitted.

Which make the concept of war even more obscene.

If you feel that sex is obscene, perhaps. Edit: Otherwise I don't see what the goal does to make the butchery of your fellow man any more or less obscene than it inherently is.

Allow me to explain the joke.

The legal definition of obscenity requires that a work is meant to be arousing and has patently offensive sexual conduct, in addition to having no redeeming artistic value.

Therefore, adding sex into something offensive makes it more obscene.

Re: Youporn.com is now a 100% Redis Site

#104
post #95

Earlier quoted context omitted.

Do you store the video using some sort of distributed file systems? specialized machine? SAN/NAS? Or the good old' NFS?

Nothing fancy actually. We have 3 dedicated storage servers (two in the same DC as our web server, one in germany), with lots and lots of disk space. We then SCP converted videos to them and serve them trough nginx (supports seeking).

Hey, thank you so much for the information. I hope you don't mind to share a little bit more (it's okay if you don't reply due to IP or whatnot, I'll understand).

How do you handle where to put the files on which disks? do you write custom software or there's some sort of off-the-shelf software to do this?

The reason I asked about this is because it looked like a few people I talked to seem to prefer to use Distributed File System such as HBase, GlusterFS or something else so that they don't have to write extra code.

And I'm guessing you back them all up on daily base as well?

Re: Youporn.com is now a 100% Redis Site

#105
post #4
post #3

Earlier quoted context omitted.

You know your software is successful when it's used by porn sites :D

I remember in the 90's having a conversation with my friend. We were discussing Linux vs Windows for web hosting. My friend said "tell me if you can find a single porn site that's hosted on Windows." He was right, I couldn't find any.

They do exist. I run a .NET developer tools company and had a customer purchase our data access products to use with several of their porn sites.

Never did manage to see the final product though!

Re: Youporn.com is now a 100% Redis Site

#106
post #94
post #75

Earlier quoted context omitted.

Sex and war would seem more accurate; porn being just a subset of sex. And I suppose one could argue that war is often just a manifestation of a desire for sex or power/money as an intermediary to sex.

Reading tip for you: Prometheus Rising by Robert Anton Wilson. Especially the part about the first 4 primitive circuits of the mind which govern survival, dominance, sex, stuff like that. War is very centered on Circuit II: dominance, emotions and territorial thinking. http://www.wikisummaries.org/Prometheus_Rising It fucked my mind when I read it :) It's a bit far out sometimes though, but it's a cool read.

It's even less scientific than Freud, and I regard Freud as much as speculation as science. At least Freud had case studies. :/

Re: Youporn.com is now a 100% Redis Site

#108
post #25

Earlier quoted context omitted.

Yep, i've been a Redis lobbyist for over a year at this company (i use to be the Lead Software Engineer on Youporn/Pornhub), and i'm really happy to see them using it and using it properly.

How do you store the videos? I remember seeing YouTube storing videos using some sort of specialized hardware from NetApp or something and they still got hit by the limitation of Linux filesystem (number of nodes?)

It was number of files in a directory, and those were the garage days.

Re: Youporn.com is now a 100% Redis Site

#109
post #30
post #24

Earlier quoted context omitted.

First off, I am not saying that youporn guys are not decent but IMHO, people shouldn't get too excited about this. Youporn is somewhat quite a simple site I'd imagine. It's just categorized videos with a bunch of stats (views, related video...), and users. There's almost no social interaction between users (i've just registered an account just to confirm that). That's a very clear (and good) reason why 100% redis sui…

Imagine the site now wants to add a little bit of social interaction, like allowing users to post video, follow each others Follow each other? I'm not sure you know what the point of a porn website is.

I'm pretty sure i know what I'm looking for in a porn site. There's many things youporn can do to help me watch better stuff.

Say I'm a fan of a porn star XXX and I'd like to see a simple notification that there's recently a new video tagging her. Same thing if I like some particular user's taste for porn and would like to get noticed if he/she has posted a video. Basically if it gets more social, my wall or dashboard or whatever, would be more sorta relevant.

Re: Youporn.com is now a 100% Redis Site

#110
post #35
post #24

Earlier quoted context omitted.

First off, I am not saying that youporn guys are not decent but IMHO, people shouldn't get too excited about this. Youporn is somewhat quite a simple site I'd imagine. It's just categorized videos with a bunch of stats (views, related video...), and users. There's almost no social interaction between users (i've just registered an account just to confirm that). That's a very clear (and good) reason why 100% redis sui…

You would imagine wrong. I'm running a video sharing page (think FB&youtube mashed together with a dash of blogger) with about 800k unique/month users and it's no picnic.

I apparently did NOT say that it's picnic. And I don't see how your reply is related to my comment. Does your site have enough social features? Like follow, walls... And is your site 100% redis too?
Post reply on HN