Live data from Hacker News

Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

infoq.com

81–90 of 114 posts

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#81
post #77

I was confused about the memcached problem after moving to the cloud. I understand why network latency may have gone from submillisecond to milliseconds, but how could you improve latency by batching requests? Shouldn't that improve efficiency, not latency, at the possible expense of latency (since some requests will wait on the client as they get batched)? And while maybe efficiency is valuable, why would that be an…

[deleted]

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#82
post #77

I was confused about the memcached problem after moving to the cloud. I understand why network latency may have gone from submillisecond to milliseconds, but how could you improve latency by batching requests? Shouldn't that improve efficiency, not latency, at the possible expense of latency (since some requests will wait on the client as they get batched)? And while maybe efficiency is valuable, why would that be an…

Though it might not be the situation in the video, introducing batching can decrease system latency. I made this little graph to show how this can work:

http://imgur.com/Vr6BqDq

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#84

Earlier quoted context omitted.

For me personally, it ends up being far more annoying. I really wish wikipedia would just put small unobtrusive text adverts on each page rather than the massive intrusive banners begging for money.

There is an issue of who calls the shots -- if you solicit donations from your users, that's who you are beholden to and need to serve to get money. If you are soliciting third party advertisements, that's who you are beholden to (and if you are using a third-party ad placement service, you are beholden to them as well as, perhaps more than, the actual advertisers.)

That is one issue, indeed. But the downside is that you're hassling your users to give you money, rather than hassling advertisers to give you money.

I'd rather not be hassled as a user.

I would also click on adverts, and buy things if they're useful to me, but I don't think I'd ever donate to a website.

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#85
post #34

Earlier quoted context omitted.

>> Reddit succeeded largely because the company that bought them is making money elsewhere. Such a nonsense makes me angry. Surely you've heard about companies called Google, Facebook, Linkedin, that succeeded without being bought and for a long time not making a profit.

The difference is Reddit isn't particularly looking for profit. Unless they completely change their business and way of doing things (unlikely to happen), they probably will never make a profit.

Agreed. If they are re-investing money to grow the product, that might be why they aren't currently profitable. That doesn't indicate a lack of success in my book.

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#86
post #77

I was confused about the memcached problem after moving to the cloud. I understand why network latency may have gone from submillisecond to milliseconds, but how could you improve latency by batching requests? Shouldn't that improve efficiency, not latency, at the possible expense of latency (since some requests will wait on the client as they get batched)? And while maybe efficiency is valuable, why would that be an…

As long as nothing's blocked, latency could go up 'a lot' (sub-ms -> ms, maybe 1ms->2ms with batching) without meaningfully impacting overall throughput.

I can definitely see millions of networked memcache calls being a bottleneck, and if the batching adds another ms per req on average, but removes the bottleneck, then they can serve a lot more users at a cost of 1ms per req.

Is there anything in TFA that would support my theory? I don't know. I don't care enough to endure InfoQ. (I did for a Rich Hickey talk once, lo these various months, and yea it were a minor inconvenience).

Edit: whoa jedbergo!

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#87
post #58

Earlier quoted context omitted.

But weren't you "deeply involved in the business?"

Yes. What point are you trying to make?

I think his point is that he doesn't understand accounting and how complicated it can be so he thinks that if you were deeply involved in the business you should know every facet of every debit and credit.

If he's right I guess I wasted about 300 hours studying for Financial Reporting and Analysis section in the Chartered Financial Analyst (CFA) program.

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#88

Earlier quoted context omitted.

Its not the alternative to advertising (it is advertising), its the alternative to soliciting and displaying third-party advertisements.

For me personally, it ends up being far more annoying. I really wish wikipedia would just put small unobtrusive text adverts on each page rather than the massive intrusive banners begging for money.

I really wish wikipedia would just put small unobtrusive text adverts on each page rather than the massive intrusive banners begging for money.

Hi, welcome to your first day on the Internet. Since you're new, let me tell you how things work around here.

There are probably dozens of web sites similar to Wikipedia. But Wikipedia is on the first page of search engine results for just about anything you search for. Why is that? Because people have learned that they can trust them over the last 12.5 years.

When you go to Wikipedia, you know that when you're looking for information on the Battle of Hastings that you aren't going to see ads for anatomy enlargement pills. You won't see any advertising at all in fact. You know that the community at large does a decent job at removing biased information. You know that a company can't buy their way into hiding negative information or promoting positive information.

This level of trust is what causes people to link to Wikipedia thousands of times per day.

So let's say Wikipedia takes your advice. They put a small unobtrusive text advert on each page. Suddenly you're searching for information on acne and an ad for "Acbegone" pops up that promises to cure your problem for 3 easy payments of $19.95. Acbegone ends up becoming a huge advertiser with Wikipedia - spending $1 million per month on advertising. Suddenly Wikipedia gets The Phone Call. "Hi, this is Acbegone. We'd love to continue advertising on your site but your article on acne mentions 10 other products. Get rid of those and we'll double our ad spend with you. Don't get rid of them and we'll be forced to stop advertising." Wikipedia can't make do without the income they've become accustomed to so they make editorial decisions to not mention any product - but still there's that ad from Acbegone. Suddenly Wikipedia seems like one huge cheesey ad. People stop trusting it. People stop linking to it. It stops coming up in search engine results.

For a real world excample, see http://en.wikipedia.org/wiki/Digg#Digg_v4

Look at that - a link to Wikipedia.

Re: Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

#89
post #87
post #58

Earlier quoted context omitted.

Yes. What point are you trying to make?

I think his point is that he doesn't understand accounting and how complicated it can be so he thinks that if you were deeply involved in the business you should know every facet of every debit and credit. If he's right I guess I wasted about 300 hours studying for Financial Reporting and Analysis section in the Chartered Financial Analyst (CFA) program.

Since this isn't reddit, I won't just say: ^^this.

But yes, I believe he was trying to point out that I couldn't have been involved if I didn't know, but doesn't understand the ins and outs of G&A and other such accounting practices.

Post reply on HN