Live data from Hacker News

Ask HN: How much does it cost to run Hacker News?

news.ycombinator.com

71–80 of 91 posts

Re: Ask HN: How much does it cost to run Hacker News?

#72
post #31
post #18

Earlier quoted context omitted.

I lol-ed at this. A few years ago, someone said it runs as a single process on 1 core and use no database, everything is written to filesystem.

Is that supposed to be a good thing?

Would it make your experience as a user better if the data was stored in a schema-less distributed database instead of saved to file? Would you browse it more often? If you had to pay for it, would you pay more money?

Because at the end of the day, none of those decisions matter, and sometimes the crappy, inelegant solution is cheaper and more understandable to the ones running it for almost two decades.

Re: Ask HN: How much does it cost to run Hacker News?

#73
post #13
post #7

I believe it still runs on one box. Xeon E5-3567 (3.5Ghz). Stack is FREEBSD with nginx as front-end. From a quick look at M5 hosting price, cost is probably $500-$1000/month (6M requests).

I wonder how much it would cost to run if it were designed and run with 2022 modern best practices of Kubernetes, Helm, Node + React, on a fleet of cattle servers hosted on AWS, paired with expensive add-on services because running PostgreSQL is too hard. The cynic in me says it would cost at least 10x that, require a full time team of 5 devops, and we'd suffer at the very least the same amount of outages, if not wor…

OOH, I'm cheering along with everyone else at this comment.

OTOH, I wish there was a reference book or something that takes this to a usable level.

Everyone who works on software knows that similar tasks can be completed by a 6 workers, a 6 figure budget or 600 and an 8 figure budget. A similar feature costs 6 hours, or 6,000 hours... in dissimilar circumstances. Some reasons for this are probably unavoidable. Deploying a moderation feature on Twitter is just different to deploying on a 10,000 user app. Some reasons are complex, and mysterious. Overall though, it is very difficult to fathom "Why." How can efficiency possibly vary by so much?! Should we even believe our eyes? Maybe it doesn't vary by that much?

I think one reason this is a nasty problem is that there are so many unrelated ways to answer it. They all yield different insights, and the different insights barely intersect... neither negating or supporting one another.

You could treat this as an engineering issue. How is HN's stack, code and such engineered. That'll give you an answer.

You could go one step before engineering: how do decisions/specs work? For HN, the same few head(s) decide what the site do, how to code it, moderate it, host it, etc. It doesn't change often, or much. A "minor feature" like christmas colours is probably conceived of, specced, approved, coded, released and operated by the same person. You don't suddenly discover that one of the steps is hard. An engineer doesn't have to explain to an idea person why X is harder than Y or why A creates more technical debt than B. They don't need to negotiate, compromise, or communicate in a least common denominator language.

This sort of management/organisational explanation doesn't negate the engineering explanation, but it does trivialize it. When I'm in "organisational brain" mode, I think of engineering decisions (eg. writing everything to the file system) as derivative. Those decisions happen because of organisational reality. This isn't strictly true, but it probably applies in most RL situations. A bank isn't going to engineer like this. Neither is a startup team of 50 newly hired ninjas. It's tempting to forget about engineering at this point... but that's obviously wrong.

Meanwhile, you can probably answer these questions 10 more ways. The team of 50 newly hired ninjas can be explained by funding. It's just what happens when VCs pour large sums into incubator startups en masse, in a tight labour market. We can go a step further: Maybe the VC stuff is derivative of monetary policies and macroeconomics... It's not untrue.

You might prefer a cultural explanation. IIRC, pg like this kind of explanation. Academic culture, FOSS, or government consulting cultures will get you to different code, stack, financial structures, etc. Hiring a LISP team will get you fundamentally different software than hiring a Java team. Much more different than legibly explainable by the differences between Java and LISP. It's technically possible to do the LISP thing in Java or vise versa. It won't happen though.

It just goes on and on, gets hairier and nastier as you go. I find that the deeper I go, the more I touch base with the aggravating starting point: the cost/efficiency of software varies by several order of magnitude: far more than reasonable.

Re: Ask HN: How much does it cost to run Hacker News?

#74
post #23

Earlier quoted context omitted.

Two years ago I emailed HN to ask why favoriting posts is rate limited. Got the reply, "HN's main software runs on a single core." They also said they are working on an overhaul of Arc and HN, which will massively improve performance.

They gave you false info https://news.ycombinator.com/item?id=34171328

NGINX does the heavy lifting, and can utilize many cores.

Re: Ask HN: How much does it cost to run Hacker News?

#75
post #5

Pretty sure the most expensive thing is @dang's time.

Do they really only have a single moderator? What happens when @dang has to sleep?

Legend has it that dang can moderate even while asleep.

On the other hand, I've read here previously that dang is not human but a lizard.

We may never know.

Re: Ask HN: How much does it cost to run Hacker News?

#76

Earlier quoted context omitted.

They had a hardware failure this year and were for a really short time on a cloud instance and behind cloudflare.

While most of your statement is true, it was direct-from-AWS (at least from my testing, so I'm not sure if some users were routed through Cloudflare).

Oh you might be right I could've sworn traceroute said cloudflare when I probed it.

Re: Ask HN: How much does it cost to run Hacker News?

#77
post #53

Earlier quoted context omitted.

In some circles of our buzz-word fuelled world what is considered “best practise” amongst risk-averse management is “what everyone else is already doing”. Anything else is too different: if it is such a good idea not to over-engineer, why is everyone else over-engineering?

How does one find the best tools for the job? I want to build something that is performant and maintainable, but I also don't want an over-engineered mess.

Read what others are doing, especially if it seems everyone is doing something similar, but, and this is the vital part, apply critical thinking & specific knowledge of your use case. And keep an eye on new ideas that are less common, and keep in mind old ideas that are out of fashion, and apply said critical thinking to them also (or use them & lessons learned using them in the past to judge against the other/newer ideas). Basically: avoid being part of the cargo cult, except on those occasions where it actually finds the right direction.

Re: Ask HN: How much does it cost to run Hacker News?

#78
post #13

Earlier quoted context omitted.

I wonder how much it would cost to run if it were designed and run with 2022 modern best practices of Kubernetes, Helm, Node + React, on a fleet of cattle servers hosted on AWS, paired with expensive add-on services because running PostgreSQL is too hard. The cynic in me says it would cost at least 10x that, require a full time team of 5 devops, and we'd suffer at the very least the same amount of outages, if not wor…

Buuut... The Aws+kubernetes approach is very scalable. If overnight, HN became the new Facebook, the single server model wouldn't work, and the business opportunity would be lost. However, the kubernetes model probably would scale (probably with a few hiccups still, but doable), and HN would suddenly be a 100x business. That is why business leaders pick the more expensive 'best practice' setup.

> If overnight, HN became the new Facebook, the single server model wouldn't work, and the business opportunity would be lost.

I know you're probably being /s but just in case ... all they'd need to do as a stop-gap hack whilst they worked it through is spin up another couple of servers and stick a load-balancer in front. If it does have a filesystem back-end then move that into cloud or network storage. Not ideal, but it would probably survive long enough for a more thought-through solution to arrive.

Re: Ask HN: How much does it cost to run Hacker News?

#79
post #39
post #32

Earlier quoted context omitted.

Why get those instead of modern Ryzens that are much faster at the same power levels?

Because I trust Intel and I don't see Mini-ITX motherboards with server grade quality for Ryzen... The only AMD I have ever had was a Thinkpad X100e and that convinced me to never buy anything AMD again. That said, X86 and ARM are peaking together so it does not matter what you buy, the M1 might save you some electricity but at peak performance below what a Xeon can deliver. For parallelism on the same atomic memory…

In microATX form factor Asrock has had a number of AM4 motherboards with IPMI and ECC RAM available for a long time. For example:

https://www.asrockrack.com/general/productdetail.asp?Model=X...

AMD is now firmly ahead in performance/watt, and in peak performance on most server-side benchmarks (see phoronix). Xeon superiority is a thing of the past. The only area where Intel is competitive is in AVX512 workloads.

Re: Ask HN: How much does it cost to run Hacker News?

#80
post #7

I believe it still runs on one box. Xeon E5-3567 (3.5Ghz). Stack is FREEBSD with nginx as front-end. From a quick look at M5 hosting price, cost is probably $500-$1000/month (6M requests).

Sorry, typo. Processor is E5-2637.

Source: https://news.ycombinator.com/item?id=16076041

Post reply on HN