Ask HN: How much does it cost to run Hacker News?
71–80 of 91 posts
Re: Ask HN: How much does it cost to run Hacker News?
#72Earlier quoted context omitted.
I lol-ed at this. A few years ago, someone said it runs as a single process on 1 core and use no database, everything is written to filesystem.
Is that supposed to be a good thing?
Because at the end of the day, none of those decisions matter, and sometimes the crappy, inelegant solution is cheaper and more understandable to the ones running it for almost two decades.
Re: Ask HN: How much does it cost to run Hacker News?
#73I believe it still runs on one box. Xeon E5-3567 (3.5Ghz). Stack is FREEBSD with nginx as front-end. From a quick look at M5 hosting price, cost is probably $500-$1000/month (6M requests).
I wonder how much it would cost to run if it were designed and run with 2022 modern best practices of Kubernetes, Helm, Node + React, on a fleet of cattle servers hosted on AWS, paired with expensive add-on services because running PostgreSQL is too hard. The cynic in me says it would cost at least 10x that, require a full time team of 5 devops, and we'd suffer at the very least the same amount of outages, if not wor…
OTOH, I wish there was a reference book or something that takes this to a usable level.
Everyone who works on software knows that similar tasks can be completed by a 6 workers, a 6 figure budget or 600 and an 8 figure budget. A similar feature costs 6 hours, or 6,000 hours... in dissimilar circumstances. Some reasons for this are probably unavoidable. Deploying a moderation feature on Twitter is just different to deploying on a 10,000 user app. Some reasons are complex, and mysterious. Overall though, it is very difficult to fathom "Why." How can efficiency possibly vary by so much?! Should we even believe our eyes? Maybe it doesn't vary by that much?
I think one reason this is a nasty problem is that there are so many unrelated ways to answer it. They all yield different insights, and the different insights barely intersect... neither negating or supporting one another.
You could treat this as an engineering issue. How is HN's stack, code and such engineered. That'll give you an answer.
You could go one step before engineering: how do decisions/specs work? For HN, the same few head(s) decide what the site do, how to code it, moderate it, host it, etc. It doesn't change often, or much. A "minor feature" like christmas colours is probably conceived of, specced, approved, coded, released and operated by the same person. You don't suddenly discover that one of the steps is hard. An engineer doesn't have to explain to an idea person why X is harder than Y or why A creates more technical debt than B. They don't need to negotiate, compromise, or communicate in a least common denominator language.
This sort of management/organisational explanation doesn't negate the engineering explanation, but it does trivialize it. When I'm in "organisational brain" mode, I think of engineering decisions (eg. writing everything to the file system) as derivative. Those decisions happen because of organisational reality. This isn't strictly true, but it probably applies in most RL situations. A bank isn't going to engineer like this. Neither is a startup team of 50 newly hired ninjas. It's tempting to forget about engineering at this point... but that's obviously wrong.
Meanwhile, you can probably answer these questions 10 more ways. The team of 50 newly hired ninjas can be explained by funding. It's just what happens when VCs pour large sums into incubator startups en masse, in a tight labour market. We can go a step further: Maybe the VC stuff is derivative of monetary policies and macroeconomics... It's not untrue.
You might prefer a cultural explanation. IIRC, pg like this kind of explanation. Academic culture, FOSS, or government consulting cultures will get you to different code, stack, financial structures, etc. Hiring a LISP team will get you fundamentally different software than hiring a Java team. Much more different than legibly explainable by the differences between Java and LISP. It's technically possible to do the LISP thing in Java or vise versa. It won't happen though.
It just goes on and on, gets hairier and nastier as you go. I find that the deeper I go, the more I touch base with the aggravating starting point: the cost/efficiency of software varies by several order of magnitude: far more than reasonable.
Re: Ask HN: How much does it cost to run Hacker News?
#74Earlier quoted context omitted.
Two years ago I emailed HN to ask why favoriting posts is rate limited. Got the reply, "HN's main software runs on a single core." They also said they are working on an overhaul of Arc and HN, which will massively improve performance.
They gave you false info https://news.ycombinator.com/item?id=34171328
Re: Ask HN: How much does it cost to run Hacker News?
#75Pretty sure the most expensive thing is @dang's time.
Do they really only have a single moderator? What happens when @dang has to sleep?
On the other hand, I've read here previously that dang is not human but a lizard.
We may never know.
Re: Ask HN: How much does it cost to run Hacker News?
#76Earlier quoted context omitted.
They had a hardware failure this year and were for a really short time on a cloud instance and behind cloudflare.
While most of your statement is true, it was direct-from-AWS (at least from my testing, so I'm not sure if some users were routed through Cloudflare).
Re: Ask HN: How much does it cost to run Hacker News?
#77Earlier quoted context omitted.
In some circles of our buzz-word fuelled world what is considered “best practise” amongst risk-averse management is “what everyone else is already doing”. Anything else is too different: if it is such a good idea not to over-engineer, why is everyone else over-engineering?
How does one find the best tools for the job? I want to build something that is performant and maintainable, but I also don't want an over-engineered mess.
Re: Ask HN: How much does it cost to run Hacker News?
#78Earlier quoted context omitted.
I wonder how much it would cost to run if it were designed and run with 2022 modern best practices of Kubernetes, Helm, Node + React, on a fleet of cattle servers hosted on AWS, paired with expensive add-on services because running PostgreSQL is too hard. The cynic in me says it would cost at least 10x that, require a full time team of 5 devops, and we'd suffer at the very least the same amount of outages, if not wor…
Buuut... The Aws+kubernetes approach is very scalable. If overnight, HN became the new Facebook, the single server model wouldn't work, and the business opportunity would be lost. However, the kubernetes model probably would scale (probably with a few hiccups still, but doable), and HN would suddenly be a 100x business. That is why business leaders pick the more expensive 'best practice' setup.
I know you're probably being /s but just in case ... all they'd need to do as a stop-gap hack whilst they worked it through is spin up another couple of servers and stick a load-balancer in front. If it does have a filesystem back-end then move that into cloud or network storage. Not ideal, but it would probably survive long enough for a more thought-through solution to arrive.
Re: Ask HN: How much does it cost to run Hacker News?
#79Earlier quoted context omitted.
Why get those instead of modern Ryzens that are much faster at the same power levels?
Because I trust Intel and I don't see Mini-ITX motherboards with server grade quality for Ryzen... The only AMD I have ever had was a Thinkpad X100e and that convinced me to never buy anything AMD again. That said, X86 and ARM are peaking together so it does not matter what you buy, the M1 might save you some electricity but at peak performance below what a Xeon can deliver. For parallelism on the same atomic memory…
https://www.asrockrack.com/general/productdetail.asp?Model=X...
AMD is now firmly ahead in performance/watt, and in peak performance on most server-side benchmarks (see phoronix). Xeon superiority is a thing of the past. The only area where Intel is competitive is in AVX512 workloads.
Re: Ask HN: How much does it cost to run Hacker News?
#80I believe it still runs on one box. Xeon E5-3567 (3.5Ghz). Stack is FREEBSD with nginx as front-end. From a quick look at M5 hosting price, cost is probably $500-$1000/month (6M requests).