Live data from Hacker News

We handle 80TB and 5M page views a month for under $400

blog.polyhaven.com

331–340 of 426 posts

Re: We handle 80TB and 5M page views a month for under $400

#331

Earlier quoted context omitted.

They didn’t mention a fleet size but 2GB/s is a single commodity server. You don’t even need a single employee to manage a single server…

Which "commodity server" could serve 2GB/s(16gbps) to public internet?

At Netflix we’re doing close to 400Gbps on 1U commodity hardware, and pretty inexpensive.

Re: We handle 80TB and 5M page views a month for under $400

#332

Earlier quoted context omitted.

Anything over 100ms [1] is perceived as not-instant by a user. If you wait 2RTTs with 50ms per round trip, then you've already exceeded this threshold. [1]: https://stackoverflow.com/questions/536300/what-is-the-short...

To clarify, i don't disagree. I just think if your site takes 700ms, is there really a difference between that and 650ms?

If that additional 50ms hits your user's bail-out threshold, yeah.

Re: We handle 80TB and 5M page views a month for under $400

#333

Earlier quoted context omitted.

> We consume 2GB/S, maxed out, which ends up being 5184TB a month. We have millions on users a day, all on a streaming video platform. > It cost less than $2K/Month. The solution in this article is serving on the order of 100TB/month for $400/month including a high speed global CDN, their API and database servers being hosted reliably, and redundancy and backup being handled by someone else. Your solution is hosting…

A python that knows python and linux is enough to support the up time needs and evolutions of this particular product. Actually a part time one. The entire team is composed of half of one dev. I'm 100% sure it's way cheaper than anybody that has AWS on resume. Of course, some things have to give, like the global CND, and some data guarantees. Everything is a compromise. It's all depend of what is important for your p…

> The entire team is composed of half of one dev.

Who is on-call 24/7/365, never takes vacation ever, and is always available to fix the website?

It’s weird how much HN hates jobs with on-call requirements, but every time cloud services come up the solutions always involve forcing someone to be permanently on call to save a few hundred dollars per month in hosting costs.

Re: We handle 80TB and 5M page views a month for under $400

#334

Earlier quoted context omitted.

> I think to manage private servers of that size you would need at least two extra experts totalling at least $20k/month. What? You set up the deployment once, and then you only need to touch it when things go horribly wrong, which is every couple of months, or to make minor quick tweaks and run some updates. Let's be generous, and say you need 10 h/month, which is about 1/16 of a person-month. And if things go horri…

> What? You set up the deployment once, and then you only need to touch it when things go horribly wrong, which is every couple of months Right, which is exactly why people pay extra for cloud managed services. If things are going “horribly wrong” every couple of months then you must necessarily be on call 24/7 and never take vacation or time away. In practice, you need at least two people to manage on-call coverage…

Things go horribly wrong every year or so. The site goes down. It's fine. This isn't Facebook.

Re: We handle 80TB and 5M page views a month for under $400

#335

Earlier quoted context omitted.

> I think to manage private servers of that size you would need at least two extra experts totalling at least $20k/month. What? You set up the deployment once, and then you only need to touch it when things go horribly wrong, which is every couple of months, or to make minor quick tweaks and run some updates. Let's be generous, and say you need 10 h/month, which is about 1/16 of a person-month. And if things go horri…

> What? You set up the deployment once, and then you only need to touch it when things go horribly wrong, which is every couple of months Right, which is exactly why people pay extra for cloud managed services. If things are going “horribly wrong” every couple of months then you must necessarily be on call 24/7 and never take vacation or time away. In practice, you need at least two people to manage on-call coverage…

We're talking volunteer-run projects, though. Who cares if it's not available 24/7? Best-effort is good enough. Those managed cloud services also fail often, you just have no information and no recourse about it.

Re: We handle 80TB and 5M page views a month for under $400

#336

Earlier quoted context omitted.

> I think to manage private servers of that size you would need at least two extra experts totalling at least $20k/month. What? You set up the deployment once, and then you only need to touch it when things go horribly wrong, which is every couple of months, or to make minor quick tweaks and run some updates. Let's be generous, and say you need 10 h/month, which is about 1/16 of a person-month. And if things go horri…

> What? You set up the deployment once, and then you only need to touch it when things go horribly wrong, which is every couple of months Right, which is exactly why people pay extra for cloud managed services. If things are going “horribly wrong” every couple of months then you must necessarily be on call 24/7 and never take vacation or time away. In practice, you need at least two people to manage on-call coverage…

Things go horribly wrong with AWS hosted stuff as well. And a lot of companies have a single-point-of-failure AWS person. While you're not wrong in general, nothing you just wrote is specific to running on dedicated servers vs AWS.

Re: We handle 80TB and 5M page views a month for under $400

#337

Earlier quoted context omitted.

A python that knows python and linux is enough to support the up time needs and evolutions of this particular product. Actually a part time one. The entire team is composed of half of one dev. I'm 100% sure it's way cheaper than anybody that has AWS on resume. Of course, some things have to give, like the global CND, and some data guarantees. Everything is a compromise. It's all depend of what is important for your p…

> The entire team is composed of half of one dev. Who is on-call 24/7/365, never takes vacation ever, and is always available to fix the website? It’s weird how much HN hates jobs with on-call requirements, but every time cloud services come up the solutions always involve forcing someone to be permanently on call to save a few hundred dollars per month in hosting costs.

Nobody is on call 24H.

If the system has a problem during the night, the users will wait until the morning.

The world doesn't stop because a streaming service is down for a few hours. It's not a medical service, or something thousands of businesses rely on.

It just looses a bit of money and users are grumpy for a day because they had to wait until they could access new content.

It's ok.

Re: We handle 80TB and 5M page views a month for under $400

#338

As someone building on a mostly free service with lots of content this is very helpful, thank you! Will probably migrate from S3 to Blackblaze, seems like a great deal.

Depending on how much you access per month, Storj DCS[0] and Wasabi[1] can also be interesting choices.

- Storj has the lowest cost per TB, but charges for egress - Wasabi doesn't charge for egress, but has a fair use policy where if you egress more than you store they can kick you off their platform[2] - Wasabi is also a better fit only if you plan to keep your files around for 90+ days (they have a minimum object retention period) - The bandwidth alliance is only available for HTML related content unless you're on a specific paid plan[3]

[0] https://www.storj.io/ [1] https://wasabi.com/ [2] https://wasabi.com/paygo-pricing-faq/#free-egress-policy [3] https://www.cloudflare.com/terms/#28-limitation-on-serving-n...

*opinion is mine, not my employer's

Re: We handle 80TB and 5M page views a month for under $400

#339

Earlier quoted context omitted.

A python that knows python and linux is enough to support the up time needs and evolutions of this particular product. Actually a part time one. The entire team is composed of half of one dev. I'm 100% sure it's way cheaper than anybody that has AWS on resume. Of course, some things have to give, like the global CND, and some data guarantees. Everything is a compromise. It's all depend of what is important for your p…

> The entire team is composed of half of one dev. Who is on-call 24/7/365, never takes vacation ever, and is always available to fix the website? It’s weird how much HN hates jobs with on-call requirements, but every time cloud services come up the solutions always involve forcing someone to be permanently on call to save a few hundred dollars per month in hosting costs.

I think it's bizarre you're giving cloud marketing material to a person, whose in a position to know their own situation, as-if you were describing their situation.

Like.. what are you expecting to happen? You'll just gaslight them into thinking they dont know how their business works?

Re: We handle 80TB and 5M page views a month for under $400

#340

Earlier quoted context omitted.

> The entire team is composed of half of one dev. Who is on-call 24/7/365, never takes vacation ever, and is always available to fix the website? It’s weird how much HN hates jobs with on-call requirements, but every time cloud services come up the solutions always involve forcing someone to be permanently on call to save a few hundred dollars per month in hosting costs.

I think it's bizarre you're giving cloud marketing material to a person, whose in a position to know their own situation , as-if you were describing their situation. Like.. what are you expecting to happen? You'll just gaslight them into thinking they dont know how their business works?

I’m discussing the linked article, which is what this comment section is for and it’s what the parent commenter was comparing to.
Post reply on HN