Live data from Hacker News

We handle 80TB and 5M page views a month for under $400

blog.polyhaven.com

101–110 of 426 posts

Re: We handle 80TB and 5M page views a month for under $400

#101

We have an incredibly similar stack for attic.city, aside from the application layer. We lean heavily on CF (edge caching, Argo and page rules). But we’ve recently changed our image assets from S3 to CF R2. Anyone else put that side by side with Bunny?

What? how do you have access to R2?

Re: We handle 80TB and 5M page views a month for under $400

#102

Earlier quoted context omitted.

> The bulk of the traffic is serving static files. The bulk of the data transferring is static files because they're hosting large assets, but the rest of the article is about their API, database, etc. A single server in a single datacenter isn't comparable to a global CDN. They made it clear in the article that they value global latency, and they're willing to pay more for it. > Here is a 3.3 GHz Xeon, 24 GB of RAM,…

What's wrong with a spinning hard disk? The files are super easy to read, we're talking milliseconds, and once done it stays in the page cache in RAM... that completely negates any SSD advantage. SSDs have little to no benefit in serving static files. If you're really strict on this it's trivial to preload these files in RAM after compiling your assets so you don't have to wait for a request.

Higher up someone calculated that they have 2TB of data, considering their $11/mo Backblaze bill. I calculate $11/$0.004/GB and get 2750 GB.

If you have 2.75TB of files to serve and have a bunch of simultaneous requests for different files:

- everything doesn't fit into the RAM page cache, unless you have 3TB of RAM in your server

- for files that aren't cached, you have to read from the drive

- when you have a bunch of different requests for different files, you're going to have a lot of disk seeks. Seeks are expensive on rotating media.

Serving a large collection of static files at scale can be quite challenging. At my previous e-commerce company, back in the early 2000's, we did our own image serving with RAID1 multiply-mirrored drives (before SSDs!) so we could multiply the seek capacity by the number of drives.

Re: We handle 80TB and 5M page views a month for under $400

#104
post #71

Earlier quoted context omitted.

I used it successfully on my Mac last week. It's still GIMP (bleh!) but it works.

You can consider Affinity Photo

Same suggestion, purchased during the last Christmas sales period. PS’s price is out of my reach as a non-professional user.

Re: We handle 80TB and 5M page views a month for under $400

#105

Seems like they could pratically host everything on Cloudflare and save even more money. Asset storage: Backblaze B2 – $11 (replace with Cloudflare R2) Web hosting: Vercel – $20 (replace with Cloudflare Pages, $0 cost) Database: Firestore – $100 (replace with Cloudflare) API: Vultr – $5 Image hosting & optimization: Bunny.net – $27 (replace with Cloudflare) Domains: Cloudflare – $4 Email fees: MXroute – $3

> Database: Firestore – $100 (replace with Cloudflare)

Does Cloudflare have a database offering? Do you just mean the Worker KVs, or is there a full relational database?

Re: We handle 80TB and 5M page views a month for under $400

#106
Do the Bunny images go through Argo?

If you were OK with your content only updating periodically you might be able to do away with Firestore, Argo, and Vultr.

You definitely do a great job of mitigating db hits. Consider publishing all the data to a CDN using something like Gatsby.

In this scenario your CI/CD would build a static website from all the assets and publish it to a static server.

You mentioned that only your view counts are the only really dynamic part. You could just estimate and emulate those or design them a different way.

Martin Fowler has an article on this: https://martinfowler.com/bliki/EditingPublishingSeparation.h...

Re: We handle 80TB and 5M page views a month for under $400

#107

Earlier quoted context omitted.

Quoted post unavailable.

> If you're going to centralize in Cloudflare you might as well just skip the hosting the website bit entirely and make a business account on Facebook as your host. These responses are getting bizarre. Facebook pages have nothing to do with web hosting or Cloudflare. Also, hosting on a single server in a single datacenter is, literally, the definition of centralized. Cloudflare distributes the content to a huge numbe…

Yup, I’m still wrapping my head reading these comments, “bizarre” is the word I was looking for.

Re: We handle 80TB and 5M page views a month for under $400

#108
post #105

Seems like they could pratically host everything on Cloudflare and save even more money. Asset storage: Backblaze B2 – $11 (replace with Cloudflare R2) Web hosting: Vercel – $20 (replace with Cloudflare Pages, $0 cost) Database: Firestore – $100 (replace with Cloudflare) API: Vultr – $5 Image hosting & optimization: Bunny.net – $27 (replace with Cloudflare) Domains: Cloudflare – $4 Email fees: MXroute – $3

> Database: Firestore – $100 (replace with Cloudflare) Does Cloudflare have a database offering? Do you just mean the Worker KVs, or is there a full relational database?

Firestore isn't a full relational DB, so why would a replacement need to be?

Re: We handle 80TB and 5M page views a month for under $400

#109
post #107

Earlier quoted context omitted.

> If you're going to centralize in Cloudflare you might as well just skip the hosting the website bit entirely and make a business account on Facebook as your host. These responses are getting bizarre. Facebook pages have nothing to do with web hosting or Cloudflare. Also, hosting on a single server in a single datacenter is, literally, the definition of centralized. Cloudflare distributes the content to a huge numbe…

Yup, I’m still wrapping my head reading these comments, “bizarre” is the word I was looking for.

Conflating cloudflare's distributed architecture with distributed control is just silly. It is extremely centralized control and the CEO of Cloudflare has already terminated accounts of a business he had a personal distaste for on whim.

"Non-commercial" might be a better way to understand this point of view. Instead of prioritizing profit (the reason for people using cloudflare, it's cheap and good) the idea is to minimize the damage done by large centralizing forces on the internet. So, in the above comment I suggest Facebook as an equal option because it is analogous to using Cloudflare. The intent was to get you to think like a human person and not a business owner or employee on the clock. It's short term gain for long term damage to the internet.

Re: We handle 80TB and 5M page views a month for under $400

#110
> But, we can get around that because of a partnership between Backblaze and Cloudflare they call the Bandwidth Alliance.

This reads like a paid marketing post for Cloudflare.

It's astonishing how many times the author conflates browser cache-able assets with cached assets on a CDN. When a browser downloads a static asset if the web server is configured properly those files will be cached and there won't be a need to re-download them for a very long time.

There is of course the issue with modern web frameworks like React generating a single massive js/css file that bundles everything all over again in a unique file busting all previous cached versions across all users' browsers just because a comma was added to a sentence.

Keep your js/css files small, serve them from your own web server and set a reasonable expire header, no need to pay Cloudflare $40/mo to continue gatekeeping the internet.

Post reply on HN