Live data from Hacker News

We handle 80TB and 5M page views a month for under $400

blog.polyhaven.com

401–410 of 426 posts

Re: We handle 80TB and 5M page views a month for under $400

#401

Earlier quoted context omitted.

> You can't ensure the CEO of a company doesn't null route you. So the alternatives aren't better than Cloudflare, Superkuh just had an axe to grind specifically with Cloudflare. And there is no an alternative solution that wrests control from a CEO having a bad day. At the end of the day, he's still at the whims of the Cloudflare/Bunny/Akamai and if he wants to be fully in control he must spend millions building his…

Any alternative is better than everyone using Cloudflare. This would be true even if Cloudflare hadn't already demonstrated their untrustworthiness. It's true for LetsEncrypt even if LE is awesome and really improved the internet and there are other options. If people only use one thing in practice it is a locus of control.

"Why are you using this thing that solves your problems and does it cheaper than you making your own solution to your problems? You're leading to centralization of the internet!" Good luck changing human nature. Writing these comments here is helping, I'm sure of it. /s

Re: We handle 80TB and 5M page views a month for under $400

#402
post #382

Earlier quoted context omitted.

At Netflix we’re doing close to 400Gbps on 1U commodity hardware, and pretty inexpensive.

And that is 400Gbps encrypted ! Side Note, aren't they 2U?

Yep! All TLS.

The production boxes are 2U, but it can be done in a 1U box.

Re: We handle 80TB and 5M page views a month for under $400

#403

Earlier quoted context omitted.

> Nobody is on call 24H. This one dev is literally on call 365 days a year and can never be away from a computer on vacation. If he leaves, the project has no one. How is that not a problem? Surely you can see that this isn’t reasonable for anyone who wants to run a business, or any employee who doesn’t want the website to be their life. > If the system has a problem during the night, the users will wait until the mo…

> If you’re running a website where extended outages are no big deal and you don’t care about lost revenue, then it’s not really a valid comparison to the typical business website. I think you're severely underestimating how many businesses make a significant amount of money from their website, but doesn't actually have full-time developer available. An extended outage would cause significant revenue loss, but it's t…

> An extended outage would cause significant revenue loss, but it’s typically not a problem

This just seems like a bad decision from a business perspective. You are willing to endure a significant outage that will cost a lot of money but not pay to prevent it? Machines can and will fail.

Re: We handle 80TB and 5M page views a month for under $400

#404

Earlier quoted context omitted.

This! Hetzner root servers, there is nothing else I know on the market that comes close in price/power ratio when you use the "Serverbörse". I run multiple low traffic websites, databases and a heavy traffic elk instance + my complete homelab in proxmox / docker for 48€ a month and there is even room for more. Highly recommended!

What is your strategy for dealing with server failure?

I do not have an HA setup BUT all of my proxmox vms are snapshot backuped by proxmox backup server every night to my home NAS and to my office NAS. You can use one of many storage providers. SSHFS also works. This is the cheapest and lowest administration solution I used till today. For production usage I would recommend 3-4 similar speced 28€ machines and run a replicated proxmox cluster or ceph proxmox cluster.

Re: We handle 80TB and 5M page views a month for under $400

#405
post #400

Earlier quoted context omitted.

I have two of the AX41-NVMe, and only one was lucky enough to get a "Intel Corporation I210 Gigabit Network Connection (rev 03)" which has the hardware timestamping. In the finland datacenter, it appears there is a PTP running, though the offset is ~2.33 seconds off from NTP. Chrony says its a false-ticker, but I haven't really figured out how to get it configured correctly nor have I asked Hetzner for help. I've mos…

Would you care to share the IPs? (both for the Hetzner PTP one and the local ISP stratum 1) Is the 2.33s stable? If so, after deducing the stable offset, it could still be valuable.

`/dev/ptp0` and `/dev/pps0` magically showed up and yeah, it appears to be stable. Chrony actually has it marked as a non-false ticker atm and is marked as a backup. Here's the stats:

  Name/IP Address            NP  NR  Span  Frequency  Freq Skew  Offset  Std Dev
  ==============================================================================
  PPS                        64  40   67m     -6.827     33.059    -72ms    99ms
  PTP                         6   3    20     -9.585      0.005   -119ms    10ns
  192.168.100.1               6   3   88h     -0.159      0.000    -12ms  3815ns
  192.168.100.2               6   3   29h     -0.176      0.299    -11ms  2817us
  ntp1.hetzner.de            14  10  154m     -0.003      0.006    -47us    12us
  ntp2.hetzner.de            11   6  103m     -0.001      0.005    -21us  5711ns
  ntp3.hetzner.de             9   6  137m     -0.006      0.007    -72us  8949ns
I don't feel great about sharing the discovered stratum 1's on the open internet, but my email address is in my profile.

Re: We handle 80TB and 5M page views a month for under $400

#406

Honestly you can go very far with unmettered data plans. We consume 2GB/S, maxed out, which ends up being 5184TB a month. We have millions on users a day, all on a streaming video platform. It cost less than $2K/Month. The cloud is crazy expensive. Private servers are beasts, and they are cheap. Of course, for this price, you don't have redundancy and horizontal scaling. You also don't have to maintain and debug a sy…

> We consume 2GB/S, maxed out, which ends up being 5184TB a month. We have millions on users a day, all on a streaming video platform. > It cost less than $2K/Month. The solution in this article is serving on the order of 100TB/month for $400/month including a high speed global CDN, their API and database servers being hosted reliably, and redundancy and backup being handled by someone else. Your solution is hosting…

Does it work for video as well?

Re: We handle 80TB and 5M page views a month for under $400

#407

Earlier quoted context omitted.

All of the Affinity products are top notch. I wanted a simple vector tool and ended up liking Affinity Designer so much I picked up a course to learn it more in-depth. The best part is their pricing model doesn't suck, so I'm happy to pay for their wares.

Which course did you take?

It was an iPad specific course on Udemy [0] a couple years ago. Looks like it hasn't been updated in a while, but it was great for what I was after.

[0] https://www.udemy.com/course/vector-drawing-on-the-ipad-with...

Re: We handle 80TB and 5M page views a month for under $400

#408
post #166

First of all, kudos, I’m a junkie for such optimizations myself. It’s a pleasure that your systems are optimized well, you sleep well and you’re proud :) Two thoughts: 1) CloudFlare offers incredible service. What would need the team of netadmins/sysadmins can be handled via their UI easily. I use Argo in one project and yes, it is a very efficient tool. CloudFlare is becoming like AWS, knowing its tools is a skill.…

I'm new to this stuff, but what the source article describes is essentially just that it is cheaper to run a static website with a CDN than without - right? I'm mostly curious because they described the cloudflare service as a cache layer rather than a CDN.

Re: We handle 80TB and 5M page views a month for under $400

#410
post #105

Earlier quoted context omitted.

> Database: Firestore – $100 (replace with Cloudflare) Does Cloudflare have a database offering? Do you just mean the Worker KVs, or is there a full relational database?

Firestore isn't a full relational DB, so why would a replacement need to be?

Good point. I'd assumed it was a full RMDB, but hadn't ever really spent much time with it.
Post reply on HN