Live data from Hacker News

Apple downloads ~45 TB of models per day from our S3 bucket

twitter.com

21–30 of 237 posts

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#21

Earlier quoted context omitted.

Backblaze B2 + Cloudflare = free outbound transfer (bandwidth alliance). Making objects in S3 publicly available and then complaining about their extortionate bandwidth charges is...silly.

If you try to serve a petabyte of binary data a month through Cloudflare, they're going to shut you down. S3 is very expensive, but averaging 4 gigabits 24x7 is not going to be cheap anywhere.

[deleted]

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#23

Earlier quoted context omitted.

Backblaze B2 + Cloudflare = free outbound transfer (bandwidth alliance). Making objects in S3 publicly available and then complaining about their extortionate bandwidth charges is...silly.

If you try to serve a petabyte of binary data a month through Cloudflare, they're going to shut you down. S3 is very expensive, but averaging 4 gigabits 24x7 is not going to be cheap anywhere.

>averaging 4 gigabits 24x7 is not going to be cheap anywhere

A normal upstream (if you were in a colo or some sort of DC) will charge you about $0.50 per meg. So, 4gbps would cost you... $200/mo. [1]

I think people don't realize just how much more expensive IaaS providers are. We're literally talking orders of magnitude.

[1] https://blog.telegeography.com/outlook-for-ip-transit-prices...

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#25
post #15

I don't have high hopes for his business prospects if this is how he handles one of the richest companies in the world clearly having a high need for something his company offers. Maybe spend less time on Twitter and more on your business model?

They're basically bragging they have something Apple really wants. Now they have a bunch of people at least interested in what they got. I'll say that's not a bad PR.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#27
post #15

I don't have high hopes for his business prospects if this is how he handles one of the richest companies in the world clearly having a high need for something his company offers. Maybe spend less time on Twitter and more on your business model?

You don't know that this was the only action he took. This was not a great criticism considering how limited our information is right now.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#28

Earlier quoted context omitted.

If you try to serve a petabyte of binary data a month through Cloudflare, they're going to shut you down. S3 is very expensive, but averaging 4 gigabits 24x7 is not going to be cheap anywhere.

>averaging 4 gigabits 24x7 is not going to be cheap anywhere A normal upstream (if you were in a colo or some sort of DC) will charge you about $0.50 per meg. So, 4gbps would cost you... $200/mo. [1] I think people don't realize just how much more expensive IaaS providers are. We're literally talking orders of magnitude. [1] https://blog.telegeography.com/outlook-for-ip-transit-prices...

$2000, it seems like you dropped a zero. And you're presumably going to need some burst capacity, so call it $4k for a 2:1 ratio if you care about not throttling at peak times.

The big cloud providers are very expensive, but you're getting impeccable bandwidth. Low packet loss, burst what you want even in peak times, fast transit worldwide, minimal variability.

What most people actually don't realize is that they're making that tradeoff implicitly. You're not being ripped off if you need all of these things, but if it's overkill you can get much cheaper bandwidth elsewhere.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#30
post #6

Earlier quoted context omitted.

Amazon has the ability to charge the requester. Pass the buck on.

i dont think this works on public files though, does it?

This is the main purpose of the oft maligned allauthenticatedusers permission in the s3 console - anyone can read it they just need an identity to pay
Post reply on HN