Live data from Hacker News

Apple downloads ~45 TB of models per day from our S3 bucket

twitter.com

11–20 of 237 posts

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#13
post #3

Have you considered cloudflair?

Backblaze B2 + Cloudflare = free outbound transfer (bandwidth alliance). Making objects in S3 publicly available and then complaining about their extortionate bandwidth charges is...silly.

Backblaze B2 + Cloudflare would be a perfect combination for hosting a static site. Unfortunately there's no way to map a Backblaze bucket to a domain, so even if you use cloudflare to point www.mydomain.com to it your files still show up at www.mydomain.com/path/to/bucket.

But it certainly works if you need to CDN a bunch of large files.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#14
post #13

Earlier quoted context omitted.

Backblaze B2 + Cloudflare = free outbound transfer (bandwidth alliance). Making objects in S3 publicly available and then complaining about their extortionate bandwidth charges is...silly.

Backblaze B2 + Cloudflare would be a perfect combination for hosting a static site. Unfortunately there's no way to map a Backblaze bucket to a domain, so even if you use cloudflare to point www.mydomain.com to it your files still show up at www.mydomain.com/path/to/bucket. But it certainly works if you need to CDN a bunch of large files.

You can use Cloudflare Workers to rewrite the path.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#18
post #9
post #8

I read the Twitter post but did not understand what is happening. Can someone please explain.

Apple employees are using their product, downloading lots of data, not paying for any of it, and the OP doesn't like it or can afford it.

I don't think it's employees as such — even Apple does not have THAT many machine learning people, and they wouldn't download models daily.

Maybe a server farm, where each instance downloads a model when spinning up?

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#19
post #12
post #11

Well, you could contact them and make a very-likely-to-succeed case that they should pay you some money, or you could complain about it on Twitter.

Twitter will probably be a faster response than automated email inboxes at Apple

The executive team email addresses that can be easily found are monitored quite well.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#20
post #3

Have you considered cloudflair?

Backblaze B2 + Cloudflare = free outbound transfer (bandwidth alliance). Making objects in S3 publicly available and then complaining about their extortionate bandwidth charges is...silly.

If you try to serve a petabyte of binary data a month through Cloudflare, they're going to shut you down.

S3 is very expensive, but averaging 4 gigabits 24x7 is not going to be cheap anywhere.

Post reply on HN