Live data from Hacker News

Apple downloads ~45 TB of models per day from our S3 bucket

twitter.com

231–237 of 237 posts

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#232
post #48

Earlier quoted context omitted.

This isn't sensitive information. Anyone with a BGP session can have this information. [1] [1] = https://bgp.he.net/AS714#_prefixes

Pretty amazing that a single company can own an entire block of IP space, if I understand this correctly. Approx how many addresses is this?

There are many of them (obviously not very many) - Universities, too iirc. Most have divested by now.

It correlates strongly with big organizations who were "into" networking early on.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#233
post #29

Why can't they use cloudfront?

cloudfront costs money too.

For some reason I thought the prices for transfer were much better than S3, but that doesn't look like it's the case. It's lightly better, at large volumes.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#234
post #64

Hosting terabytes of data on an S3 bucket where people would download 45TB per month ($0.023/GB == $1000+/month) sounds like a really expensive way to distribute your data to people...

The graph makes it look like about 90% of the requests are apple, so I think this is intended to be serving more like 4.5TB per day. At that rate, I don't think its a terrible way to handle it, since S3 handles things all of the HA and scaling stuff internally. They clearly didn't expect apple to go whole hog on the service.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#236
post #161
post #145

Earlier quoted context omitted.

The point of this thread is that maybe Apple would pay if they were asked.

And how would you be contacting Apple, from your little 3-person startup in Paris ? You assume they have the means or contacts to do that; and IMHO the tweet is not that aggressive. It's been done before, (e.g Intel has been called out for consuming kernel.org bandwidth and git CPU power) and is the simplest way to have people from inside BigCorp get a message.

Blacklist the IP range and throw 404s with "please contact us, we're throttling you because load".

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#237
post #152

Earlier quoted context omitted.

Oh, so now IP addresses is PII? When it is inconvenient for FAAGM monster corporations? I seem to remember a few hundred thousands corporate statements that tracking individual IPs is totally ok and not surveillance.

IP addresses are definitely PII under GDPR.

That was the point of my comment.
Post reply on HN