Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple downloads ~45 TB of models per day from our S3 bucket

twitter.com

Post reply on HN
Print view View original

71–80 of 237 posts

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#71

Post by derefr »

lgats wrote: post #69
nathantotten wrote: post #58

Earlier quoted context omitted.

Not to mention that if Cloudflare CDN was in front of it this traffic would be free.

I'm skeptical of the number of 500+ MB files the CloudFlare CDN would actually cache... Does anyone have any numbers on this?

Correct; Cloudflare doesn't cache large asset files (I think anything more than 2MB?) by default. It's not that kind of CDN... at least, not for free it's not.

Of course, you can trick Cloudflare into caching your large media assets using some funky Page Rules... but I wouldn't suggest it. Mostly just for moral reasons. If you have that much traffic, you should be making some money off it and then paying Cloudflare with it!

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#72

Post by nathantotten »

lgats wrote: post #69
nathantotten wrote: post #58

Earlier quoted context omitted.

Not to mention that if Cloudflare CDN was in front of it this traffic would be free.

I'm skeptical of the number of 500+ MB files the CloudFlare CDN would actually cache... Does anyone have any numbers on this?

Good point. I guess for free plans they only cache up to 512mb files [1]. It does seem you can set page rules to cache large files by extension [2].

1. https://support.cloudflare.com/hc/en-us/articles/200172516 2. https://support.cloudflare.com/hc/en-us/articles/11500015027...

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#73

Post by orf »

lgats wrote: post #69
nathantotten wrote: post #58

Earlier quoted context omitted.

Not to mention that if Cloudflare CDN was in front of it this traffic would be free.

I'm skeptical of the number of 500+ MB files the CloudFlare CDN would actually cache... Does anyone have any numbers on this?

512mb: https://support.cloudflare.com/hc/en-us/articles/200172516

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#74

Post by flotwig »

brodie78382 wrote: post #67
vonseel wrote: post #48

Earlier quoted context omitted.

Pretty amazing that a single company can own an entire block of IP space, if I understand this correctly. Approx how many addresses is this?

I used to work for HP and someone explained to me a select few companies got /8's when the internet was still young. HP got one, Compaq had one which HP now also owns. I was basically told if you had a /8 you didn't give it up because of how valuable and rare they now are (this was around 2010, too). GE, Kodak, Apple, and Microsoft were a few other names that came up in that discussion as well.

GE actually sold their entire 3.0.0.0/8 block off to AWS a few years ago.

It's a little awkward since a lot of internal software is still configured to whitelist all access from that space since it was a constant for so long.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#75

Post by paulie_a »

brodie78382 wrote: post #67
vonseel wrote: post #48

Earlier quoted context omitted.

Pretty amazing that a single company can own an entire block of IP space, if I understand this correctly. Approx how many addresses is this?

I used to work for HP and someone explained to me a select few companies got /8's when the internet was still young. HP got one, Compaq had one which HP now also owns. I was basically told if you had a /8 you didn't give it up because of how valuable and rare they now are (this was around 2010, too). GE, Kodak, Apple, and Microsoft were a few other names that came up in that discussion as well.

The post office has/had one

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#76

Post by xxpor »

paulie_a wrote: post #75
brodie78382 wrote: post #67

Earlier quoted context omitted.

I used to work for HP and someone explained to me a select few companies got /8's when the internet was still young. HP got one, Compaq had one which HP now also owns. I was basically told if you had a /8 you didn't give it up because of how valuable and rare they now are (this was around 2010, too). GE, Kodak, Apple, and Microsoft were a few other names that came up in that discussion as well.

The post office has/had one

The DOD has like 5 or 6!

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#77

Post by kalleboo »

vonseel wrote: post #48
mariomariomario wrote: post #43

Earlier quoted context omitted.

This isn't sensitive information. Anyone with a BGP session can have this information. [1] [1] = https://bgp.he.net/AS714#_prefixes

Pretty amazing that a single company can own an entire block of IP space, if I understand this correctly. Approx how many addresses is this?

This map was drawn 13 years ago so it's heavily out of date but it does illustrate the companies that got their ip /8 blocks back the day (Ford?!) https://xkcd.com/195/

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#78

Post by qes »

nathantotten wrote: post #58
btown wrote: post #42

A brief reminder: Whenever you publish code or documentation that might be used/scraped by the outside world, ALWAYS use a domain you own. If you're on Cloudflare you can instantly (and for free) create Page Rules to use Cloudflare as a CDN, redirect to another CDN, or black-hole or reroute traffic anywhere you want.

Not to mention that if Cloudflare CDN was in front of it this traffic would be free.

Not with this amount of traffic it won't be free. 45 TB per day lol Cloudflare will be disabling your account and in contact for payment in a hurry.

Go ahead and try, see how far their "free" tier really goes.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#79

Post by ethbro »

brodie78382 wrote: post #67
vonseel wrote: post #48

Earlier quoted context omitted.

Pretty amazing that a single company can own an entire block of IP space, if I understand this correctly. Approx how many addresses is this?

I used to work for HP and someone explained to me a select few companies got /8's when the internet was still young. HP got one, Compaq had one which HP now also owns. I was basically told if you had a /8 you didn't give it up because of how valuable and rare they now are (this was around 2010, too). GE, Kodak, Apple, and Microsoft were a few other names that came up in that discussion as well.

Map: https://www.caida.org/research/id-consumption/census-map/ima...

(a bit dated, but shows the historic allocations)

Look up "CIDR", history thereof, for reasons why it looks this way.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#80

Post by qes »

paxys wrote: post #51

That's about $4000/month in bandwidth costs, assuming retail pricing. FYI he is bragging, not complaining. There are a dozen ways to reduce or eliminate this problem.

> That's about $4000/month in bandwidth costs

You're an order of magnitude off.

45 TB per day is 1,350 TB in a month, or 1,350,000 GB.

Show me somewhere you can get a petabyte of egress inside a calendar month for 4 figures USD...

Let's suppose you even used the cheaper egress from Cloudfront rather than serving from S3 (lol @ your wallet if you serve 1 PB doing that).

https://aws.amazon.com/blogs/aws/aws-data-transfer-prices-re...

The first petabyte costs an average of $0.045 per GB - $45,000.

The remaining 350 TB costs another $10,500 for a total of $55,500.

Serving off S3 directly? Yeah, that'll be more like $150,000.

Post reply on HN