Live data from Hacker News

Apple downloads ~45 TB of models per day from our S3 bucket

twitter.com

41–50 of 237 posts

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#41
post #9
post #8

I read the Twitter post but did not understand what is happening. Can someone please explain.

Apple employees are using their product, downloading lots of data, not paying for any of it, and the OP doesn't like it or can afford it.

Is that normally freely available? Or is Apple accessing data that is publicly accessible but not meant to be shared?

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#42
A brief reminder: Whenever you publish code or documentation that might be used/scraped by the outside world, ALWAYS use a domain you own. If you're on Cloudflare you can instantly (and for free) create Page Rules to use Cloudflare as a CDN, redirect to another CDN, or black-hole or reroute traffic anywhere you want.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#43
post #25

Earlier quoted context omitted.

They're basically bragging they have something Apple really wants. Now they have a bunch of people at least interested in what they got. I'll say that's not a bad PR.

Also a great way to throw out massive red flags to any enterprise user that cares about privacy and non-disclosure. IP address data is pretty sensitive information, and throwing it out there like this, even in aggregate, is not OK because of what it shows. No matter how much PR this gets, this goes both ways.

This isn't sensitive information. Anyone with a BGP session can have this information. [1]

[1] = https://bgp.he.net/AS714#_prefixes

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#44
post #6

Earlier quoted context omitted.

Amazon has the ability to charge the requester. Pass the buck on.

i dont think this works on public files though, does it?

You can allow anyone to read it and pay as long as they authenticate with AWS so aws can bill them.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#45
post #42

A brief reminder: Whenever you publish code or documentation that might be used/scraped by the outside world, ALWAYS use a domain you own. If you're on Cloudflare you can instantly (and for free) create Page Rules to use Cloudflare as a CDN, redirect to another CDN, or black-hole or reroute traffic anywhere you want.

When working on APIs meant to be used client-side (especially mobile clients) by different customers are partners, use one subdomain per integrator. If there's a bug in their integration, it could easily DDoS your servers, but DNS is an easy way to have a manual kill switch.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#46
post #42

A brief reminder: Whenever you publish code or documentation that might be used/scraped by the outside world, ALWAYS use a domain you own. If you're on Cloudflare you can instantly (and for free) create Page Rules to use Cloudflare as a CDN, redirect to another CDN, or black-hole or reroute traffic anywhere you want.

huh? why publish if you don’t want it used?

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#47
post #25

Earlier quoted context omitted.

They're basically bragging they have something Apple really wants. Now they have a bunch of people at least interested in what they got. I'll say that's not a bad PR.

Also a great way to throw out massive red flags to any enterprise user that cares about privacy and non-disclosure. IP address data is pretty sensitive information, and throwing it out there like this, even in aggregate, is not OK because of what it shows. No matter how much PR this gets, this goes both ways.

They're not showing IP addresses, they're showing /8 CIDR blocks, that's very coarse granularity.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#48

Earlier quoted context omitted.

Also a great way to throw out massive red flags to any enterprise user that cares about privacy and non-disclosure. IP address data is pretty sensitive information, and throwing it out there like this, even in aggregate, is not OK because of what it shows. No matter how much PR this gets, this goes both ways.

This isn't sensitive information. Anyone with a BGP session can have this information. [1] [1] = https://bgp.he.net/AS714#_prefixes

Pretty amazing that a single company can own an entire block of IP space, if I understand this correctly. Approx how many addresses is this?

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#49
post #25

Earlier quoted context omitted.

They're basically bragging they have something Apple really wants. Now they have a bunch of people at least interested in what they got. I'll say that's not a bad PR.

Also a great way to throw out massive red flags to any enterprise user that cares about privacy and non-disclosure. IP address data is pretty sensitive information, and throwing it out there like this, even in aggregate, is not OK because of what it shows. No matter how much PR this gets, this goes both ways.

> Also a great way to throw out massive red flags to any enterprise user that cares about privacy and non-disclosure.

If you want to have a business relationship with someone, pay them.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#50
If a company the size of Apple finds this that useful, perhaps you should consider charging for your service, rather than just complaining on Twitter about the free usage you appear to have willingly given away?

Or perhaps you have reached out to them, but are for some reason still complaining on Twitter to drum up PR or something?

Regardless, this posting is ridiculously context-free to the point of being click-baity. (But hey, good job, I clicked on it anyway.)

Post reply on HN