Live data from Hacker News

Apple downloads ~45 TB of models per day from our S3 bucket

twitter.com

141–150 of 237 posts

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#141
post #59
post #15

I don't have high hopes for his business prospects if this is how he handles one of the richest companies in the world clearly having a high need for something his company offers. Maybe spend less time on Twitter and more on your business model?

That tweet will get attention! Finding the right person is everything...

For better or worse, positioning yourself in a David / Goliath with Apple is almost always newsworthy. Interviews with the Apple underdog makes easy content.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#142
post #118
post #79

Earlier quoted context omitted.

Map: https://www.caida.org/research/id-consumption/census-map/ima... (a bit dated, but shows the historic allocations) Look up "CIDR", history thereof, for reasons why it looks this way.

Crazy how wasteful it is. I wonder what genius thought to allocate /8 to every company/organization. You don't need to have PhD in statistics and math to know there's more than 250 companies.

I wonder who will think about the genius who disbanded the EPA, rolled back every environmental protection there is and withdrew from the Paris Agreement at the most critical time for our planet in 40 years.

Hindsight is 20/20 and the „Internet“ was a mainly US centered university research project that was thought of as a toy by the far majority.

Everybody thought they‘d have a replacement for the initial assignment once things got serious... for more fun, google ipv6 history ^^

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#143

Earlier quoted context omitted.

Apple publishes that IP range (CIDR address block) in several KB articles on its own website for system administrators to configure firewalls/web filters. https://support.apple.com/en-us/HT210060 https://support.apple.com/en-gb/HT203609

That's rather beside the point. Just because I advertise my IP doesn't mean I want my service providers to disclose my activity publicly.

Maybe I'm misunderstanding something here, but does apple pay them for this?

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#145

Earlier quoted context omitted.

That's rather beside the point. Just because I advertise my IP doesn't mean I want my service providers to disclose my activity publicly.

Maybe I'm misunderstanding something here, but does apple pay them for this?

The point of this thread is that maybe Apple would pay if they were asked.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#147

Earlier quoted context omitted.

Apple publishes that IP range (CIDR address block) in several KB articles on its own website for system administrators to configure firewalls/web filters. https://support.apple.com/en-us/HT210060 https://support.apple.com/en-gb/HT203609

That's rather beside the point. Just because I advertise my IP doesn't mean I want my service providers to disclose my activity publicly.

> my service providers

Someone you get freebies from isn't a "service provider".

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#148

This is probably apple's continuous integration tests, lazily written to download the whole thing every time someone merges a commit.

that's really stupid. I mean, I would have set a cache repository (SonaType Nexus maybe?), download everything there and use that repository. In the tweets the author says they've blocked the download from Apple IPs, so now their pipeline is broken.

Unfortunately it's very common for companies to set up their CI without any form of caching. I think it's mostly because developers are under time pressure from their managers. In some cases it's because CI is set up by juniors who don't fully understand the tools and the consequences of setting them up at this scale.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#149

Earlier quoted context omitted.

Funny enough the highest price point for IP ranges is somewhere between /16 and /24, IIRC. You can count how many companies need and will be willing to pay 8-9 figures for a /8 without getting to your toes. And subnetting it and selling it to maximize returns is hard work. But if you’re sitting on a /21? That’ll move before you can count how many IPs are in the block ;)

Why are they so valuable?

Because there are only four billion addresses all in all. Every device that wants to be reachable on the Internet needs one. These days, mobile devices don't get a public address anymore and there are all sorts of complications due to it.

We're slowly transitioning to a new scheme with ample address space. But to nobody's surprise it's taking decades longer than envisioned.

Re: Apple downloads ~45 TB of models per day from our S3 bucket

#150

This is probably apple's continuous integration tests, lazily written to download the whole thing every time someone merges a commit.

that's really stupid. I mean, I would have set a cache repository (SonaType Nexus maybe?), download everything there and use that repository. In the tweets the author says they've blocked the download from Apple IPs, so now their pipeline is broken.

So they can fix it, now, that is is a problem, and they didn't have to spend time worrying about that before.

Sounds very smart on their party: move forward with what matters (building your codebase, tests, etc) and don't do something (like an internal cache), unless you have to -- the ops equivalent of lazy-loading...

Post reply on HN