Live data from Hacker News

Ask HN: Is Apple down?

news.ycombinator.com

51–60 of 118 posts

Re: Ask HN: Is Apple down?

#51

the domain name developer.apple.com resolves through a series of CNAMEs to Apple's CDN (applimg.com), which if it was down would explain other things like iMessage also being unavailable.

Some reports that there were DNSSEC validation issues w/ proxy.safebrowsing.apple which CNAMEs to aaplimg.com.

Re: Ask HN: Is Apple down?

#52

    nslookup
    > server a.ns.apple.com
    Default server: a.ns.apple.com
    Address: 2620:149:ae0::53#53
    Default server: a.ns.apple.com
    Address: 17.253.200.1#53
    > developer.apple.com
    Server:  a.ns.apple.com
    Address: 2620:149:ae0::53#53

    developer.apple.com canonical name = developer-cdn.apple.com.akadns.net.
    ** server can't find developer-cdn.apple.com.akadns.net: REFUSED
Ah. So Apple's own DNS servers are redirecting developer.apple.com to something on "akadns.net", which is operated by Akamai. But Apple's own DNS servers refuse to resolve that, probably because it's not in the apple.com zone.

More:

    nslookup
    > developer-cdn.apple.com.akadns.net
    Server:  127.0.0.53
    Address: 127.0.0.53#53

    Non-authoritative answer:
    developer-cdn.apple.com.akadns.net canonical name = world-gen.g.aaplimg.com.
    world-gen.g.aaplimg.com canonical name = apple-c.g.aaplimg.com.
    apple-c.g.aaplimg.com canonical name = apple-cf.g.aaplimg.com.
    apple-cf.g.aaplimg.com canonical name = apple-lr.g.aaplimg.com.
    > server a.ns.apple.com
    Default server: a.ns.apple.com
    Address: 2620:149:ae0::53#53
    Default server: a.ns.apple.com
    Address: 17.253.200.1#53
    > developer-cdn.apple.com.akadns.net
    Server:  a.ns.apple.com
    Address: 2620:149:ae0::53#53

    ** server can't find developer-cdn.apple.com.akadns.net: REFUSED
It's clearly a botched DNS configuration. Not clear what the intent was. Did they really want to point "developer.apple.com", a web site, to "developer-cdn.apple.com.akadns.net", which is a DNS server? Or am I misreading that?

It's generally considered bad form to have all the DNS servers for "example.com" under "example.com", by the way. If you mess up "example.com", or it goes down, getting to it to fix it can be difficult.

Anyway, this looks like an attempt to outsource something to Akamai that went badly wrong.

Re: Ask HN: Is Apple down?

#53
Looks like their DNS servers are responsive, but refuse to serve records:

    $ dig -t NS developer.apple.com
    [...]
    apple-lr.g.aaplimg.com.     14400   IN      NS      b.gslb.aaplimg.com.
    apple-lr.g.aaplimg.com.     14400   IN      NS      a.gslb.aaplimg.com.

    $ dig @a.gslb.aaplimg.com developer.apple.com
    [...]
    ;; ->>HEADER
Most likely a configuration mistake that'll be undone as soon as they figured out how to re-deploy their DNS servers while DNS is down.

Unlikely to be BGP shenanigans as some people on Twitter claim. My network has direct peerings to Apple's AS714.

Re: Ask HN: Is Apple down?

#54

Definitely. Downdetector shows a bunch of reports too (e.g. https://downdetector.com/status/apple-music/ ). I noticed issues with Music and News, seems like a ton of their services are down

Downdetector has predicted about 50 of the last 3 outages, and linking to them here just makes the self-fueling cycle even worse.

I think they’re about as useful as any anecdotal data out there. Unusually high numbers of reports when you’re seeing issues yourself is about as good as it gets until a status page is updated (which it thankfully has been finally).

Re: Ask HN: Is Apple down?

#55

Yep. Wife: My Apple Maps isn't working. Me: Hmm, it's not working for me either. They must be having server problems. You should use Google Maps for now. Wife: I can't download Google Maps either, the App Store doesn't seem to be working.

Maps, App Store, iMessage on macOS works They work on iOS as well - so it seems to be a regional thing? (Location: Germany)

Everything in the App Store was working for me except actually downloading apps. Seems to be (mostly) resolved now.

Re: Ask HN: Is Apple down?

#58

Earlier quoted context omitted.

Maps, App Store, iMessage on macOS works They work on iOS as well - so it seems to be a regional thing? (Location: Germany)

Everything in the App Store was working for me except actually downloading apps. Seems to be (mostly) resolved now.

for me the search function also refused to work, but the start page loaded without a problem... downloading an app still seems to not work though...

Re: Ask HN: Is Apple down?

#59
post #32
post #24

Earlier quoted context omitted.

A lot of system status pages are updated by humans who will verify issues before reporting them. Main reason is to avoid overly surface every minor and transitory issue to public view.

Quite easy to verify if the entire developer site is down though, non?

No. “Doesn’t respond for me” doesn’t imply “down for lots of people”. If you discover that foo.com doesn’t respond, it takes a while to figure out whether that’s on your system, in your network, in the city, etc.

Yes, you would set up multiple hosts across the world polling that server, but that adds complexity. Maybe, those pollers decide the site is down because of a bug in your network setup, while the rest of the world happily uses your services.

Post reply on HN