Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Heroku was Down

news.ycombinator.com

Post reply on HN
Print view View original

131–140 of 149 posts

Re: Heroku was Down

#131

Post by bin_bash »

dspillett wrote: post #117
jlangenauer wrote: post #20

All our apps are down as well. And it seems (and I really have to almost laugh here) that https://status.heroku.com no longer loads.

As always, a note to infrastructure providers: HOST YOUR LIVE STATUS DETAILS ON OTHER INFRASTRUCTURE. Of course, they won't. If they host is on someone else's then that might look bad (tacitly saying that a competitor is reliable and might be up when they are down) and if they hive off an extra copy of some of their infrastructure there will still be single points of failure either accidentally, by human error (someo…

I am pretty sure Heroku has a Linode box or something for their status page. I may be wrong though. They may also have moved it but that would seem like an incredibly dumb idea.

I worked there and I vaguely remember something like this but it's been a long time.

If I had to guess this is probably a DNS issue (it's always DNS).

Re: Heroku was Down

#133

Post by adamrezich »

2OEH8eoCRo0 wrote: post #129
adamrezich wrote: post #123

Earlier quoted context omitted.

what does this have to do with Heroku? why would it be targeted? especially given that they're running on AWS?

> Every organization in the United States is at risk from cyber threats Heroku and AWS are organizations no? > While there are not currently any specific credible threats to the U.S. homeland, we are mindful of the potential for the Russian government to consider escalating its destabilizing actions in ways that may impact others outside of Ukraine.

this morning at work we had a database connection issue for a few hours. I work for a school district, which is an organization. therefore, it was probably a Russian cyberattack.

like what

Re: Heroku was Down

#134

Post by ne0n »

jpmw wrote: post #45

Let me bet: it's DNS. It's always DNS.

It was, but I don't know why. I'm curious to hear if Heroku releases any information about how this happened. Heroku's DNS was returning a single 100.64.x.x address which is in a reserved range.

Re: Heroku was Down

#135

Post by jpmw »

ne0n wrote: post #134
jpmw wrote: post #45

Let me bet: it's DNS. It's always DNS.

It was, but I don't know why. I'm curious to hear if Heroku releases any information about how this happened. Heroku's DNS was returning a single 100.64.x.x address which is in a reserved range.

They typically publish post-mortems, I think? Not 100% sure. They definitely do in-house.

We'll have to wait and see I guess.

Re: Heroku was Down

#136

Post by bin_bash »

driverdan wrote: post #74
ezekg wrote: post #18

I've been with Heroku for 7 years and this is the first time in recent memory that I've seen Heroku completely go down. Nothing at all works.

You haven't been paying attention. We're very heavy Heroku users. Their dashboard/API has gone down a few times in the past year. Overall they've been reasonably good. It's much better than it was 5+ years ago. Back then they had almost weekly downtime.

they had their big layoff in 2020 or 2021 though so I wouldn't expect it to improve

Re: Heroku was Down

#137

Post by 2OEH8eoCRo0 »

adamrezich wrote: post #133
2OEH8eoCRo0 wrote: post #129

Earlier quoted context omitted.

> Every organization in the United States is at risk from cyber threats Heroku and AWS are organizations no? > While there are not currently any specific credible threats to the U.S. homeland, we are mindful of the potential for the Russian government to consider escalating its destabilizing actions in ways that may impact others outside of Ukraine.

this morning at work we had a database connection issue for a few hours. I work for a school district, which is an organization. therefore, it was probably a Russian cyberattack. like what

> what would lead you to this conclusion?

I'm just posting what would lead somebody to that conclusion. Nobody is definitively saying anything right now.

Re: Heroku was Down

#139

Post by adamrezich »

2OEH8eoCRo0 wrote: post #137
adamrezich wrote: post #133

Earlier quoted context omitted.

this morning at work we had a database connection issue for a few hours. I work for a school district, which is an organization. therefore, it was probably a Russian cyberattack. like what

> what would lead you to this conclusion? I'm just posting what would lead somebody to that conclusion. Nobody is definitively saying anything right now.

yes, and I'm just pointing out how ridiculous of a conclusion this is.

Re: Heroku was Down

#140

Post by jrochkind1 »

sharksauce wrote: post #50

% heroku status › Warning: Our terms of service have changed: https://dashboard.heroku.com/terms-of-service Apps: Yellow Data: No known issues at this time. Tools: No known issues at this time. === Availability of Common Runtime apps 2022-02-24T16:50:47.249Z https://status.heroku.com/incidents/2402 investigating 2022-02-24T16:50:47.249Z (1 minute ago) Engineers are looking into reports of connectivity issues to Commo…

oh I didn't know that was a CLI command, nice!
Post reply on HN