Render Is Down

#1

Post by neb_b » Tue, Mar 26, 2024, 4:18 PM UTC

Render Is Down
status.render.com

Re: Render Is Down

#2

Post by neb_b » Tue, Mar 26, 2024, 4:18 PM UTC

Their status page says operational, but even their main website https://render.com is down

edit: website is back up

Re: Render Is Down

#3

Post by christophilus » Tue, Mar 26, 2024, 4:21 PM UTC

It looks to me like it's related to Cloudflare: https://www.cloudflarestatus.com/

Re: Render Is Down

#4

Post by jgrahamc » Tue, Mar 26, 2024, 4:28 PM UTC

Their status page (https://status.render.com/) says:

Update - Many services recovered automatically, engineering is continuing to identify still affected services and mitigate issues as necessary.

Mar 26, 2024 - 16:28 UTC

Update - We are continuing to work on a fix for this issue.

Mar 26, 2024 - 16:20 UTC

Identified - We are encountering a broad range of outages across the Render Platform affecting connections and services. Engineering is working on mitigating the cause of these issues and narrowing down any non-affected components.

Mar 26, 2024 - 16:19 UTC

Re: Render Is Down

#5

Post by seabass » Tue, Mar 26, 2024, 4:29 PM UTC

Whenever there's an incident like this, it seems like the status pages take a while to reflect the problem. Why is that? The part of the status page that can be manually updated is now correct, but most of the automated checks still show 100% uptime and only "degraded performance" in some cases despite being fully offline.

If I were implementing a status page, it might look something like a ping to some url from various regions. Assuming that's what these status pages are doing, why do they often say "All systems operational" until well into the downtime? Frustrating that I have to confirm on HN before I can know for sure something isn't just down for me.

Re: Render Is Down

#6

Post by anurag » Tue, Mar 26, 2024, 4:32 PM UTC

(Render CEO) Things are recovering. We're still investigating, but the issue seems unrelated to Cloudflare. We'll post more updates on https://status.render.com.

Re: Render Is Down

#7

Post by Sytten » Tue, Mar 26, 2024, 4:37 PM UTC

All our services and databases are still down

Re: Render Is Down

#8

Post by anurag » Tue, Mar 26, 2024, 4:37 PM UTC

seabass wrote: post #5

Whenever there's an incident like this, it seems like the status pages take a while to reflect the problem. Why is that? The part of the status page that can be manually updated is now correct, but most of the automated checks still show 100% uptime and only "degraded performance" in some cases despite being fully offline. If I were implementing a status page, it might look something like a ping to some url from vari…

(Render CEO) As an engineer myself, I understand your frustration. Updating the status page automatically is a hard problem when the systems in question are distributed and complex. Perhaps we could post a generic 'something is wrong' message using the automated checks we have in place, and go from there.

Re: Render Is Down

#9

Post by anurag » Tue, Mar 26, 2024, 4:39 PM UTC

Sytten wrote: post #7

All our services and databases are still down

We're on it. Some databases are taking longer to recover.

Re: Render Is Down

#10

Post by Sytten » Tue, Mar 26, 2024, 4:40 PM UTC

anurag wrote: post #6

(Render CEO) Things are recovering. We're still investigating, but the issue seems unrelated to Cloudflare. We'll post more updates on https://status.render.com .

I expect to have a decent post-mortem for this major outage...