Cloudflare outage on December 5, 2025

> Disabling this was done using our global configuration system. This system does not use gradual rollouts but rather propagates changes within seconds to the entire network and is under review following the outage we recently experienced on November 18.

> As soon as the change propagated to our network, code execution in our FL1 proxy reached a bug in our rules module which led to the following LUA exception:

They really need to figure out a way to correlate global configuration changes to the errors they trigger as fast as possible.

> as part of this rollout, we identified an increase in errors in one of our internal tools which we use to test and improve new WAF rules

Warning signs like this are how you know that something might be wrong!

Re: Cloudflare outage on December 5, 2025

#7

Post by RoyTyrell » Fri, Dec 05, 2025, 3:45 PM UTC

throwawaymaths wrote: post #4

jpeter wrote: post #2

Unwrap() strikes again

this time in lua. cloudflare can't catch a break

Or they're not thoroughly testing changes before pushing them out. As I've seen some others say, CloudFlare at this point should be considered critical infrastructure. Maybe not like power but dang close.

Re: Cloudflare outage on December 5, 2025

#8

Post by kachapopopow » Fri, Dec 05, 2025, 3:45 PM UTC

why does this seem oddly familiar (fail-closed logic)

Re: Cloudflare outage on December 5, 2025

#9

Post by gcau » Fri, Dec 05, 2025, 3:45 PM UTC

throwawaymaths wrote: post #4

jpeter wrote: post #2

Unwrap() strikes again

this time in lua. cloudflare can't catch a break

The 'rewrite it in lua' crowd are oddly silent now.

Re: Cloudflare outage on December 5, 2025

#10

Post by [deleted] » Fri, Dec 05, 2025, 3:46 PM UTC

[deleted]