Cloudflare was down

(cloudflarestatus.com)

Comments

claudex 20 hours ago
> Cloudflare’s critical Workers KV service went offline due to an outage of a 3rd party service that is a key dependency.

So they depend on GCP for (some of) their services

koliber 21 hours ago
https://downdetector.com/ is showing outages at many major companies including Google, CloudFlare, AWS and more.

Word on the street is that there are large BGP routing issues behind all of this.

jerrygoyal 21 hours ago
GCP is also down https://news.ycombinator.com/item?id=44260810
neo_doom 21 hours ago
Yeah this is going to be a problem. I haven't seen an issue this widespread across so many services in a while.
tete 20 hours ago
Big blog post about how they saved the internet upcoming. ;)

Currently down, but reference: https://blog.cloudflare.com/the-ddos-that-almost-broke-the-i...

paxys 21 hours ago
Let me guess, someone pushed out a bad BGP config?
aranchelk 22 hours ago
Seems to be affecting functionality of their "Verify you are human" dialogs as well as Workers.
pier25 21 hours ago
They've changed the title to "Broad Cloudflare service outages"
PeterStuer 9 hours ago
So both Cloudflare authentication as well as Google's identity systems suffered major dowtime yesterday. Are there technical dependecies between these?
sidcool 17 hours ago
Cloudflare's lava lamps are dimming.
ourmandave 21 hours ago
Is it coincidence that there's a Scheduled Maintenance in Tokyo for 18:00 UTC in progress, and the problems started at 18:19 UTC?
poorman 19 hours ago
Can’t wait to read this post-mortem. Seems odd that a Google Cloud outage would bring down Cloudflare services.
pier25 20 hours ago
Our Workers apps are up again

edit:

It works in the US but EU customers are still reporting our services as down.

edit:

EU customers are reporting ok

iimblack 21 hours ago
They updated the incident noting that it's not just authentication affected.
b0a04gl 21 hours ago
distributed systems break, that’s the whole point what actually matters is how fast they localize damage and how invisible that feels to the end user if kv failing takes down auth, ui, and workers, then failure isolation’s missing recovery is fine, but if your fix needs global coordination to unbreak local flows, that’s a design smell not saying perfect uptime, but the post-outage ux should feel smoother, not shakier right now it feels like the system survived but the interface didn’t
pier25 21 hours ago
Workers KV has been down for like +30mins. This is impacting us seriously.

Their API is down too.

Amazing that something can impact their whole infrastructure like this given how much redundance they have.

vimwizard 21 hours ago
proxy seems available in general, must just be local to workers because only one of my sites going thru ZT tunnel with identity access rules is affected
ineedaj0b 21 hours ago
solar flare?
joduplessis 21 hours ago
Hopefully they also publish the prompt that did this.