Incident Library

Component

Backbone network (WAN)

백본망 · backbone-network

12 cases · 2019 to 2026

Root cause Configuration change3Dependency failure3Software defect3Operator error2Capacity exhaustion1
Contributing factor Excessive blast radius3Automation amplification2Circular dependency2Limited debug access2Harmful manual action2No configuration tests2Overlapping failures2Ineffective rollback2Single point of failure2Signal buried in noise1Unverified assumption1Ignored early signal1No headroom1Retry storm1
Symptom High latency7Network unreachable7Packet loss6Service outage4Link flapping2DNS resolution failures1High error rate1Intermittent connection failures1Intermittent timeouts1Monitoring outage1Replication lag1
Organisation 37signals2Linode2Cloudflare1Google Cloud1Meta1Microsoft Azure1OVHcloud1Packet1Scaleway1Wikimedia Foundation1

Cases, by severity

  1. IL-0394 A Cloudflare router in Miami leaked IPv6 BGP routes to peers and providers for 25 minutes, congesting the backboneCloudflare · 2026

    Root cause Configuration change

  2. IL-0564 Linode's Miami, Milan and Sao Paulo data centers had packet loss as traffic moved onto congested alternate pathsLinode · 2025

    Root cause Capacity exhaustion

  3. IL-0348 Scaleway's FR-PAR region lost public internet connectivity when one 100 Gbps backbone link was saturatedScaleway · 2025

    Root cause Operator error

  4. IL-0344 Linode's US-West data centers in Fremont and Santa Clara lost connectivity as the fibre circuits between them failedLinode · 2023

    Root cause Software defect

  5. IL-0225 An IGP purge command made every Microsoft WAN router recompute routes, causing global latency, timeouts and packet lossMicrosoft Azure · 2023

    Root cause Configuration change

  6. IL-0267 Wikimedia's eqsin cache site went unreachable when both of its transport links to the core data centers were downWikimedia Foundation · 2023

    Root cause Dependency failure

  7. IL-0228 IPv4 routing across OVHcloud's global network broke after a router change put the full internet routing table into OSPFOVHcloud · 2021

    Root cause Configuration change

  8. IL-0221 A backbone maintenance command disconnected all Facebook data centers, and its DNS servers withdrew their BGP routesMeta · 2021

    Root cause Operator error

  9. IL-0256 Basecamp was fully down twice in two days as hardware load balancers crashed and routers lost sync after failover37signals · 2020

    Root cause Software defect

  10. IL-0255 Basecamp's two redundant links between data centers dropped together and a Redis replica resync loop stalled chat37signals · 2020

    Root cause Dependency failure

  11. IL-0358 Packet Public Cloud locations had high latency and unreachable paths from routing loops and blackholed trafficPacket · 2019

    Root cause Dependency failure

  12. IL-0222 Google Cloud US regions had heavy packet loss and some went unreachable after the network control plane was descheduledGoogle Cloud · 2019

    Root cause Software defect

View on the graph