Incident Library

Organisation

Namespace

Namespace · namespace

1 case · 2024

Root cause Cloud provider outage
Component Kubernetes API server
Contributing factor No capacity planningNo headroomOverlapping failures
Symptom Control plane lagHigh latencyIntermittent connection failuresService outage

Cases

  1. IL-0084 Packet drops on a bare metal provider's vSwitch forced Namespace to rebuild its fra3 region and left global capacity short, and the next day slow NVMe writes on a control plane node drove the Kubernetes API server to very high CPUNamespace · 2024

    Root cause Cloud provider outage