Incident Library

Organisation

Render

Render · render

1 case · 2024

Root cause Capacity exhaustion
Component CoreDNSetcdKubernetes API server
Contributing factor Unreviewed defaultsHarmful manual action
Symptom Control plane unresponsiveDeploys failingDNS resolution failuresHigh error rate

Cases

  1. IL-0204 An etcd memory spike overloaded the control plane of a Render Frankfurt cluster, and DNS then failed because CoreDNS ran on the rebooted control plane nodes and could not start without the API serverRender · 2024

    Root cause Capacity exhaustion