Incident Library

Organisation

Enigmo

Enigmo · enigmo

1 case · 2020

Root cause Breaking change in an upgrade
Component Node operating system imageNode pool
Contributing factor Change with a delayed effectIneffective rollback
Symptom Memory pressureSustained high node CPUNode NotReadyPods stuck in TerminatingUpgrade stall

Cases

  1. IL-0449 Pods on Enigmo's new EKS managed node groups kept restarting or stuck Terminating and the nodes became unusableEnigmo · 2020

    Root cause Breaking change in an upgrade