Incident Library

Organisation

Universe

Universe · universe

1 case · 2017

Root cause Capacity exhaustion
Component Jobs and CronJobsPod scheduling and placement
Contributing factor Unverified assumptionAutomation amplificationExcessive blast radius
Symptom Node NotReadyNode recreation loopService outage

Cases

  1. IL-0036 A reindex Job that kept failing exhausted one node after another until the whole cluster was downUniverse · 2017

    Root cause Capacity exhaustion