Incident Library

Organisation

Stytch

Stytch · stytch

1 case · 2023

Root cause Configuration change
Component Configuration templatingKarpenterNode pool
Contributing factor Unverified assumptionChange with a delayed effectIgnored early signalShared credential
Symptom Scale-up failureNode NotReadyPods PendingPod evictionService outage

Cases

  1. IL-0231 Deleting EKS managed node groups also deleted Karpenter's instance profile, and every Stytch worker node shut downStytch · 2023

    Root cause Configuration change