Incident Library

Organisation

Nordstrom

Nordstrom · nordstrom

1 case · 2017

Root cause Software defect
Component etcdIngress controllerKubernetes API serverPersistent volumes and stateful sets
Contributing factor Unreviewed defaults
Symptom Service outageStale or inconsistent API readsStale endpoint routing

Cases

  1. IL-0072 High etcd write latency made the API servers return stale data, and the production cluster flipped between two views of its stateNordstrom · 2017

    Root cause Software defect