Incident Library

Organisation

NRE Labs

NRE Labs · nre-labs

1 case · 2018

Root cause unknown
Component etcdKubernetes API serverkubelet
Contributing factor Unreviewed defaultsIgnored early signalHarmful manual actionMonitoring blind spotSingle point of failure
Symptom Control plane unresponsiveProbe failuresService outage

Cases

  1. IL-0059 Single-master Kubernetes control plane kept dying because the kubelet restarted a healthy etcd on a failing kubeadm liveness probeNRE Labs · 2018

    Root cause unknown