Incident Library

Organisation

Lotte E-commerce

Lotte E-commerce · lotte-e-commerce

1 case · 2022

Root cause DNS or network fault

Component Cloud load balancer conntrack table Horizontal pod autoscaler Ingress controller kube-proxy Pod termination

Contributing factor Unreviewed defaults

Symptom High error rate Intermittent timeouts Stale endpoint routing

Cases

IL-0178 On EKS, HPA scale-in returned 502 errors because containers stopped before their pod IPs left the Service endpoints, and after blue/green switches conntrack kept sending established connections to deleted pods behind an instance-mode ALBLotte E-commerce · 2022
Root cause DNS or network fault