Incident Library

Component

HTTP and RPC client library

HTTP·RPC 클라이언트 라이브러리 · http-client-library

3 cases · 2022

Root cause Cloud provider outage1Configuration change1Software defect1
Contributing factor Unreviewed defaults1Change with a delayed effect1Unknown limit1Monitoring blind spot1Overlapping failures1Retry storm1Gap in automated tests1
Symptom High error rate2DNS resolution failures1High latency1OOMKilled1Packet loss1Service outage1Stale endpoint routing1
Organisation Datadog1Mozilla1Spotify1

Cases, by severity

  1. IL-0461 Every rollout of Datadog's metrics query service on Kubernetes raised errors that the logs blamed on DNSDatadog · 2022

    Root cause Configuration change

  2. IL-0252 Spotify users who were logged out could not log back in during a global outage of service discoverySpotify · 2022

    Root cause Cloud provider outage

  3. IL-0253 Firefox froze and could not load any web content for close to two hours, stuck in an HTTP/3 request to TelemetryMozilla · 2022

    Root cause Software defect

View on the graph