Incident Library

Organisation

Spotify

Spotify · spotify

1 case · 2019

Root cause Configuration change
Component CI systemGKE control planeTerraform
Contributing factor Unverified assumptionNo safeguard on destructive changeMissed in review
Symptom Resources deleted

Cases

  1. IL-0061 A Terraform pull request merged out of order deleted a production GKE cluster, and recreating it deleted a second oneSpotify · 2019

    Root cause Configuration change