Incident Library

Organisation

U.S. Department of Health and Human Services

U.S. Department of Health and Human Services · u-s-department-of-health-and-human-services

1 case · 2023

Root cause Faulty deployment
Component DatabaseSchema migration
Contributing factor No runbookOverlapping failuresUnrepresentative stagingGap in automated tests
Symptom Deploys failingNode disk full

Cases

  1. IL-0523 TANF-app production deployments were blocked for two months when a search-index migration ran out of database disk spaceU.S. Department of Health and Human Services · 2023

    Root cause Faulty deployment