Incident Library

Organisation

Webhook Relay

Webhook Relay · webhook-relay

1 case · 2022

Root cause Certificate or credential expiry
Component GKE control planeKubernetes API serverNode poolRBAC and service accounts
Contributing factor Limited debug accessSingle point of failure
Symptom Control plane lagControl plane unresponsiveCredentials unavailableService outageStale or inconsistent API reads

Cases

  1. IL-0113 The managed GKE control plane of Webhook Relay's main cluster failed because its API server certificates had never been rotated, and a manual credential rotation reported success without taking effectWebhook Relay · 2022

    Root cause Certificate or credential expiry