Incident Library

Organisation

Fastmail

Fastmail · fastmail

2 cases · 2016 to 2023

Root cause Dependency failure2
Component BGP routing1DDoS protection service1ISP and transit networks1
Contributing factor Limited debug access1Monitoring blind spot1Single point of failure1
Symptom Network unreachable2Service outage1

Cases

  1. IL-0259 Outbound packets from Fastmail did not reach part of the internet for about 19 hours, cutting off 3-5% of customersFastmail · 2023

    Root cause Dependency failure

  2. IL-0258 FastMail was unreachable for almost two hours when the GRE tunnels carrying its traffic from Level 3 went downFastmail · 2016

    Root cause Dependency failure