Incident Library

Organisation

Mailgun

Mailgun · mailgun

2 cases · 2014 to 2017

Root cause DNS or network fault1unknown1
Component Cloud load balancer1Database1Database replication1
Contributing factor Harmful manual action1Single point of failure1
Symptom Intermittent timeouts2Database overload1High error rate1Intermittent connection failures1Packet loss1

Cases

  1. IL-0387 Mailgun MongoDB secondaries were overloaded by rising connections, and a rollback then moved reads onto the primary tooMailgun · 2017

    Root cause unknown

  2. IL-0590 F5 load balancers cached a path MTU of 296 after Rackspace reboots, and Mailgun connections failed intermittentlyMailgun · 2014

    Root cause DNS or network fault