Incident Library

Organisation

Tencent

Tencent · tencent

1 case · 2026

Root cause Hardware failure
Component –
Contributing factor Unverified assumption
Symptom Throughput degradation

Cases

  1. IL-0477 Slow compute on 8 ranks pushed a 10,000-GPU MoE job from 30 s to over 90 s per step; an alert pointed at the networkTencent · 2026

    Root cause Hardware failure