Microsoft blames monster email outage on software defect introduced in July fix
Points and comments are a snapshot, not live.
Microsoft says July software fix caused November email outage affecting Exchange Online.
Microsoft blamed a November 12 outage of Exchange Online and other Microsoft 365 services on a software defect introduced in July 2026. The update caused lock contention in a Windows process, exhausting CPU and memory on high-core servers. A Teams failover combined with 14% server capacity offline triggered the dormant bug. Over 80% of servers became unresponsive due to cascading failures. Engineers could not roll back the months-old change; they developed a patch that restored the former code path. Service was restored by November 14. A final report is due November 20.
What commenters are saying
Commenters criticized Microsoft's testing practices, noting they tested on weaker hardware with fewer cores, missing the lock-contention bug that manifested on production machines with more cores. Several pointed out that testing at full production scale is extremely difficult and expensive, with one arguing that at Microsoft's scale you cannot spare the millions of servers needed for a separate non-production load test. Others questioned why lock contention remains a recurring issue in Windows, and a few noted the irony of massive AI spending while core infrastructure testing is inadequate.