Trill News

To do a common thing uncommonly well brings success. — H. J. Heinz
INDUSTRY

Microsoft 365 Outage Hits Hospitals and Courts Into a Second Day

Microsoft 365 Outage Hits Hospitals and Courts Into a Second Day
Microsoft Data Center Middenmeer, the Netherlands - 2 by Hay Kranen (CC BY 4.0)
A global Microsoft 365 outage cut off Outlook email and Copilot for businesses, hospitals, courts and governments, and recovery dragged into a second day.

Microsoft says the trouble was not extra traffic but servers failing automated health checks, later found a core process on affected servers becoming overwhelmed, and reports no evidence of malicious activity.

Fixes kept falling short: hours in, the company admitted its actions had not provided the anticipated relief, and some restored servers went unresponsive again once traffic returned.

In Japan the outage disrupted government IT, the Philippine Supreme Court saw legal work derailed, a Colorado sheriff's office said people struggled to post bond, and bank customers were blocked from transfers because verification codes could not reach them.

To keep delayed mail from being lost, Microsoft extended its email timeout to 48 hours.

Ciaran Martin, former head of the UK's National Cyber Security Centre, told NBC News it looks like one of the biggest outages of all time and suggested it could be worse than the Amazon Web Services and CrowdStrike failures.

It is unclear how many users were hit, but Microsoft estimated in January that paid commercial Microsoft 365 subscriptions topped 450 million, and NBC found few public bodies immune.
The slow recovery is built into email itself. Most cloud apps fail like a closed door, but email runs on a store and forward design, so mail servers worldwide keep queuing messages for the downed provider and then hit it with a wave of retries once it returns, a backlog that typically takes hours to days to clear, Doug Jacobson of Iowa State University wrote in The Conversation. Because organizations have outsourced email to a few global providers, one failure can stall whole sectors along with the tool they would use to coordinate a response. The next marker is the full report on root cause that Microsoft has promised once mitigation is complete.

Read the original reporting at Ars Technica.

Read Full Story at Ars Technica →

More Industry coverage →

Explore Trill News Originals →

FIND A BOOK ON BOOKSHOP.ORG