Microsoft’s New AI Tool Outperforms Doctors 4-to-1 in Diagnostic Accuracy

Microsoft’s new AI diagnostic system achieved 80% accuracy in diagnosing patients compared to 20% for human doctors, while reducing costs by 20%, according to company research published Monday. The MAI Diagnostic Orchestrator queries multiple leading AI models including OpenAI’s GPT, Google’s Gemini, Anthropic’s Claude, Meta’s Llama, and xAI’s Grok in what the company describes as a “chain-of-debate style” approach.

The system was tested against 304 case studies from the New England Journal of Medicine using Microsoft’s Sequential Diagnosis Benchmark, which breaks down each case into step-by-step diagnostic processes that mirror how human physicians work. Microsoft CEO of AI Mustafa Suleyman called the development “a genuine step toward medical superintelligence.”