Skip to content
K = 0.731

Microsoft’s AI Diagnostic Orchestrator Outperforms Physicians on Historical Cases, With Hospital Testing Planned

2 reports 2 reporting sources 1 hours agoNew

Understand the event

AI overview

Microsoft reported in Science that its GPT-5-powered Diagnostic Orchestrator outperformed physicians on historical medical cases, while validation in clinical settings remains pending. On cases drawn from The New England Journal of Medicine, the system achieved around 83 percent diagnostic accuracy, compared with roughly 36 percent for generalist physicians using references and 22 percent for those without them. The system uses multiple AI agents to assess symptoms and medical histories, choose tests and arrive at a diagnosis. The research evaluated scenarios drawn from medical case reports and emergency department data; those results do not establish how well it performs with patients in clinical settings. Microsoft plans to test the system in hospitals with Beth Israel Deaconess Medical Center, likely beginning in the next couple of months.

Generated by AI from reports · Updated 1 hours ago

Latest development10/23 02:00 (UTC+8)
Microsoft study reports AI Diagnostic Orchestrator outperforms doctors on historical medical casesThe Verge · AI

Read next

More changes in today’s briefingMicrosoft Research and Collaborator Resolve the KLS Conjecture With Human-Directed AI

Report timeline

Follow the reports to explore different sides of the event.

10/23
  1. TechCrunch · AI
    Microsoft’s MAI-DxO outperforms generalist doctors on complex cases in a simulation

    Microsoft’s MAI-DxO correctly diagnosed 83% of complex medical cases in a simulation, compared with 36% for generalist physicians working individually, according to a study published Thursday in Science. Specialist physicians and teams were excluded from the comparison. Gains over underlying models varied, with little improvement on emergency department cases; Microsoft plans to evaluate DxO across hospital settings with Beth Israel Deaconess Medical Center.

  2. The Verge · AI
    Microsoft study reports AI Diagnostic Orchestrator outperforms doctors on historical medical cases

    Microsoft's GPT-5-powered Diagnostic Orchestrator outperformed physicians on historical medical cases in research published Thursday in Science. Its multiple AI agents achieved around 83 percent accuracy on cases from The New England Journal of Medicine, versus roughly 36 percent for generalist physicians using references and 22 percent without them. The system still needs clinical validation, and Microsoft plans hospital testing with Beth Israel Deaconess Medical Center, likely starting in the next couple of months.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.