Thats the reaserach i love to see: Google put Gemini through a simulated medical residency, and it became markedly better at conducting clinical consultations.
ResidencyRL trained Gemini 3.5 Flash across 49,870 simulated telehealth encounters covering 81 conditions.
The AI patients hid symptoms, resisted advice and requested inappropriate treatments, forcing the model to gather information over conversations of up to 60 turns.
After training, diagnostic accuracy under adversarial conditions rose from 81% to 88%, while missed red flags fell by 31%. In a blinded evaluation of 97 cases, clinicians preferred the trained agent over the base model in 87.6% of comparisons.
The improvement also transferred to unseen oncology cases and external benchmarks.
AI health agents incoming <3