Inside 847 Production Clinical AI Notes — Sebastian Fox, Composo
1 in 20 production clinical AI notes contains errors serious enough to harm patients.
“1 in 20. That's not theoretical in testing, that's in production on real patients.”
Analysis of 847 real-world clinical AI notes found that 1 in 20 contained seriously harmful errors, nearly 1 in 5 had important omissions, and over 1 in 10 had hallucinations — all while ambient AI scribes are deployed in roughly a third of US practices with no adverse event reporting. The most dangerous failures are the subtle ones that look correct on the surface, such as a missed giant cell arteritis diagnosis that could cause blindness within days. With physician AI use doubling last year and no tracking infrastructure in place, the speaker argues the industry is effectively flying blind on patient harm.