STAT+: AI gone astray: How subtle shifts in patient data send popular algorithms reeling, undermining patient safety

STAT and MIT launched an experiment that — unlike most studies of AI in health care — tried not to prove the strength of health care algorithms, but root out their…

A novel investigation by STAT and the Massachusetts Institute of Technology found that subtle shifts in data fed into popular health care algorithms — used to warn caregivers of impending medical crises — can cause their accuracy to plummet over time, raising the prospect AI could do more harm than good in many hospitals.

In a monthslong experiment, STAT and MIT traced the performance of algorithms past their early days of peak performance into the grinding years that follow, when the hype has faded and they must prove their reliability to caregivers. Instead of transforming care, the algorithms withered in the face of fast-moving clinical conditions — unable to keep up with the pace of change.

Continue to STAT+ to read the full story…