"During a provincial procurement process for AI medical systems that transcribe conversations between doctors and patients, government evaluators found serious errors in transcripts generated by 20 programs, she said. Inaccuracies in medical notes generated by AI scribe systems could potentially result in inadequate or harmful treatment plans that may potentially impact patient health outcomes, the auditor's report said."
"The evaluators ran a pair of test conversations between hypothetical doctors and patients through the AI systems to test their capabilities, and uncovered the problems, the report said. Evaluators found that nine of the systems had so-called "hallucinations," fabricating information or making suggestions to patient treatment plans not made by the doctors. Those included referring a patient for therapy or ordering blood tests, the report said."
"Transcripts created by 12 of the 20 programs contained incorrect information like capturing a different drug than was prescribed by the doctor. Seventeen of the 20 systems missed key details about patients' mental health issues. The auditor also found some of the system vendors did not submit third-party audit reports, certifications or threat risk assessments during the procurement process."
"Four systems were still approved by the government. The systems are in use across the province, however the government"
Ontario’s auditor general found that AI note-taking tools used by doctors provided incorrect and incomplete information and sometimes generated hallucinations. During a procurement process for AI medical systems that transcribe doctor-patient conversations, evaluators tested 20 programs using hypothetical conversations and found serious transcript errors. Nine systems fabricated information or suggested treatment steps not made by doctors, including referrals for therapy and ordering blood tests. Twelve systems captured incorrect drug information, and seventeen systems missed key mental health details. The auditor also found that some vendors did not provide third-party audit reports, certifications, or threat risk assessments during procurement. Four systems remained approved and are used across the province.
#ai-medical-transcription #healthcare-safety #auditing-and-procurement #hallucinations #ontario-government
Read at www.cbc.ca
Unable to calculate read time
Collection
[
|
...
]