Ontario audit finds AI medical scribes inaccurate

A recent audit by the auditor general of Ontario revealed significant inaccuracies in AI medical scribes recommended by the provincial government. These systems, intended to help doctors summarize patient interactions, frequently generated incorrect, incomplete, or entirely fabricated information. The audit tested 20 AI scribe vendors, finding that all exhibited flaws, including hallucinated patient data and misrecorded prescriptions. Despite these critical accuracy issues, the 'accuracy' metric constituted only a small portion of a vendor's overall approval score, raising concerns about inadequate evaluation processes. Such errors could potentially lead to harmful treatment plans and negatively impact patient health outcomes.