Huge Gap Exists Between Regulatory Authorization, Clinical Validation of AI Medical Devices

FRIDAY, Aug. 21, 2026 (HealthDay News) — Only three of the 1,357 U.S. Food and Drug Administration-authorized artificial intelligence (AI) medical devices have been evaluated for clinical effectiveness, according to a study published online Aug. 19 in PLOS Digital Health.

Rawan Abulibdeh, from the University of Toronto, and colleagues conducted a systematic analysis of all FDA-cleared AI/machine learning-enabled medical devices (through Dec. 5, 2025) using the FDA device database and the American College of Radiology Data Science Institute catalogue, with searches linked to ClinicalTrials.gov and PubMed, to identify registered trials and publications.

The researchers found that of 1,357 cleared AI devices, only 2.5 percent were linked to registered prospective trials, 0.9 percent (12 studies) posted results, 0.9 percent had peer-reviewed publications, and 0.2 percent (three studies) evaluated patient-centered outcomes, including mortality, morbidity, or readmissions. Of those AI devices with identified studies, 62 percent had employed observational designs with small, homogenous cohorts, limited subgroup analyses, and frequent exclusion of vulnerable populations. Rigorous evaluation was discouraged by structural barriers, including misaligned financial incentives, reliance on predicate-based regulatory pathways, and logistical challenges of multicenter trials.

“The market is crowded with AI tools, yet the evidence supporting patient-centered outcomes remains remarkably thin,” the authors write. “This evidence attrition highlights the profound gap between regulatory authorization and clinically meaningful validation.”

One author is a paid consultant for the Collaborative Institutional Training Initiative.

Abstract/Full Text