Skip to content
Sign in
Artwork for YPO Technology Network AI Brief
YPO Technology Network AI Brief · August 25 · 9 min

Approved Does Not Mean It Works

A research team at the University of Toronto counted every artificial-intelligence medical device the American regulator has authorized for use on patients. There are one thousand three hundred and fifty-seven of them. Then they looked for evidence that any of those devices helps a patient live longer or better. They found three. That gap is not a scandal, and understanding why is the whole episode: the clearance pathway asks about resemblance, not benefit. The same structure sits inside the AI certificate a vendor is about to put in front of you. In this episode, Stephen Forte covers: The numbers from the device census: 1,357 AI medical devices authorized for patient care, 34 appearing in any registered clinical trial, 12 with posted results, and 3 tested against patient-centered outcomes such as mortality or hospitalization. The mechanism that produces the gap: substantial equivalence, the pathway that asks whether a new device meaningfully resembles one already authorized. Not better. Not proven. Similar. The vocabulary trap: the formal word is cleared, not approved, and clearance is the lighter legal standard. But the hospital, the sales deck, and the board minutes all say approved. The system answers a question about resemblance; the buyer hears an answer about benefit. Why this travels beyond healthcare: ISO 42001, the international standard for an AI management system, certifies that an organization has policies, roles, and documented decision processes. It does not certify that any model is safe, accurate, or fair, and it does not claim to. SOC 2, the other badge in the pack: a genuinely useful attestation about controls in the systems around the AI that says very little about the model itself. The part almost nobody checks: audits have boundaries. The certificate proves something about what sits inside the boundary, which is not necessarily the product on the invoice. The detail worth turning over: there is no official register of ISO 42001 certificates. The credential becoming the default proof of AI governance cannot itself be verified against a list by the buyer relying on it. The honest framing: every certificate in this story is real and honestly issued. The gap is between the question that was answered and the question you thought you were asking. Sources: Abulibdeh et al., "Clinical evidence supporting FDA-authorized artificial intelligence medical devices," PLOS Digital Health, August 19, 2026. Open access; device census as of December 5, 2025. Medical Xpress and News-Medical coverage, August 20, 2026, with independent corroboration of the 1,357 / 34 / 12 / 3 breakdown across four outlets. ISO's published scope for ISO 42001 and AICPA trust services criteria for SOC 2. Referenced: episode 138, "Thirty Percent Became A Hundred. Same Model." The AI Brief from the YPO Technology Network is a daily executive briefing on the AI developments that matter to business leaders. Hosted by Stephen Forte.

0:00-9:23
Play in

transcript

No transcript — this publisher did not publish one.

show notes

A research team at the University of Toronto counted every artificial-intelligence medical device the American regulator has authorized for use on patients. There are one thousand three hundred and fifty-seven of them. Then they looked for evidence that any of those devices helps a patient live longer or better. They found three.

That gap is not a scandal, and understanding why is the whole episode: the clearance pathway asks about resemblance, not benefit. The same structure sits inside the AI certificate a vendor is about to put in front of you.

In this episode, Stephen Forte covers:

  • The numbers from the device census: 1,357 AI medical devices authorized for patient care, 34 appearing in any registered clinical trial, 12 with posted results, and 3 tested against patient-centered outcomes such as mortality or hospitalization.
  • The mechanism that produces the gap: substantial equivalence, the pathway that asks whether a new device meaningfully resembles one already authorized. Not better. Not proven. Similar.
  • The vocabulary trap: the formal word is cleared, not approved, and clearance is the lighter legal standard. But the hospital, the sales deck, and the board minutes all say approved. The system answers a question about resemblance; the buyer hears an answer about benefit.
  • Why this travels beyond healthcare: ISO 42001, the international standard for an AI management system, certifies that an organization has policies, roles, and documented decision processes. It does not certify that any model is safe, accurate, or fair, and it does not claim to.
  • SOC 2, the other badge in the pack: a genuinely useful attestation about controls in the systems around the AI that says very little about the model itself.
  • The part almost nobody checks: audits have boundaries. The certificate proves something about what sits inside the boundary, which is not necessarily the product on the invoice.
  • The detail worth turning over: there is no official register of ISO 42001 certificates. The credential becoming the default proof of AI governance cannot itself be verified against a list by the buyer relying on it.
  • The honest framing: every certificate in this story is real and honestly issued. The gap is between the question that was answered and the question you thought you were asking.

Sources:

  • Abulibdeh et al., "Clinical evidence supporting FDA-authorized artificial intelligence medical devices," PLOS Digital Health, August 19, 2026. Open access; device census as of December 5, 2025.
  • Medical Xpress and News-Medical coverage, August 20, 2026, with independent corroboration of the 1,357 / 34 / 12 / 3 breakdown across four outlets.
  • ISO's published scope for ISO 42001 and AICPA trust services criteria for SOC 2.
  • Referenced: episode 138, "Thirty Percent Became A Hundred. Same Model."

The AI Brief from the YPO Technology Network is a daily executive briefing on the AI developments that matter to business leaders. Hosted by Stephen Forte.

more episodes

All episodes