CHAI: Look for Healthcare AI Model 'Nutrition Labels' Soon

The coalition's new draft certification frameworks, which could be finalized in six months after more stakeholder feedback, offer a way forward for artificial intelligence assurance labs and basic model transparency.The Coalition for Health AI this past Friday unveiled news plans for how it would certify independent artificial intelligence assurance labs.The draft frameworks come as the group – comprising health system heavy-hitters such as Mayo Clinic, Penn Medicine and Stanford, along with Amazon, Google, Microsoft and other Big Tech giants – set a timeline for its aim to standardize the output of testing labs by grading AI and ML models with so-called CHAI Model Cards – which the group likens to ingredient and nutrition labels on food products.

Medigy Insights

CHAI leaders say the certification rubric and model card designs can be expected – after incorporating stakeholder feedback from members, partners and the public – by the end of April 2025.Created with the ANSI National Accreditation Board and several emerging quality assurance labs using ISO 17025 – it's the predominant standard for testing and calibration laboratories worldwide – the draft CHAI certification program framework requires, among other things, mandatory disclosure of conflicts of interest between assurance labs and model developers, and the protection of data and intellectual property. (That standard was also used for ONC's Electronic Health Record certification program.)

Continue reading at healthcareitnews.com

Make faster decisions with community advice

Deploy this technology today

Build or Buy? HTI-2 Presents Health IT Vendors With a Strategic Fork in the Regulatory Road – Regulatory Talk Series

This article is the fifth in the Healthcare Regulatory Talk series.With the public comment period now closed, the newly renamed Assistant Secretary for Technology Policy and Office of the National …

Posted Oct 23, 2024