Top 10 questions to ask when buying radiology AI software
The framework aims to help radiologists assess and choose commercial radiology AI software that will best fit their needs, and it was published in an open-access article online March 5 in European Radiology by a group led by Dr. Patrick Omoumi, PhD, of the University of Lausanne in Switzerland. The team dubbed the guidelines the evaluating commercial AI solutions in radiology (ECLAIR).
Thanks to unprecedented investment and activity in private and public companies, a wide range of commercial AI-based offerings are now available for sale, according to the authors. Regulation of the software has also evolved.
As a result, radiology practices need to learn how to properly evaluate these tools, they said.
“While several guidelines describing good practices for conducting and reporting AI-based research in medicine and radiology have been published, fewer efforts have focused on recommendations addressing the key questions to consider when critically assessing AI solutions before purchase,” Omoumi et al noted.
Many factors need to be included in the evaluation of these complicated software applications, such as assessment of technical and financial considerations, as well as quality and safety factors, according to the authors. Input from key stakeholders must also be included.
“Topics to consider in the evaluation include the relevance of the solution from the point of view of each stakeholder, issues regarding performance and validation, usability and integration, regulatory and legal aspects, and financial and support services,” the group wrote.
In their article, the authors provided a detailed checklist of points to consider when assessing commercial radiology AI software, as well as a top 10 list of questions:
- What problem is the application intended to solve, and who is the application designed for?
- What are the potential benefits and risks, and for whom?
- Has the algorithm…