September 04, 2018

Startup at odds with doctors over claim about AI diagnoses

Publisher: Digital Journal

The UK-based healthcare startup's announcement that their AI had achieved medical test scores on par with human doctors, including on relevant sections of the MRCGP, was met with concern from doctors over the research behind the study.

According to a press release from Babylon Health, the average pass mark for the MRCGP over the past five years was 72 per cent. On the first try, Babylon's AI scored 81 per cent. Babylon Health's research paper on artificial intelligence and human doctors for triage and diagnosis goes as far to claim "the triage advice recommended by the AI System was, on average, safer than that of human doctors, when compared to the ranges of acceptable triage provided by independent expert judges, with only a minimal reduction in appropriateness."

The research paper is not peer reviewed and has drawn a significant amount of criticism from those in the healthcare industry.

To further test the AI's diagnostic abilities, according to the company, it was tested alongside seven primary care doctors using 100 medical vignettes. On this Babylon's AI scored 80 per cent for accuracy. When tested against conditions seen frequently in primary care, according to the company, the AI had 98 per cent accuracy.

Healthcare professionals are questioning the methodology of Babylon's research and how accurate the AI is at actually diagnosing.

Going forward, Bablyon Health founder and CEO Dr. Ali Parsa said that their mission it to use the AI to relieve the shortage of doctors worldwide. "Even in the richest nations, primary care is becoming increasingly unaffordable and inconvenient, often with waiting times that make it not readily accessible," he said in the release. "Babylon's latest artificial intelligence capabilities show that it is possible for anyone, irrespective of their geography, wealth or circumstances, to have free access to health advice that is on-par with top-rated practicing clinicians." Time will tell if they get there.

This article was from Digital Journal and was legally licensed through the NewsCred publisher network. Please direct all licensing questions to