Connecting talented and ambitious people in the world's greatest cities, our mission is to be a top quality institution.
Join our more than 40,000 students studying in hundreds of programs on six continents all around the globe.
Our world-class students, faculty, and scholars expect high achievement in pursuit of engaging the world's diverse challenges.
An institution without walls, we draw spirit from our cities and their famous cultural institutions and professional opportunities.
Being at the forefront of their disciplines, our faculty shape the understanding of an enormous range of academic fields.
Connecting talented and ambitious people in the world's greatest cities, our mission is to be a top quality institution.
Join our more than 40,000 students studying in hundreds of programs on six continents all around the globe.
Our world-class students, faculty, and scholars expect high achievement in pursuit of engaging the world's diverse challenges.
An institution without walls, we draw spirit from our cities and their famous cultural institutions and professional opportunities.
Being at the forefront of their disciplines, our faculty shape the understanding of an enormous range of academic fields.
Radiologists and artificial intelligence systems yield significant differences in breast-cancer screenings, revealing the potential value of using both human and AI methods in making medical diagnoses.
Analysis Points to Potential of Human-Tech Complementary Approach to Detecting Cancer
Radiologists and artificial intelligence systems yield significant differences in breast-cancer screenings, a team of researchers has found. Its work, which appears in the journal Nature Scientific Reports, reveals the potential value of using both human and AI methods in making medical diagnoses.
“While AI may offer benefits in healthcare, its decision-making is still poorly understood,” explains Taro Makino, a doctoral candidate in NYU’s Center for Data Science and the paper’s lead author. “Our findings take an important step in better comprehending how AI yields medical assessments and, with it, offer a way forward in enhancing cancer detection.”
The analysis centered on a specific AI tool: Deep neural networks (DNNs), which are layers of computing elements—“neurons”—simulated on a computer. A network of such neurons can be trained to “learn” by building many layers and configuring how calculations are performed based on data input—a process called “deep learning.”
In the Nature Scientific Reports work, the scientists compared breast-cancer screenings read by radiologists with those analyzed by DNNs.
The researchers, who also included Krzysztof Geras, Ph.D., Laura Heacock, MD, and Linda Moy, MD, faculty in NYU Grossman School of Medicine’s Department of Radiology, found that DNNs and radiologists diverged significantly in how they diagnose a category of malignant breast cancer called soft tissue lesions.
In these three examples of soft tissue lesions, the images are unperturbed on the left column and blurred on the right column. The AI system was sensitive to the blurring, while the radiologists were not. This showed that the AI system relies on details in soft tissue lesions that are considered irrelevant by the radiologists. Image courtesy of Taro Makino, NYU’s Center for Data Science
“In these breast-cancer screenings, AI systems consider tiny details in mammograms that are seen as irrelevant by radiologists,” explains Geras. “This divergence in readings must be understood and corrected before we can trust AI systems to help make life-critical medical decisions.”
More specifically, while radiologists primarily relied on brightness and shape, the DNNs used tiny details scattered across the images. These details were also concentrated outside of the regions deemed most important by radiologists.
By revealing such differences between human and machine perception in medical diagnosis, the researchers moved to close the gap between academic study and clinical practice.
“Establishing trust in DNNs for medical diagnosis centers on understanding whether and how their perception is different from that of humans,” says Moy. “With more insights into how they function, we can both better recognize the limits of DNNs and anticipate their failures.”
“The major bottleneck in moving AI systems into the clinical workflow is in understanding their decision-making and making them more robust,” adds Makino. “We see our research as advancing the precision of AI’s capabilities in making health-related assessments by illuminating, and then addressing, its current limitations.”
The study, which also included Kyunghyun Cho, Ph.D., an associate professor at NYU’s Courant Institute of Mathematical Sciences and NYU’s Center for Data Science, and researchers from Warsaw University of Technology, was supported by grants from the National Science Foundation (HDR-1922658) and the National Institutes of Health (P41EB017183, R21CA225175).
Images of soft tissue lesions are available on Google Drive.
DOI: 10.1038/s41598-022-10526-z