Duke Students Taught a Computer to Detect COVID-19 in Lung Scans
A lot of illnesses can look like COVID-19 in a CT scan. Duke students built an AI tool to spot telltale signs of the virus and flag cases that swab tests miss.
Coronavirus may have shut down campuses and closed labs, but that hasn鈥檛 stopped some Duke students from brainstorming ways to improve COVID-19 testing while working from home -- with help from artificial intelligence.
A student-led team is building a machine learning system that could help doctors analyze CT scans of people鈥檚 lungs and diagnose COVID-19 more quickly and accurately than nasal swab tests.
Their system is able to distinguish COVID-19 from other common infections, such as pneumonia. And unlike many AI tools where it鈥檚 unclear how they work, the Duke tool also shows what it 鈥渟aw鈥 that led to the diagnosis.
Two undergraduates, Anmol Warman 鈥22, and Pranav Warman 鈥20, led the . The brothers say they first got the idea for the project in early March. By then, the first positive cases of coronavirus were being reported in their home town on the outskirts of Tampa.
But testing bottlenecks made it difficult to determine how widespread the virus was. Supplies were limited, and getting results could take days.
What鈥檚 more, the most common coronavirus test -- which looks for viral RNA in cells swabbed from a person鈥檚 nose -- identifies only of people who have the virus.
In other words, it misses up to a third of cases. The test gives these people false reassurance that they don鈥檛 have the virus when actually they do.
鈥淭hat's probably one of the worst things in a pandemic,鈥 said Anmol Warman, a rising junior majoring in biology. 鈥淵ou don't want people thinking that they're safe and actually not being safe.鈥
Many states have since seen improvements in swab testing supplies, but lingering questions about the accuracy of such tests have pushed researchers to study alternatives, including CT scans.
While normal lungs look black on a CT scan, coronavirus scans often show whitish-gray patches called 鈥済round glass opacities.鈥
CT scans were widely used to diagnose COVID-19 patients in China, but they鈥檙e not currently recommended as a first-line test in the U.S. The problem is that, to the human eye, these lighter patches on a CT scan can look a lot like other illnesses too, such as tuberculosis or viral pneumonia
The Duke team wondered if artificial intelligence might help. 鈥淐ould AI help us use all the testing options we have?鈥 said Pranav Warman, who just graduated with a double-major in computer science and biology.
If they could train a computer to tell the difference between COVID-19 and other common infections in CT scans, they reasoned, perhaps researchers could get a better handle on how many people are infected.
The team鈥檚 first major hurdle was wrangling enough data. Artificial intelligence needs data to learn from. Most published studies teach AIs to identify patterns based on hundreds of thousands of examples.
Over spring break the students started collecting CT images that had been posted online in the public domain on medical websites such as Radiopaedia.org. Realizing they were going to need expert help, they also asked radiologists at the James A. Haley Veterans' Hospital in Tampa to outline suspicious areas in each image.
They eventually compiled some 900 CT images from 338 patients with known diagnoses. Some patients had COVID-19, some were normal and others had lung damage from other illnesses.
The team fed the images to a neural network, and then set it free to find features common to COVID-19 patients but not in the others.
Other teams have developed AI tools to detect COVID-19 from CT scans. 鈥淏ut what's really cool about our system is that it doesn't just spit out a diagnosis,鈥 Anmol Warman said. It also shows the locations of the features it relied on to arrive at the answer.
The research hasn鈥檛 gone through peer review yet; however, the Duke tool performed just as well, if not better, than other AI models that don鈥檛 have this transparency.
When they tested it on data from countries and hospitals it had never seen before, the system correctly identified those carrying the virus 98% of the time. Unlike swab tests, actual cases were rarely overlooked. And 95% of the time it also ruled out people with hazy patches in their lungs due to other conditions.
Importantly, their system worked equally well on symptomatic patients and 鈥渟ilent spreaders鈥 -- infected people who don鈥檛 have cough or fever but could still be spreading the virus unknowingly, and could become a bigger risk as states reopen.
鈥淚鈥檓 proud of our students for taking the initiative to work on this,鈥 said Duke computer vision and medical imaging expert Guillermo Sapiro, who mentored the team.
The students will be presenting their work to representatives from Duke Health this summer. They hope to find out what steps they would need to take to make it useful in the clinic.
鈥淲e know that testing is going to be extremely important, especially now that some epidemiologists are suggesting a second wave,鈥 said Pranav Warman, who will be entering Duke鈥檚 medical school this fall. 鈥淲e need to know who has the virus to prevent further spread.鈥
CITATION: "Interpretable Artificial Intelligence for COVID-19 Diagnosis from Chest CT Reveals Specificity of Ground-Glass Opacities," Anmol Warman, Pranav Warman, Ayushman Sharma, Puja Parikh, Roshan Warman, Narayan Viswanadhan, Lu Chen, Subhra Mohapatra, Shyam Mohapatra and Guillermo Sapiro. medRxiv, May 22, 2020.