Real-Time Fact-Checking: There's (Almost) An App For That
Bass Connections students pursue first-ever app providing 'pop-up' fact-checking in real time automatically
With an endless onslaught of news and opinion pounding us from traditional outlets, blogs and social media, fact-checking helps a weary public determine which political claims are accurate and which ones aren鈥檛.
But there are now 156 fact-checking operations around the world, a number that has more than tripled in the past four years, according to the . And checking claims takes time.
So imagine this: You鈥檙e watching a State of the Union speech and the fact-checking pops up on the screen -- in real time.
No waiting for the media to post stories on which statements were true, false or misleading.
No wading through the sludge to check the claims on your own.
The fact checks are right there on your smartphone, tablet or TV.
A project that combines journalism and computer science is working on such an app. Faculty who lead the project, which started this fall, say it would be the first to provide 鈥減op-up鈥 fact-checking in real time automatically.
Hover over the dot on the graph to see numbers of fact-checkers in different years.
The app doesn鈥檛 do the work of human fact-checkers 鈥 that鈥檚 still too complex for computers 鈥 but the goal is to match spoken claims with fact-check articles that have already been published, says , professor of the practice of journalism and public policy and director of the , who co-leads the Bass Connections project.
鈥淚t is about trying to take the journalism of political fact-checking and get it to the people when they need it,鈥 says Adair, a veteran news reporter and creator of the Pulitzer Prize-winning website .
鈥淩ight now there鈥檚 a lot of good political fact-checking, but people have to go find it. They have to hear the claim, then look up the claim. What we鈥檙e trying to do is automate it so that the moment the claim is made by a politician, the fact check automatically pops up on their phone, TV screen or tablet.鈥
That鈥檚 much easier said than done, acknowledge Adair and co-project leader , a professor of computer science.
The apps being developed by Yang鈥檚 and Adair鈥檚 team rely on a database of fact-checks that were published by organizations such as The Washington Post, PolitiFact and FactCheck.org. The database grew out of an earlier partnership between the Reporters鈥 Lab and Google.
The previously published fact-checks have value because politicians often repeat the same lines. So past fact-checks are relevant.
But a big challenge is matching the new statement to that fact-check because phrasing can vary and computers don鈥檛 understand all the nuances of spoken English. For example, take the sentences, 鈥淭he animal didn鈥檛 cross the street because it was too wide鈥 and 鈥渢he animal didn鈥檛 cross the street because it was too tired.鈥 Until recently, computers had a hard time determining whether 鈥渋t鈥 refers to the animal or the street. Besides resolving such ambiguities, computers also need to be able to detect paraphrases, and more generally, whether one statement logically entails another. These problems remain very difficult despite recent advances in AI.
鈥淭he accuracy bar is very high,鈥 Yang says. 鈥淧op-up fact-checking can give a true-or-false verdict, but if our matching algorithm makes any mistakes people are not going to be very happy about it.鈥
So, much like a Google search returns suggested answers or pages, the real-time app would return a 鈥渉ere is some helpful information鈥 response related to the claim, unless the matching algorithm is absolutely sure about a true or false judgment, Adair says.
The Bass team aims to have a proof of concept version done in the spring and would like to have more polished products complete in 2020.
The project continues work that began this summer during an intense precursor called Data+, a 10-week research experience for undergraduates that focuses on using 鈥渄ata-driven approaches to interdisciplinary challenges.鈥
Ethan Holland, a junior double-majoring in computer science and statistics, says the summer program helped him apply his classroom learning with a real-world problem -- truth in politics.
鈥淜nowing where to start was a pretty big challenge,鈥 says the Rockville, Maryland, native. 鈥淲e started with a very broad idea of what the final product should do, but very little idea of how best to go about getting there. Much of the process was trial and error. ( to watch Holland鈥檚 presentation on the app project.)
鈥淲e realized after five weeks that we were building a model to answer too narrow of a question and had to go back to the drawing board. I'm not sure about our biggest success, but the first time we combined all the parts we had been separately developing into one system and could see real results was really exciting.鈥
RELATED STORY: Bass Connections Marks 5 Years of Real-World Solutions