Strategic Communications and Marketing News Bureau

Study: Americans struggle to distinguish factual claims from opinions amid partisan bias

CHAMPAIGN, Ill. — How well do Americans succeed at distinguishing statements of fact from statements of opinion? The answer: Not very well at all, according to new research co-written by a team of University of Illinois Urbana-Champaign scholars.

Americans struggle to tell the difference between statements of fact and statements of opinion – a troubling trend that has grave implications for civic discourse and for navigating the torrent of political information that citizens receive every day, said Jeffery J. Mondak, a professor of political science and the James M. Benson Chair in Public Issues and Civic Leadership at Illinois.

“The capacity to differentiate between a statement of opinion and a statement of fact is vital for citizens to manage the flood of political information they receive on any given day,” said Mondak, a co-author of the research and an affiliate of the Center for Social and Behavioral Science. “There’s a huge amount of research on misinformation. But what we found is that, even before we get to the stage of labeling something misinformation, people often have trouble discerning the difference between statements of fact and opinion.”

“We also see a lot of research on misinformation that comes at the problem from the angle of, ‘How are we doing in terms of playing whack-a-mole with misinformation? Are we able to fact check them and rebut these claims?’ Well, that isn’t necessarily a useful way of getting at the root cause of the problem,” said Matthew Mettler, a U. of I. graduate student and co-author of the paper.

The study, published by the Harvard Kennedy School Misinformation Review, examined whether Americans can differentiate statements of fact (2 + 2 = 4, for example) versus statements of opinion (“Green is the most beautiful color”), with a particular focus on political statements.

Respondents were asked to categorize 12 statements about current events as statements of fact or statements of opinion. The researchers found that 45.7% of respondents performed no better than a coin flip at the task.

“What we’re showing here is that people have trouble distinguishing factual claims from opinion, and if we don’t have this shared sense of reality, then standard journalistic fact-checking – which is more curative than preventative – is not going to be a productive way of defanging misinformation,” Mondak said. “How can you have productive discourse about issues if you’re not only disagreeing on a basic set of facts, but you’re also disagreeing on the more fundamental nature of what a fact itself is?”

Four factors were associated with modest improvements in success at fact-opinion differentiation: civics knowledge, current events knowledge, education and cognitive ability. 

But partisan bias played a strong role in the root cause of error, the scholars said.

“As partisan political views grow more polarized, Democrats and Republicans both tend to construct an alternate reality in which they report that their side has marshalled the facts and the other side merely has opinions,” Mondak said.

Unbiased error, such as mistakes resulting from random guessing, decreased due to the four factors, but errors linked to partisan bias didn’t budge, Mondak said.

“It’s not merely the case that there were a lot of incorrect responses, but that many of the errors were not random,” he said. “They were systematic errors because many respondents formed their answers to fit their partisan narrative. For example, the statement ‘President Barack Obama was born in the U.S.’ is a statement of fact that could be incorrectly redefined as a statement of opinion, depending on your partisan lens.”

“Although people with greater political sophistication were better at distinguishing fact from opinion, affective partisan polarization tends to promote systematic partisan error,” Mettler said. “It distorts people’s capacity to reason their way through these statements.”

For citizens who are concerned about misinformation, the findings suggest not only that people are resistant to corrections of misinformation, but also that they’re susceptible to manipulation, the researchers said.

“Our analyses show that the problem of misinformation includes an underappreciated dimension in that people do not just disagree on the facts, they also disagree on the more fundamental matter of what facts are,” Mondak said. “The results also suggest that faulty fact-opinion differentiation can severely complicate the correction of misinformation because a consensus of ‘We can agree to disagree’ can emerge even for questions of indisputable fact. Well, you can’t just ‘Agree to disagree’ that 2 + 2 = 22.

“It’s possible that news media can help improve fact-opinion differentiation by highlighting the distinction between statements of fact and statements of opinion in their stories or broadcasts. But the trend nowadays, especially on cable news, is more of a blurring of opinion and fact.”

The implications of the research ought to be highly concerning for political discourse, especially during the 2024 presidential election cycle, the researchers said.

“If you can’t tell if somebody is proposing a statement of fact versus a statement of opinion, you’re doomed as an information consumer,” Mondak said. “It signals a fundamental breakdown in the possibility of meaningful communication between people and political elites, or between journalists and the public.”

The research was supported by the Benson Fund at the U. of I.

Editor’s notes: To contact Jeffery J. Mondak, call 217-244-6045; email jmondak@illinois.edu.

 

The paper “Fact-opinion differentiation” is available online.

 

DOI: 10.37016/mr-2020-136

Read Next

Health and medicine Dr. Timothy Fan, left, sits in a consulting room with the pet owner. Between them stands the dog, who is looking off toward Fan.

How are veterinarians advancing cancer research in dogs, people?

CHAMPAIGN, Ill. — People are beginning to realize that dogs share a lot more with humans than just their homes and habits. Some spontaneously occurring cancers in dogs are genetically very similar to those in people and respond to treatment in similar ways. This means inventive new treatments in dogs, when effective, may also be […]

Honors From left, individuals awarded the 2025 Campus Awards for Excellence in Public Engagement are Antoinette Burton, director of the Humanities Research Institute; Ariana Mizan, undergraduate student in strategy, innovation and entrepreneurship; Lee Ragsdale, the reentry resource program director for the Education Justice Project; and Ananya Yammanuru, a graduate student in computer science. Photos provided.

Awards recognize excellence in public engagement

The 2025 Campus Awards for Excellence in Public Engagement were recently awarded to faculty, staff and community members who address critical societal issues.

Uncategorized Portrait of the researchers standing outside in front of a grove of trees.

Study links influenza A viral infection to microbiome, brain gene expression changes

CHAMPAIGN, Ill. — In a study of newborn piglets, infection with influenza A was associated with disruptions in the piglets’ nasal and gut microbiomes and with potentially detrimental changes in gene activity in the hippocampus, a brain structure that plays a central role in learning and memory. Maternal vaccination against the virus during pregnancy appeared […]

Strategic Communications and Marketing News Bureau

507 E. Green St
MC-426
Champaign, IL 61820

Email: stratcom@illinois.edu

Phone (217) 333-5010