Journalists reporting on the COVID-19 pandemic relied on research that had yet to be peer reviewed
A story on . A deep dive into the . A look at for COVID-19 variants. These are a few examples of news stories based on preprints — research studies that haven’t been formally vetted by the scientific community.
Journalists have because of fears that the findings could be exaggerated, inaccurate or flat-out wrong. But our new research suggests that the COVID-19 pandemic may have changed things by .
While this new normal offers important benefits for journalists and their audiences, it also comes with risks and challenges that deserve our attention.
Peer review and the pandemic
Traditionally, studies must be read and critiqued by at least two independent experts before they can be published in a scientific journal — a process known as “.”
This isn’t the case with preprints, which are posted online almost immediately, without formal review. This immediacy has made preprints a valuable resource for scientists .
The lack of formal review makes preprints a faster way to communicate science, albeit a potentially riskier approach. While , it can help scientists identify errors in data or more clearly communicate their findings.
Studies suggest that to . Still, in some cases, , which can be on average .
A ‘paradigm shift’ in science journalism
As researchers of we’ve been keeping a close eye on media coverage of preprints since the onset of the pandemic. In one study, we found , including major outlets like The New York Times and The Guardian.
Unfortunately, many of these outlets failed to mention that these studies were preprints, leaving audiences unaware that the science they were reading hadn’t been peer reviewed.
We dug deeper into how and why journalists use preprints. Through in-depth interviews, we they used to find, verify and communicate about preprints and whether they planned to report on them after COVID-19.
Our peer-reviewed, published study found that preprints have become an for many journalists, and one that some plan to keep using post-pandemic. Journalists reported actively seeking out these unreviewed studies by visiting (websites where scientists post preprints) or by monitoring social media.
Although a few journalists were unsure if they would continue using preprints, others said these studies had created “a complete paradigm shift” in science journalism.
A careful equation
Journalists told us that they valued preprints because they were more timely than peer reviewed studies, which are often published . As one freelancer we interviewed put it: “When people are dying, you gotta get things going a little bit.”
Journalists also appreciated that preprints are , while many .
Journalists balanced these benefits against the potential risks for their audiences. Many expressed a high level of skepticism about unreviewed studies, voicing concerns about the potential to spread misinformation.
Some journalists provided examples of issues that had become “extremely muddied” by preprints, such as whether to .
Many journalists said they felt it was important to label preprints as “preprints” in their stories or mention that the research had not been peer reviewed. At the same time, they admitted that their audience probably wouldn’t understand what the words “preprint” or “peer review” mean.
In addition, verifying preprints appeared to be a real challenge for journalists, even for those with advanced science education. Many told us that they leaned heavily on interviews with experts to vet findings, with some journalists organizing what they described as their “own peer review.”
Other journalists simply relied on their intuition or “gut” instinct, especially when deadlines loomed or when experts were unavailable.
Supporting journalists to communicate science
Recently, media organizations have started and for . While these resources are an important first step, our findings suggest that more needs to be done, especially if preprint-based journalism is indeed here to stay.
Whether it’s through providing specialized training, updating journalism school curricula or revising existing professional guidelines, we need to support journalists in verifying and communicating about preprints effectively and ethically. The quality of our news depends on it.
This article is republished from under a Creative Commons license. Read the .
Enjoy reading 91ÑÇÉ«´«Ã½ Today?
Become a member to receive the print edition four times a year and the digital edition weekly.
Learn moreGet the latest from 91ÑÇÉ«´«Ã½ Today
Enter your email address, and we’ll send you a weekly email with recent articles, interviews and more.
Latest in Science
Science highlights or most popular articles
New discovery enables gene therapy for muscular dystrophies, other disorders
At the University of Rochester, researchers find that RNA-based technology facilitates effective use for difficult-to-treat, large-gene diseases.
From the journals: JBC
Huntington protein interactions affect aggregation. Intrinsically disordered protein forms a scaffold. From unknown protein to curbing cancer growth. Read about recent JBC papers on these topics.
An inclusive solar eclipse — with outreach
Traveling more than 150 miles with a group of neurodivergent students to have them witness a rare orbital alignment. and also teach the public about it, requires some strategic planning.
Predicting fatty liver disease from a tiny blood sample
Obesity and being overweight aren't the only factors that contribute to liver disease. New tests can help identify who is at risk or already has the disease, even in people who are lean or have a normal weight.
An ancient animal helps scientists improve modern technology
The same molecules that help tardigrades survive extreme weather can improve cryo-EM images of cellular structures and proteins, a team led by University of Wisconsin–Madison researcher Ci Ji Lim reports.
New structure gives insight into mRNA export and cancers
Yi Ren’s lab at Vanderbilt has described the structure of a protein complex that sheds light on the underlying molecular mechanism of mRNA export.