- Kylie Jenner found a way to make Kobe Bryant’s death about her 4 Years Ago
- Warren calls for harsh penalties for tech companies that spread voter disinformation 4 Years Ago
- ‘Vanderpump Rules’ recap: Miami vices and vexes 4 Years Ago
- Teen gets harmonica stuck in mouth, documents it on TikTok Today 11:08 AM
- Joey Salads got his DNA results in and now he’s tweeting the N-word Today 10:58 AM
- NikkieTutorials says she knows who blackmailed her Today 10:22 AM
- Seth Rogen is making a movie about a deadly meme Today 9:30 AM
- Ring should be shut down ‘immediately,’ Amazon engineer warns Today 9:19 AM
- Joe Biden wants his own Bernie Bros Today 8:57 AM
- Twitch star Adept shares heartwarming story about meeting Kobe Bryant Today 8:44 AM
- ‘Promising Young Woman’ unravels the complexities of a revenge fantasy Today 8:35 AM
- Review: ‘Next in Fashion’ is Netflix’s latest attempt at reality TV Today 7:00 AM
- What is Byte, and can it really compete with TikTok? Today 7:00 AM
- Migrants are under social media surveillance—and that’s a problem for everyone Today 6:00 AM
- Gabrielle Union deserves better from Terry Crews Tuesday 11:12 PM
Many researchers don’t share their raw data like they’re supposed to
Even though they should.
Science has a reproducibility problem. In order to confirm hypotheses, researchers need to test and retest them. But recently, some researchers discovered that most social science studies couldn’t be replicated—even the really big, foundational ones.
Now, researchers are discovering that scientists rarely even make their raw data freely available to their colleagues or the public.
In an open-access study published in the journal PLoS One on Dec. 4, data librarian Ryan Womack looked at original research articles (articles that publish findings from original data) in the top 10 journals in biology, chemistry, physics, and math in 2014. Womack found that, overall, only 13 percent of the articles in those four core fields offered their raw data for free.
Theoretically, researchers are supposed to make their data available either automatically or upon request in the spirit of reproducibility, letting scientists check each other’s work and build upon it. A fresh set of eyes might see the data in a new way or find something the original researchers didn’t notice. But the reality, apparently, is that data isn’t as freely available as it should be.
Some journals require scientists to provide their raw data up front in order to publish, but they usually don’t enforce this requirement, Womack wrote in his article. Several online data repositories exist, but researchers don’t seem to make use of them.
Womack found some differences between disciplines. Biological sciences, for instance, had the highest rate of data sharing, but it was still only 42.9 percent. In contrast, only one of the physics articles made its data freely available. (Four made it available by other means.)
“I didn’t find the results surprising,” Ivan Oransky, founder of academic publishing watchdog Retraction Watch, told the Daily Dot in an email. “We frequently hear researchers complain that not only do many authors fail to automatically make their raw data available, many even fail to make it available upon request.”
The reason, Oransky said, is that researchers, like journalists, are competitive and don’t want to get scooped. “That’s understandable, really, given that the system rewards new big papers instead of collaboration.”
Womack’s study analyzed only top-tier journals, judged by their impact factor, a metric by which researchers and institutions can judge a study’s importance. Articles in journals with high impact factors are often perceived as being better and more important and containing the most exciting results.
But Randy Schekman, founder of the online journal eLife, previously told the Daily Dot that the impact factor is a faulty measure of clout. Librarians originally developed it to help them decide which journal subscriptions to buy. But journals learned to hack the impact factor, Schekman said—publishing more review articles and cherry-picking original research articles that would get more citations.
Publishing in high-impact journals also benefits researchers directly. The more high-impact papers on their curriculum vitae, the better their chances of scoring a tenure-track research position.
Womack, the author of the concerning new study, said that he saw a push to reverse the trend and offer more open data.
“Policies and practices are gradually tilting the balance towards openness, so I believe data sharing will increase,” Womack told the Daily Dot. “Hopefully other studies will demonstrate that over time in different disciplines.”
Illustration by Jason Reed
Cynthia McKelvey covered the health and science for the Daily Dot until 2017. She earned a graduate degree in science communication from the University of California Santa Cruz in 2014. Her work has appeared in Gizmodo, Scientific American Mind, and Mic.com.