Failing to Replicate: How Often Do PLOS Authors Publish Negative Results?

AI Thread Summary
The discussion centers on the significance of negative results in scientific research, highlighting their historical importance and the challenges they face in publication. Negative results, such as the Michelson-Morley experiment, have historically led to major scientific advancements, including Einstein's theory of special relativity. Despite their value, negative results often struggle to be published, particularly in fields outside of physics, where funding for replication studies is limited. The conversation praises PLOS ONE for publishing a recent negative result as a full paper, showcasing a commitment to intellectual honesty. This contrasts with the tendency of many high-impact journals to overlook or minimize negative findings. The emergence of specialized journals dedicated to negative results reflects an ongoing effort to address publication bias and improve the visibility of such important research outcomes.
Physics news on Phys.org
An excellent example of science working the way it is supposed to (and often doesn't)
 
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity. The current failure of the LHC to make any experimental observation that is in conflict with the Standard Model and the failure of Dark Matter detectors to find a single confirmed particle may in the future be important negative results as well.
 
dipole said:
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity.

As a matter of interesting historical significance, I think Einstein was quoted as saying that he was unaware of the Michelson-Morley results when he was developing SR. At least according to Ohanian:https://www.amazon.com/dp/0393337685/?tag=pfamazon01-20

I think he also asserted that he was unaware of Poincare's relevant work on SR that was going on currently with his. He developed SR largely based on Maxwell's and Lorentz's work. I can see him perhaps being ignorant of Poincare's publications, but not to know about MM that occurred about 20 years earlier? Hard to believe he didn't come across that in his research. What a great feather in your hat reference to have when publishing your model. These are the kind you don't want to miss.
 
Last edited by a moderator:
dipole said:
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity. The current failure of the LHC to make any experimental observation that is in conflict with the Standard Model and the failure of Dark Matter detectors to find a single confirmed particle may in the future be important negative results as well.
Negative results are frequently published in physics, other sciences often have a worse ratio - up to the point where repetitions do not get funded at all because "this has been studied already"... or negative results are simply not published at all.
 
mfb said:
Negative results are frequently published in physics, other sciences often have a worse ratio - up to the point where repetitions do not get funded at all because "this has been studied already"... or negative results are simply not published at all.

This is a common complaint from professors teaching seminar classes in neuroscience (where we go through 4 journal articles a week).
 
The issue of the publication of negative results in peer-reviewed journals is a highly contentious one. I am impressed by PLOS ONE accepting this publication, but I am even more impressed that they did so as a full paper, rather than as "correspondence to the editor" or even a mere footnote of retraction (as many other journals tend to do, if they even bother to consider the follow-up paper). Kudos for excellent intellectual honesty all around - to the authors, the reviewers and the editorial board.

I am not really familiar with what goes on in physical sciences journals, but I am active in publishing and reviewing in the medical literature. Because of the long-recognition of issues with getting negative results to see the light of day in high impact-factor journals (or pretty much any "mainstream" journal, really), techniques like displaying the funnel plot (a visual representation of the likelihood of publication bias) have become de rigueur when publishing meta-analyses and systematic reviews. And, to address the perceived gap in the "mainstream" literature, open access, online-only journals like the Journal of Negative Results in Biological Medicine have sprung up. Their website: http://www.jnrbm.com/
 
Yep, PLOS One is itself an open acces project of PLOS.
 
Back
Top