Failing to Replicate: How Often Do PLOS Authors Publish Negative Results?

Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
8 replies · 3K views
Physics news on Phys.org
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity. The current failure of the LHC to make any experimental observation that is in conflict with the Standard Model and the failure of Dark Matter detectors to find a single confirmed particle may in the future be important negative results as well.
 
dipole said:
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity.

As a matter of interesting historical significance, I think Einstein was quoted as saying that he was unaware of the Michelson-Morley results when he was developing SR. At least according to Ohanian:https://www.amazon.com/dp/0393337685/?tag=pfamazon01-20

I think he also asserted that he was unaware of Poincare's relevant work on SR that was going on currently with his. He developed SR largely based on Maxwell's and Lorentz's work. I can see him perhaps being ignorant of Poincare's publications, but not to know about MM that occurred about 20 years earlier? Hard to believe he didn't come across that in his research. What a great feather in your hat reference to have when publishing your model. These are the kind you don't want to miss.
 
Last edited by a moderator:
dipole said:
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity. The current failure of the LHC to make any experimental observation that is in conflict with the Standard Model and the failure of Dark Matter detectors to find a single confirmed particle may in the future be important negative results as well.
Negative results are frequently published in physics, other sciences often have a worse ratio - up to the point where repetitions do not get funded at all because "this has been studied already"... or negative results are simply not published at all.
 
mfb said:
Negative results are frequently published in physics, other sciences often have a worse ratio - up to the point where repetitions do not get funded at all because "this has been studied already"... or negative results are simply not published at all.

This is a common complaint from professors teaching seminar classes in neuroscience (where we go through 4 journal articles a week).
 
The issue of the publication of negative results in peer-reviewed journals is a highly contentious one. I am impressed by PLOS ONE accepting this publication, but I am even more impressed that they did so as a full paper, rather than as "correspondence to the editor" or even a mere footnote of retraction (as many other journals tend to do, if they even bother to consider the follow-up paper). Kudos for excellent intellectual honesty all around - to the authors, the reviewers and the editorial board.

I am not really familiar with what goes on in physical sciences journals, but I am active in publishing and reviewing in the medical literature. Because of the long-recognition of issues with getting negative results to see the light of day in high impact-factor journals (or pretty much any "mainstream" journal, really), techniques like displaying the funnel plot (a visual representation of the likelihood of publication bias) have become de rigueur when publishing meta-analyses and systematic reviews. And, to address the perceived gap in the "mainstream" literature, open access, online-only journals like the Journal of Negative Results in Biological Medicine have sprung up. Their website: http://www.jnrbm.com/