Failing to Replicate: How Often Do PLOS Authors Publish Negative Results?

Click For Summary

Discussion Overview

The discussion revolves around the frequency and significance of publishing negative results in scientific research, particularly in the context of PLOS journals. Participants explore historical examples, the implications for various scientific fields, and the challenges associated with publishing negative findings.

Discussion Character

  • Exploratory
  • Historical
  • Debate/contested

Main Points Raised

  • Some participants express curiosity about how often negative results are published, suggesting it should occur more frequently.
  • Historical examples of significant negative results, such as the Michelson-Morley experiment, are cited as pivotal moments that influenced major scientific theories like special relativity.
  • There is mention of the current failures of the LHC and Dark Matter detectors as potential future important negative results.
  • Some participants note that negative results are more commonly published in physics compared to other sciences, where they may not receive funding or publication attention.
  • Concerns are raised about the contentious nature of publishing negative results in peer-reviewed journals, with some expressing appreciation for PLOS ONE's approach to publishing such findings as full papers.
  • Techniques like funnel plots are discussed as methods to address publication bias in meta-analyses and systematic reviews.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the frequency of negative results publication or the effectiveness of current practices. Multiple competing views regarding the significance and treatment of negative results in various fields remain evident.

Contextual Notes

Participants highlight limitations in the publication landscape, including the reluctance of high-impact journals to publish negative results and the funding challenges for replication studies.

Physics news on Phys.org
An excellent example of science working the way it is supposed to (and often doesn't)
 
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity. The current failure of the LHC to make any experimental observation that is in conflict with the Standard Model and the failure of Dark Matter detectors to find a single confirmed particle may in the future be important negative results as well.
 
dipole said:
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity.

As a matter of interesting historical significance, I think Einstein was quoted as saying that he was unaware of the Michelson-Morley results when he was developing SR. At least according to Ohanian:https://www.amazon.com/dp/0393337685/?tag=pfamazon01-20

I think he also asserted that he was unaware of Poincare's relevant work on SR that was going on currently with his. He developed SR largely based on Maxwell's and Lorentz's work. I can see him perhaps being ignorant of Poincare's publications, but not to know about MM that occurred about 20 years earlier? Hard to believe he didn't come across that in his research. What a great feather in your hat reference to have when publishing your model. These are the kind you don't want to miss.
 
Last edited by a moderator:
dipole said:
Historically there have been some very important negative results. The failure of experiments like the Michelson-Morley to measure the luminiferous aether is what lead Einstein, in part, to special relativity. The current failure of the LHC to make any experimental observation that is in conflict with the Standard Model and the failure of Dark Matter detectors to find a single confirmed particle may in the future be important negative results as well.
Negative results are frequently published in physics, other sciences often have a worse ratio - up to the point where repetitions do not get funded at all because "this has been studied already"... or negative results are simply not published at all.
 
mfb said:
Negative results are frequently published in physics, other sciences often have a worse ratio - up to the point where repetitions do not get funded at all because "this has been studied already"... or negative results are simply not published at all.

This is a common complaint from professors teaching seminar classes in neuroscience (where we go through 4 journal articles a week).
 
The issue of the publication of negative results in peer-reviewed journals is a highly contentious one. I am impressed by PLOS ONE accepting this publication, but I am even more impressed that they did so as a full paper, rather than as "correspondence to the editor" or even a mere footnote of retraction (as many other journals tend to do, if they even bother to consider the follow-up paper). Kudos for excellent intellectual honesty all around - to the authors, the reviewers and the editorial board.

I am not really familiar with what goes on in physical sciences journals, but I am active in publishing and reviewing in the medical literature. Because of the long-recognition of issues with getting negative results to see the light of day in high impact-factor journals (or pretty much any "mainstream" journal, really), techniques like displaying the funnel plot (a visual representation of the likelihood of publication bias) have become de rigueur when publishing meta-analyses and systematic reviews. And, to address the perceived gap in the "mainstream" literature, open access, online-only journals like the Journal of Negative Results in Biological Medicine have sprung up. Their website: http://www.jnrbm.com/
 
Yep, PLOS One is itself an open acces project of PLOS.
 

Similar threads

  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 33 ·
2
Replies
33
Views
8K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
5
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 21 ·
Replies
21
Views
6K
Replies
10
Views
5K
  • · Replies 30 ·
2
Replies
30
Views
9K
Replies
90
Views
11K
  • · Replies 3 ·
Replies
3
Views
6K