Publication Bias and Replication Crisis

Click For Summary

Discussion Overview

The discussion revolves around the concept of publication bias in scientific journals, particularly focusing on whether certain journals, like Science or Nature, publish only studies with null results or heavily replicated studies. The conversation touches on the implications of publication practices on scientific communication and the replication crisis.

Discussion Character

  • Debate/contested
  • Meta-discussion

Main Points Raised

  • Some participants inquire about the existence of a journal that publishes only null results or replicated studies, seeking clarification on the topic.
  • One participant argues that publication bias is a general issue in science, suggesting that journals prioritize exciting findings over null results due to business considerations.
  • Another participant expresses a desire for articles that discuss failed experiments, aligning with the philosophy of falsification in science.
  • There is a suggestion that the origin of the claim about the journal may not be reliable, as it is based on hearsay.
  • Participants engage in a light-hearted exchange about the difficulty of tracking down the source of the claim regarding the journal.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the existence of a specific journal that publishes only null results or replicated studies. There are differing views on the implications of publication bias and the motivations behind journal publication practices.

Contextual Notes

The discussion reflects uncertainty regarding the reliability of sources and the motivations of scientific journals. There are unresolved questions about the specific practices of journals like Science and Nature.

Ontophobe
Messages
60
Reaction score
1
I've heard tell of a science journal like Science or Nature that a) only publishes studies with null results, and/or b) only publishes heavily replicated studies. Is this true? and if so, what's it called?
 
Physics news on Phys.org
Ontophobe said:
I've heard tell of a science journal ...

where did you hear that ?
 
  • Like
Likes   Reactions: Vanadium 50
I wouldn't single out Nature or Science here since they are top-notch publications.

Publication bias is a general issue, resulting from human nature. Magazines and Journals need to keep their readers, and nobody gets excited about a "10 things that totally didn't work" article. It's good science to publish that, but it's bad business.
 
I heard it from a friend. Where he heard it from I don't know.

You're right. It's a business. I don't fault Science or Nature specifically. But I'm with Popper on the role of falsification in science, so basically, I'd absolutely want to read a "10 Things That Totally Didn't Work" article.
 
Ontophobe said:
I heard it from a friend. Where he heard it from I don't know.

That's not really something we can track down. Not much better than "I know a guy who knows a guy..."

Ontophobe said:
I'd absolutely want to read a "10 Things That Totally Didn't Work" article.

Do you subscribe to Science or Nature? If so, write them and tell them. If not, well, why would they care what a non-subscriber thinks?
 
Ontophobe said:
I heard it from a friend. Where he heard it from I don't know.

Maybe he was talking about this recent video?

 
PF's favorite pastime - guess what the OP meant,
 
  • Like
Likes   Reactions: beamie564 and davenn
This thread is closed for now.

@Ontophobe if you have a specific professional article you would like to discuss then please let me know by PM and I will reopen the thread.
 

Similar threads

Open Access Scientific Publications
  • · Replies 1 ·
Replies
1
Views
613
Adding drama and controversy to scientific articles for the public
  • · Replies 13 ·
Replies
13
Views
2K
Citation bias in published papers
  • · Replies 3 ·
Replies
3
Views
2K
Graduate How do people explore new ideas in physics?
  • · Replies 52 ·
2
Replies
52
Views
4K
The Significance Filter: How selective publishing biases results
  • · Replies 1 ·
Replies
1
Views
1K
High School Compensating for a bias - a simple geometry/algebra problem:
  • · Replies 1 ·
Replies
1
Views
2K
High School New solutions to old, historic problems
  • · Replies 2 ·
Replies
2
Views
3K
Graduate Shinichi Mochizuki's ABC Conjecture and Replication Crisis in Maths
  • · Replies 33 ·
2
Replies
33
Views
9K
Von Neumann replicator vehicle model
  • · Replies 23 ·
Replies
23
Views
4K
Why does biology deal with why questions?
  • · Replies 1 ·
Replies
1
Views
3K