Brand new way of working out quality of papers

  • Context: Undergrad 
  • Thread starter Thread starter Zurtex
  • Start date Start date
  • Tags Tags
    Papers Quality
Click For Summary

Discussion Overview

The discussion revolves around a proposed method for assessing the quality of academic papers, specifically in the fields of physics and mathematics. Participants explore the applicability of a "crackpot index" developed by John Baez, considering its relevance and effectiveness in evaluating mathematical works.

Discussion Character

  • Debate/contested

Main Points Raised

  • Some participants suggest that the crackpot index could be applied to mathematics, indicating a potential ease of transition from physics.
  • Others express skepticism about the index, arguing that it allows for the acceptance of incorrect premises and vacuous statements, which could unfairly penalize legitimate contributors.
  • A participant mentions the historical context of mathematicians like Erdős, who offered prizes for proofs and counterexamples, suggesting that the index may not accurately reflect the contributions of serious mathematicians.
  • One participant humorously proposes using the index to evaluate future discussions on the forum, implying a lighthearted approach to the topic.
  • Another participant shares their past experience using the index to grade a specific paper, indicating a high score that suggests significant issues with the work.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the validity or usefulness of the crackpot index. While some see potential in its application, others raise concerns about its criteria and implications for genuine academic work.

Contextual Notes

Participants highlight limitations in the index's scoring system, noting that it may not adequately account for the nuances of academic contributions and could misrepresent the quality of work from established mathematicians.

Zurtex
Science Advisor
Homework Helper
Messages
1,118
Reaction score
1
Someone here has worked out a way that applies to physics:

http://math.ucr.edu/home/baez/crackpot.html

Anyone wishing to try and apply it to maths? I think it will be an easy transition :smile:
 
Mathematics news on Phys.org
I agree that such a scale is needed in math, but I'm not a fan of this crackpot index. Somehow citing incorrect premises and making vaccuous statements is acceptable (wih the -5 point starting 'credit', there's flexibility for 1- and 2-point mistakes), but the other behaviors aren't. I can think of many noncrackpots who would get negative scores... Erdos frequently offered prize money for proofs and counterexamples, many mention (for various reasons) their schooling, a brief mention of the duration of one's study of the material is not beyond the pale of belief, and so on.

Combined with the fact that Baez's own index rates itself as more of a crackpot than a paper with a dozen logical inconsistencies and half a dozen otherwise false statements... :-p
 
lol

That's a great site. We must use it for judging eljose's next topic.
 
DeadWolfe said:
lol

That's a great site. We must use it for judging eljose's next topic.

So the next time he has a post, we should all just post ratings without mentioning the source or reason?
 
No, mention the source and the reason.
 
It's not new. I used it to grade one of the doren shadmi "papers". I stopped when he scored 120 points.
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 52 ·
2
Replies
52
Views
5K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 14 ·
Replies
14
Views
6K
  • · Replies 17 ·
Replies
17
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K