Confidence Levels: Andrew R. Liddle's Astronomy Centre Paper

  • Context: Graduate 
  • Thread starter Thread starter wolram
  • Start date Start date
  • Tags Tags
    Levels
Click For Summary

Discussion Overview

The discussion revolves around Andrew R. Liddle's paper on cosmological parameters and the implications of using Akaike and Bayesian information criteria for model selection in cosmology. Participants explore the accuracy of confidence levels and the impact of publication bias in scientific research.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • Some participants express interest in Liddle's questioning of the accuracy of confidence levels in cosmological models.
  • One participant appreciates the clarity of Liddle's paper and highlights the discussion on publication bias, noting its relevance to the Physics Forums community.
  • Another participant suggests that Liddle's insights on publication bias could warrant a more extensive discussion or even a book on avoiding sensationalism in science.
  • There is curiosity about the application of Akaike and Bayesian information criteria beyond cosmology, with one participant proposing its relevance to cognitive performance data.

Areas of Agreement / Disagreement

Participants generally agree on the significance of publication bias as discussed in Liddle's paper, but there is no consensus on the superiority of the Akaike and Bayesian information criteria compared to other methods. The overall reception of the paper remains mixed, with some expressing strong interest while others seek broader opinions.

Contextual Notes

Participants acknowledge the influence of media on scientific communication and the potential pitfalls of publication bias, but specific assumptions or limitations of Liddle's arguments are not fully explored.

Who May Find This Useful

This discussion may be of interest to researchers and students in cosmology, those studying scientific communication, and individuals interested in the methodologies of model selection in data-rich fields.

wolram
Gold Member
Dearly Missed
Messages
4,411
Reaction score
551
http://arxiv.org/abs/astro-ph/0401198

How many cosmological parameters?
Andrew R. Liddle
Astronomy Centre, University of Sussex, Brighton BN1 9QH, United Kingdom
29 January 2004
ABSTRACT
Constraints on cosmological parameters depend on the set of parameters chosen to define the model which is compared with observational data. I use the Akaike and Bayesian information criteria to carry out cosmological model selection, in order to
determine the parameter set providing the preferred fit to the data. Applying the information criteria to the current cosmological data sets indicates, for example, that spatially-flat models are statistically preferred to closed models, and that possible
running of the spectral index has lower significance than inferred from its confidence.
---------------------------------------------------------------------
this is an interesting paper, I'm not sure if the A and B information
criteria are better than others, but this paper questions the
accuracy of CLs "confidence levels", does anyone have an opinion
on LIDDLEs paper?
 
Astronomy news on Phys.org
Nice paper! Very clear and readable.

I particularly liked the discussion of publication bias - we here at PF (A&C) have seen a more extreme version of this, in that a) many researchers like to 'blow their trumpet' and the journos they talk with like to write catchy articles, and b) PF members will pick and write posts about only the most arresting of these journos' articles.

Of course, Liddle is simply saying what I've been saying :wink: (though he says it with the backing of solid results from information theory, and writes a darn sight better than I can )
 
Today's the 16th, and there have been 62 views of this thread, which is far more than the ~10 per post of a 'normal' thread.

What do all you other readers (PF members) think about the paper which wolfram so kindly posted here for us? Is it really cool, or is it not?? [?]
 
by NEREID.

I particularly liked the discussion of publication bias - we here at PF (A&C) have seen a more extreme version of this, in that a) many researchers like to 'blow their trumpet' and the journos they talk with like to write catchy articles, and b) PF members will pick and write posts about only the most arresting of these journos' articles.
---------------------------------------------------------------------
it is probibily worthy of a book on "how to avoid catchy science",
for some it is easy to spot media seeking researchers, but others
myelf included can fall into their influence, best advice wait
for reaction to publication, ask PF for opinion.
 
Nereid, it is truly cool. I particularly liked the part about publication bias, which certainly should be taken to heart! And I wonder about applying the same information criteria (AIC and BIC) to other areas with a lot of data. For example cognitive performance data and the g model.
 

Similar threads

  • · Replies 19 ·
Replies
19
Views
6K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 15 ·
Replies
15
Views
7K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 8 ·
Replies
8
Views
4K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K