Understanding criticisms of a paper

  • Context: Graduate 
  • Thread starter Thread starter dorlomin
  • Start date Start date
  • Tags Tags
    Paper
Click For Summary

Discussion Overview

The discussion revolves around criticisms of a recently published paper on the first flowering dates of flowers in the UK. Participants explore statistical methods used in the paper, the implications of observer bias, and the interpretation of results related to flowering dates over time.

Discussion Character

  • Debate/contested
  • Technical explanation
  • Exploratory

Main Points Raised

  • One participant critiques the paper's claim that first flowering dates have been occurring earlier, arguing that the variability could be attributed to chance alone and questioning the validity of the statistical confidence interval used.
  • The author of the paper reportedly employs a hierarchical Bayesian model to estimate parameters with uncertainties, though the meaning and implications of this approach are unclear to some participants.
  • Another participant raises a concern about potential bias in the data due to the number of observers recording flowering dates, suggesting that increased observer numbers may lead to earlier flowers being less likely to go unnoticed.
  • A follow-up comment reiterates the concern about observer bias and suggests that having data on how many observers noted a flower by a given date could help address this issue.

Areas of Agreement / Disagreement

Participants express differing views on the validity of the paper's conclusions and the statistical methods employed. There is no consensus on the impact of observer bias or the interpretation of the statistical analysis presented in the paper.

Contextual Notes

Participants note limitations regarding the historical context of observer numbers and the potential influence on the data, as well as the complexity of Bayesian statistical methods that may not be fully understood by all contributors.

dorlomin
Messages
21
Reaction score
0
First up apologies if this is a violation of a rule or COC.

Anyway new paper was published a couple of days ago concerning first flowering dates of flowers in the UK.

http://rspb.royalsocietypublishing.org/content/early/2010/04/01/rspb.2010.0291.full"

A report on it was published in the http://www.guardian.co.uk/environme...-study-shows?showallcomments=true#comment-51".
And as always a somewhat exuberant discussion broke out. In the end one comentator made this criticism of the paper.

This paper does not demonstrate that first flowering has been occurring on average earlier during the previous 25 years than in any of the 9 previous 25 year periods. The variability in 25-year mean date of first flowering can be accounted for by chance alone. The mean date of first flowering in the most recent 25 year period is within two standard deviations of the mean for the previous 250 years. In other words, exactly where we expect it to be, accounted for solely by chance variation. There is no evidence of any systematic process whatsoever influencing date of first flowering.
Now I understand that 2 standard deviations are a confidence interval of 95%. I was very wary however of the suggestion that this was all "accounted for solely by chance variation" even at less than 95% confidence surely that is not just chance, just less likely not to be chance?

I emailed the author and they very kindly responded, although again I lack the skills to fully understand their response. They said I could use the response but not cut and paste it, which I am very happy to comply with. The author infromed me that they do not simply apply an average for the estimated indices but apply a hierarchical Bayesian model that in their words can "estimate parameters with uncertainties in the estimate".

I don't quite follow what that means, I understand the baysian statistics are a means of reducing the randomness in statistics. (My ex does this for a living and I am going have her go through it with me hopefully but thought I would also ask here). The phrase that the author used that has me foxed is this one: "estimate parameters with uncertainties in the estimate". Can someone explain what that means and what the result would be?

As I said apologies if people do not think this is what the forum is for, but I keep seeing things like baysian methods being mentioned all over the place and am never quite sure about it.
 
Last edited by a moderator:
Physics news on Phys.org
Hmm I read:

Today, approximately 40 000 people across the UK are registered as recorders, providing extensive geographical coverage.

How many people were that 50 years ago, 100 years ago? Etc. Is there a chance that the first flowering date is biased by the number of observers? Like, the more of them, the lesser the chance that any earlier flower goes unnoticed.
 
Andre said:
How many people were that 50 years ago, 100 years ago? Etc. Is there a chance that the first flowering date is biased by the number of observers? Like, the more of them, the lesser the chance that any earlier flower goes unnoticed.

If we had information about how many noticed a flower by a given date, we could probably undo that bias...
 

Similar threads

  • · Replies 21 ·
Replies
21
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 2 ·
Replies
2
Views
622
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 264 ·
9
Replies
264
Views
24K
  • · Replies 5 ·
Replies
5
Views
4K
  • · Replies 16 ·
Replies
16
Views
12K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K