Probability-To-Exceed (PTE) and Chi^2 distribution

Click For Summary

Discussion Overview

The discussion centers on understanding the differences between the chi-squared (##\chi^{2}##) distribution and the Probability-To-Exceed (PTE) in the context of comparing two data sets. Participants explore the theoretical underpinnings, statistical implications, and practical applications of these concepts, particularly in relation to confidence levels and parameter estimation.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant seeks clarification on the relationship between the ##\chi^{2}## distribution with ##k=2## degrees of freedom and the PTE, noting the differences in integration and the absence of the error function in their current understanding.
  • Another participant emphasizes the importance of understanding the underlying data and how statistics are computed, questioning the treatment of model parameters as random variables in the context of the PTE.
  • A participant outlines specific concerns regarding the consistency and independence of the two data sets, as well as the estimation of shared parameters, while seeking more information on the application of PTE in this context.
  • There is a suggestion that the PTE might have a different density function compared to the ##\chi^{2}## distribution, possibly being Gaussian, which raises further questions about the implications for confidence levels.
  • One participant expresses a desire for advice on the general methods for comparing and cross-correlating two data sets, reiterating the need for clarity on the differences between the ##\chi^{2}## distribution and PTE.

Areas of Agreement / Disagreement

Participants do not appear to reach a consensus on the differences between the ##\chi^{2}## distribution and PTE, with multiple competing views and uncertainties remaining regarding their definitions and applications.

Contextual Notes

Limitations include the lack of clarity on the specific data sets being compared and the assumptions underlying the statistical methods discussed. The discussion also highlights unresolved mathematical steps related to the integration of the ##\chi^{2}## distribution and the PTE.

fab13
Messages
300
Reaction score
7
I would like to know the difference between the ##\chi^{2}## distribution and the PTE (Probability-To-Exceed) ?

I must compare 2 data sets A and B and in the article I am reading, they talk about this PTE :

Y5WOSqP.png


For the moment, I only know the ##\chi^{2}## distribution with ##k=2## degrees of freedom :

##f(\Delta\chi^{2})=\dfrac{1}{2}\,e^{-\dfrac{\Delta\chi^{2}}{2}}\quad(1)##

and the relation with confidence level :

##1-CL={\large\int}_{\Delta\chi^{2}_{CL}}^{+\infty}\,\dfrac{1}{2}\,e^{-\dfrac{\Delta\chi^{2}}{2}}\,d\,\chi^{2}=e^{-\dfrac{\Delta\chi_{CL}^{2}}{2}}\quad(2)##

I don't know how to make the link with the image and text above. Indeed, in the article, they make appear the integral of gaussian whereas in ##(2)##, I can only make appear a simple integration of exponential (I mean, there is no "##\text{erf}##" function appearing unlike into the article).

If someone could explain the difference between ##\chi^{2}## distribution and ##P_{\chi^2}## PTE ?

Thanks
 

Attachments

  • Y5WOSqP.png
    Y5WOSqP.png
    39.5 KB · Views: 1,409
Physics news on Phys.org
Even the additional information given on stackexchange https://stats.stackexchange.com/que...obability-to-exceed-pte-and-chi2-distribution doesn't clarify the situation. Questions about statistics involve what statistic is involved not merely what distribution is involved. To understand a statistic, one must know the data and how the statistic is computed from the data. In this example, it isn't clear what the data is. The stackexchange information seems to treat the "model parameters" as random variables. How does that work?
 
@Stephen Tashi

My main issue is to understand the method used in this article to be able to compare 2 data set and see if threre are :

1) there are Consistent since I have to extimate in both data sets the parameters contained into ##p_{A}## and ##p_{B}## vectors (parameters are shared into 2 experiments A and B)
2) there are independent from a statistical point of view
3) Give consistent estimation of parameters with A and B experiments (roughly equal)

I would like to get more informations about the using of the Probability-To-Exceed ##Pr_{\chi^2}## in this topic. Up to now, I know classical relation between condifence level (CL) and the ##\chi^2 ## distribution with given number of degrees of freedom (with n.o.f = 2, the ##\chi^2## distribution has an exponential density function, and not gaussian like it seems to be the case here). So the relation I know is : ##1 - CL = Pr(d(\chi^2)) > d(\chi^2_CL))##. Must I consider the P-T-E as a similar principle of ##\chi^2## distribution but with a different density function (in this case here, density function of PTE is maybe gaussian) ?

By the way, if I take a large number of sigma in this PTE, then, I have a small value for PTE and then a high C.L (confidence level) : it is the expected result, right ? since the probability to exceed a value far away from the ##\chi^2_min## is small. Thanks for your explanations and help.
 
Anyone could understand my issue ? or maybe Is my question bad formulated.

I just want to get some advices about the notion of consistency or the general method to compare and do cross-correlations between 2 data set like it is performed in article cited above.
In the case of this article, I would like to understand f someone could explain the difference between ##\chi^{2}## distribution and ##P_{\chi^{2}}## Probability To Exceed (PTE) ?
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
1K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 20 ·
Replies
20
Views
4K
Replies
13
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 12 ·
Replies
12
Views
2K