Register to reply 
Confidence in estimated parameters 
Share this thread: 
#1
Feb1412, 08:01 AM

P: 41

Hi there, just wondered if someone could help me?
I have a set of data from an experiment and have fitted a cosine fit to it. If the theoretical model for dark matter I have says the value for θ should be,say 2, and the cosine I have fitted has a θ=2+2.2σ, how could I go about saying for example "I can say with x% confidence my experimental data is consistent with the phase expected from dark matter?" I was trying to assume Gaussian error distribution and relating it to the area under a one tailed Gaussian but I am unsure if this is the correct way? Many thanks 


#2
Feb1412, 10:13 AM

Sci Advisor
P: 3,252




#3
Feb1412, 10:30 AM

P: 41

I've read about the confidence level but I couldn't find out how to relate a confidence level to a Gaussian probability. All I could work out how to do was to say that if x was the theoretical value and my experimentally obtained value was x+2.2σ there was a 0.45% chance of getting a value for the parameter that was greater than the value I have calculated, but I assumed/hoped I was doing something incorrect as this seems to indicate that my parameter is incorrect when to eye it appears a very good fit and has a reduced chi squared value of 1.02.



#4
Feb1412, 10:48 AM

Sci Advisor
P: 3,252

Confidence in estimated parameters
You evaded the questions: "Are you using confidence as a synonym for probability? If not, what do you mean by 'confidence'?"



#5
Feb1412, 10:52 AM

P: 41

Ah sorry, erm I guess so. If the event if highly probably I would like to convert this into a probability of the data being from the theoretical model, if this answers the question?



#6
Feb1412, 11:14 AM

Sci Advisor
P: 3,252

If you are looking for statement that you can make in a scientific publication then the best thing to do is to look at work that got published and see exactly what statistics those papers used that passed the peer review process in your field. (Statistics is highly subjective and what procedures are favored in various academic arenas is largely a matter of tradition.) If you are seeking an answer that satisifes you personally then you must be clear about what you are asking. If you are seeking what it takes to make statements like "There is a 0.97 probability that the true value of theta is 2 , given the data I observed" then you must use Bayesian statistics. This is also the situation if you want to make a statement about a "credible interval", such as "There is a 0.97 probability that the true value of theta is between 1.98 and 2.02". The situation in nonBayesian ("frequentist") statistics is that you make statements such as "There is a 0.97 probability that the value of theta observed in the experiment is within plus or minus 0.2 of the true value", but you can't take a particular numerical value, such as 2, and substitute it in place of "the true value of theta" in that statement. You also can't take a particular numerical value such as 2.2 and subsitute it for "the value theta observed in the experiment" . This is because a statement of a "confidence interval" says something about the general quality of the sampling process you use. It doesn't make any claims about one particular outcome of that process. 


#7
Feb1412, 11:17 AM

Sci Advisor
P: 3,252

...and another approach would be to get into "hypothesis testing" and "statistical significance", which have technicalities all their own. The frequentist approach would be to take "theta = 2" as the "null hypothesis".



#8
Feb1412, 03:48 PM

P: 41

Cheers, I'll have another look



#9
Feb1512, 06:44 AM

P: 41

Ok I've had another go at this after reading up on it and I thought I'd use an example to make my self clearer.
If I obtain a value for parameter A=361.52±5.87 and the theoretical value if the model is correct is 365 then I assume Gaussian errors and say my result is 0.6σ from the value in the model. Using a one tailed Gaussian I find that there is a 237.43% chance of getting 365 or greater if my A is from the same distribution (is this correct?) Therefore I can say with 27% confidence that my data is from the same distribution as theory and the result occurred by chance due to normal deviation, and there is a 73% chance the results are not from the same distribution so I would reject the hypothesis of a cosine modulation with a time period A of 365 days with 73% confidence? I think this is correct, please could you verify?!?! Thanks 


#10
Feb1512, 09:50 AM

Sci Advisor
P: 3,252

Hypothesis testing is subjective. If this was an exercise in a statistics text, I think the answer book would show the use of a twotailed test to do testing for whether your curve differs (in any way, in "either direction") from the theoretical distribution. 


Register to reply 
Related Discussions  
Confidence interval for estimated mean of (discrete) uniform distribution  Set Theory, Logic, Probability, Statistics  9  
Variancecovariance matrix and correlation matrix for estimated parameters  Set Theory, Logic, Probability, Statistics  0  
EWMA for calculating Estimated RTT  Engineering, Comp Sci, & Technology Homework  0  
How do you relay EM wave parameters to Transmission line parameters?  Classical Physics  4 