Register to reply 
Likelihood distribution 
Share this thread: 
#1
Oct1810, 12:35 PM

P: 16

Hey everyone,
i am new to using statistics and have come across a problem. I am trying to regenerate the result of a paper in which a theoretical parameter is constrained. I have calculated the chi squared and plotted the likelihood function (exp[chisquared])to see what value of the parameter has the highest likelihood. I am getting almost the same value as the paper but my graph is not scaled like it. I would like the maximum value of likelihood to be 1. What normalization constants am i missing? Also in the likelihood function do we use the reduced chisquared? 


#2
Oct1910, 01:05 AM

Sci Advisor
P: 4,782

Well, first of all, there may be a factor of two error. The way the Chi square is usually defined, you should be dividing it by two in the exponent to the probability distribution.
That said, the key point here is that for most problems, the normalization is simply not known when the Chi square is generated, so you have to manually integrate the probability distribution to determine the normalization. If your distribution is Gaussian, you can do this analytically, though for real distributions we typically make use of MarkovChain Monte Carlo to perform the integration numerically. At any rate, you can read up on the multivariate normal distribution here: http://en.wikipedia.org/wiki/Multiva...l_distribution 


#3
Oct1910, 03:48 AM

P: 16

Thanx,
I thought of integrating the likelihood and equating it to find the normalization constant but the problem is my chisquared itself is a function of an unknown parameter,the value of which I want to find. So we have two unknownsthe parameter and the normalization constant and only one equation!!!! 


#4
Oct1910, 04:24 AM

Sci Advisor
P: 4,782

Likelihood distribution
[tex]\int P(x) dx = 1[/tex] Where [itex]x[/itex] here is the set of all parameters in the chi square, and the integral is over the entire available parameter space. If your chi square is Gaussiandistributed, this normalization is relatively straightforward. If not, you have to actually perform the integral numerically. Basically, the unknown input parameters to the chi square are never solved for, we merely find their probability distributions. 


#5
Oct2010, 08:36 AM

P: 16

hii,
i tried doing the normalization as you suggested by doing [A*integral(exp[chisquared/2])] over the parameter(inf,inf) and equated it to 1 to calculate A. then i plotted A*exp[chisquared/2] vs the parameter. but still it is not normalized to 1. the maximum value the function takes is nearly 2. what am i doing wrong? 


#6
Oct2010, 08:45 AM

P: 16

i also tried normalizing each event(i have 17 data points) to 1 and find corresponding normalization constants. Then i plotted (product of constants)*exp[chisquared/2],but even that is not scaled to 1.



#7
Oct2010, 09:08 AM

Sci Advisor
P: 4,782

Normalizing the individual events changes the problem significantly, and should not be done. 


#8
Oct2010, 10:55 AM

P: 16

So I guess what i have done is correct and the authors of the paper must have just scaled the graph to one somehow.I was worried because I was getting the peak at the same point and my graph intersects the xaxis at the same coordinates as the paper. 


#9
Oct2010, 12:59 PM

Sci Advisor
P: 4,782




Register to reply 
Related Discussions  
Maximum likelihood of Poisson distribution  Calculus & Beyond Homework  10  
Maximum likelihood estimator of binominal distribution  Calculus & Beyond Homework  1  
Likelihood Function  Exponential Distribution  Calculus & Beyond Homework  1  
Exponential distribution likelihood  Set Theory, Logic, Probability, Statistics  1  
Poisson distribution, likelihood ratios  Calculus & Beyond Homework  0 