Undergrad Is the Likelihood Function a Multivariate Gaussian Near a Minimum?

Click For Summary
The likelihood function approaches a Gaussian form near the minimum of the chi-square function, with the mean corresponding to the minimizing parameter value. This representation is valid when considering variations in a single parameter while keeping others fixed at their minimum values. Away from the minimum, the likelihood function can become a multivariate Gaussian if correlations between parameters are present. The general formula for the likelihood function in this context is indeed a multivariate Gaussian, though the specific case discussed simplifies to univariate behavior. Understanding these nuances is crucial for accurate data analysis and error assessment.
kelly0303
Messages
573
Reaction score
33
Hello! I am reading Data Reduction and Error Analysis by Bevington, 3rd Edition and in Chapter 8.1, Variation of ##\chi^2## Near a Minimum he states that for enough data the likelihood function becomes a Gaussian function of each parameter, with the mean being the value that minimizes the chi-square: $$P(a_j)=Ae^{-(a_j-a_j')^2/2\sigma_j^2}$$ where ##A## is a function of the other parameters, but not ##a_j##. Is this the general formula or is it a simplification where the correlation between the parameters is zero? From some examples later I guess this is just a particular case and I assume the most general formula would be a multivariate gaussian, but he doesn't explicitly state this anywhere. Can someone tell me what's the actual formula? Also, can someone point me towards a proof of this? Thank you!
 
  • Informative
Likes BvU
Physics news on Phys.org
It is true if you only consider changes in aj and fix all other parameters to their value at the minimum, but not otherwise.
 
mfb said:
It is true if you only consider changes in aj and fix all other parameters to their value at the minimum, but not otherwise.
Thank you! Does it become a multivariate Gaussian, tho, away from the minimum (if there are correlations)? Or does this formula apply only at the minimum value?
 
A multivariate Gaussian can describe the function in a small region around the minimum.
 
First trick I learned this one a long time ago and have used it to entertain and amuse young kids. Ask your friend to write down a three-digit number without showing it to you. Then ask him or her to rearrange the digits to form a new three-digit number. After that, write whichever is the larger number above the other number, and then subtract the smaller from the larger, making sure that you don't see any of the numbers. Then ask the young "victim" to tell you any two of the digits of the...

Similar threads

  • · Replies 16 ·
Replies
16
Views
2K
  • · Replies 6 ·
Replies
6
Views
1K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
2
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 5 ·
Replies
5
Views
9K
  • · Replies 7 ·
Replies
7
Views
2K