I Is the Likelihood Function a Multivariate Gaussian Near a Minimum?

AI Thread Summary
The likelihood function approaches a Gaussian form near the minimum of the chi-square function, with the mean corresponding to the minimizing parameter value. This representation is valid when considering variations in a single parameter while keeping others fixed at their minimum values. Away from the minimum, the likelihood function can become a multivariate Gaussian if correlations between parameters are present. The general formula for the likelihood function in this context is indeed a multivariate Gaussian, though the specific case discussed simplifies to univariate behavior. Understanding these nuances is crucial for accurate data analysis and error assessment.
kelly0303
Messages
573
Reaction score
33
Hello! I am reading Data Reduction and Error Analysis by Bevington, 3rd Edition and in Chapter 8.1, Variation of ##\chi^2## Near a Minimum he states that for enough data the likelihood function becomes a Gaussian function of each parameter, with the mean being the value that minimizes the chi-square: $$P(a_j)=Ae^{-(a_j-a_j')^2/2\sigma_j^2}$$ where ##A## is a function of the other parameters, but not ##a_j##. Is this the general formula or is it a simplification where the correlation between the parameters is zero? From some examples later I guess this is just a particular case and I assume the most general formula would be a multivariate gaussian, but he doesn't explicitly state this anywhere. Can someone tell me what's the actual formula? Also, can someone point me towards a proof of this? Thank you!
 
  • Informative
Likes BvU
Physics news on Phys.org
It is true if you only consider changes in aj and fix all other parameters to their value at the minimum, but not otherwise.
 
mfb said:
It is true if you only consider changes in aj and fix all other parameters to their value at the minimum, but not otherwise.
Thank you! Does it become a multivariate Gaussian, tho, away from the minimum (if there are correlations)? Or does this formula apply only at the minimum value?
 
A multivariate Gaussian can describe the function in a small region around the minimum.
 
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...
Back
Top