Likelihood Functions: Parameters & Probabilities

AI Thread Summary
Likelihood functions represent the probability of observing a specific outcome of a random variable given certain parameters. They can handle both population parameters and statistical model parameters. For continuous random variables, the value of the probability density function at a point does not represent the probability of the variable equaling that point, but rather serves as an approximation for the probability within a small interval around it. This distinction clarifies why the term "maximum likelihood" is preferred over "maximum probability." Understanding these concepts is crucial for accurate statistical modeling and inference.
Cinitiator
Messages
66
Reaction score
0
As far as I know, the definition of likelihood functions is the probability of a given random variable result given some parameter (please correct me if I'm wrong). What kind of parameters are usually handled by likelihood functions? Population parameters? Statistical model parameters? Both?
 
Physics news on Phys.org
Cinitiator said:
As far as I know, the definition of likelihood functions is the probability of a given random variable result given some parameter (please correct me if I'm wrong).

For a continuous random variable x with probability density f(x), a number such as f(a) isn't "the probability that x = a". ( For example the desnity of a random variable x uniformly distributed on the interval [0, 1/2] is f(x) = 2 and 2 isn't a possible value for the probability of an event.) The density can be used to approximate the probability that x is in a small interval around a particular value and in many situations, you can think of the density at f(a) as "the probability that x = a" in order to remember the correct formulas. But f(a) isn't actually "the probability that x = a".

The fact that a value of the denstiy function isn't an actual probability explains why the phrase "maximum liklihood" is used instead of the simpler phrase "maximum probability".
 
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...
Back
Top