Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Probability of a given data set given the parameters

  1. Jul 22, 2008 #1
    Why do we look at the probability of a given data set given the parameters, as opposed to the probability of the parameters given the data set?

    So [tex] y(x) = y(x;a_{1} \ldots a_{M}) [/tex]
     
  2. jcsd
  3. Jul 23, 2008 #2

    HallsofIvy

    User Avatar
    Staff Emeritus
    Science Advisor

    Re: Mle

    I'm not sure I understand your question. In "Probability" we always assume we are given some basic probability distribution- i.e. the parameters of some general distribution (such as the normal distribution). The problems in probability then are generally, "given the parameters of the probability distribution, determine the probability of various outcomes (i.e. the data set)".

    Probabilty is then used as the theory behind "Statistics" in which we do just the opposite: given an outcome (data set) try to estimate the parameters of the probability distribution.
     
  4. Jul 24, 2008 #3
    Re: Mle

    Well, in maximum likelihood estimation, the reason is simple: the parameters are not random variables, and so there is no probability distribution defined on them. Instead, we use the likelihood function, which is similar.

    In Bayesian/MAP estimation, on the other hand, the parameters are viewed as random variables, and we do use the probability of the parameters given the data.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Have something to add?