Statistical models and likelihood functions

In summary, the conversation discusses questions about notation interpretation in the context of statistical models. The first question asks about the representation of f_X(x|θ), the probability function for a random vector X given observations θ. The second question considers whether the statistical model for a random vector X with n random variables should include realization functions or random variable functions. The third question asks about the statistical model set in case of parametrized models and the function it represents. The person asking the questions is trying to understand the precise way in which these functions are generated and their outputs.
  • #1
Cinitiator
69
0

Homework Statement


I have a couple of notation interpretation questions:
1) What does [tex]f_X(x|θ)[/tex] represent in this case? The realization function of of our random vector X for some value x and a parameter θ (so that if our random vector has n random variables, its realization vector will be a subset of R^n)? Or is something else represented here?

2) If our (non-parametrized) statistical model is based on some random vector X with n random variables, will it contain realization functions of the random vector, or rather the random variable functions which the said vector contains?

3) In case of parametrized models: Is the statistical model set (let's name it P) a set of functions under every parameter space possible? And what do these functions represent? Are they assumed to have a fixed input? Are they realizations of a random vector under every single parameter in the parameter space? Or are they random variable functions which belong to our random vector?

Homework Equations


gdmgb.png



The Attempt at a Solution


Trying to interpret it in different ways, but not knowing which interpretation is the correct one.
 
Physics news on Phys.org
  • #2
Cinitiator said:
1) What does [tex]f_X(x|θ)[/tex] represent in this case?
It is the probability (density?) function for the r.v. X given the observations θ.
I don't know what you mean by a realization function.
 
  • #3
haruspex said:
It is the probability (density?) function for the r.v. X given the observations θ.
I don't know what you mean by a realization function.

I know that. I don't know in what precise way this function is 'generated'. That is - do we take an entire random vector (say, an R^n vector with random variables) and input it, and then output a R^n vector in the measure space (probabilities for each R^...)? That's what I call a realization function, since it outputs the realization of this random vector.

Or is the said function generated in an entirely different way given our random variable?
 
  • #4
Cinitiator said:
do we take an entire random vector (say, an R^n vector with random variables) and input it, and then output a R^n vector in the measure space (probabilities for each R^...)?
No, it can't be that. If you look at the definition of the likelihood function you can deduce that the range of f is ℝ, not ℝn. So I would say it's just a joint distribution.
 

1. What is a statistical model?

A statistical model is a mathematical representation of a real-world phenomenon or process. It is used to describe, analyze, and make predictions about data, and can be used to test hypotheses or make inferences about a population based on a sample.

2. What is the purpose of likelihood functions in statistical models?

Likelihood functions are used in statistical models to measure how well the model fits the data. They are used to evaluate the probability of obtaining the observed data given the specific parameters of the model. This allows for the comparison of different models and the selection of the one that best explains the data.

3. How do you determine the best statistical model for a given dataset?

The best statistical model for a given dataset is determined by evaluating the likelihood functions of different models and comparing them. The model with the highest likelihood, or the one that best fits the data, is typically chosen as the best model. Other factors such as simplicity and interpretability may also be considered.

4. What is maximum likelihood estimation?

Maximum likelihood estimation is a method used to determine the parameters of a statistical model by finding the values that maximize the likelihood function. This involves finding the set of parameter values that make the observed data the most likely to occur. Maximum likelihood estimation is a commonly used approach in statistical modeling.

5. Can likelihood functions be used in non-parametric models?

Yes, likelihood functions can be used in non-parametric models, although they may be more difficult to define. In non-parametric models, the parameters are not predetermined, and the model is instead derived from the data itself. Likelihood functions in non-parametric models may involve estimating the probability distribution of the data or comparing different non-parametric models to determine the best fit.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
477
  • Set Theory, Logic, Probability, Statistics
Replies
30
Views
2K
  • Calculus and Beyond Homework Help
Replies
0
Views
151
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
445
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Calculus and Beyond Homework Help
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
545
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
464
Back
Top