Bayes formula and picking variance from distribution

Click For Summary

Discussion Overview

The discussion revolves around the application of Bayes' formula in the context of selecting numbers from normal distributions, where the variance of the distribution is itself drawn from another normal distribution. Participants explore the implications of this setup on the resulting distribution of the random numbers and the associated variance.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • One participant describes a scenario where numbers are picked from normal distributions, with the variance of each distribution being drawn from another normal distribution, and seeks to understand the resulting distribution and its variance.
  • Another participant requests clarification on the initial problem setup, indicating that the description may be ambiguous.
  • A third participant introduces concepts related to joint probability density functions and conditional distributions, suggesting a method to calculate the distribution of one variable given another.
  • This participant also notes that the variance of a distribution cannot be normally distributed, implying that using standard deviation might complicate the integration process due to singularities at the origin.
  • A later reply expresses agreement with the previous points and suggests that with a sufficiently large mean compared to the standard deviation, the distribution may approximate normality, while also indicating that this was more of a thought experiment.

Areas of Agreement / Disagreement

Participants express differing views on the nature of the variance and its implications for the resulting distribution. There is no consensus on the correct approach or outcome, and the discussion remains unresolved.

Contextual Notes

Participants highlight limitations regarding the positivity of variance and the implications of using standard deviation in calculations, which may affect the integration process. The discussion also reflects uncertainty about the appropriate distributions to use for variance selection.

freshmanaskin
Messages
2
Reaction score
0
This should be rather simple bayesian problem, but I can't figure it out for myself.

If i pick numbers from normal distributionS, where the variance of the distribution at each pick v1, is in turn picked out of a normal distribution with variance v2.

What is then the distribution of the random number? i tried this on my calculator a bit, and it looks as if it is normal itself, but what is the variance of x?

This is not homework, but something I would like to understand how to calculate.

//Cal
 
Physics news on Phys.org
If i pick numbers from normal distributionS, where the variance of the distribution at each pick v1, is in turn picked out of a normal distribution with variance v2.

You need to clarify this.
 
If you have two continuous random variables (for example), X and Y, with joint pdf [itex]\rho_{X,Y}(x,y)[/itex], this can be written in terms of the conditional distribution [itex]\rho_{X|Y}(x|y)[/itex] or [itex]\rho_{Y|X}(y|x)[/itex] as:

[tex]\rho_{X,Y}(x,y) = \rho_{X|Y}(x|y)\rho_Y(y) = \rho_{Y|X}(y|x)\rho_X(x),[/tex]

where the individual distributions are

[tex]\rho_X(x) = \int_{-\infty}^\infty dy~\rho_{X,Y}(x,y),[/tex]
and similarly for y. So, if you knew the distribution for y and you knew the condition distribution for x given y, you can calculate the distribution of x as

[tex]\rho_X(x) = \int_{-\infty}^\infty dy~\rho_{X|Y}(x|y)\rho_Y(y).[/tex]

Amusingly enough, I was dealing with this concept myself this week, although in the context of a much more intractable problem.

This said, I think you need to tweak your suggested problem. The variance of a distribution is positive, so it can't be normally distributed. If you use the standard deviation, I don't think you'll get a result, because you'll have a factor of [itex]1/\sigma[/itex] in your integration, why of course blows up at the origin, but the exponential will also be even in sigma, so the principal value might be zero.
 
Last edited:
Thank you mute, all you said seems very right and true to me. with large enough mu compared to sigma it will become pretty normal. I might have to use some other distribution to pick the variance if i use this for something. But this was more of a though experiment.
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
1
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 14 ·
Replies
14
Views
7K