Natural parametrization of pdfs

Click For Summary
Natural parametrization of probability density functions (pdfs) in the exponential family involves transforming the parameters in a specific way, where the pdf is expressed as a function of new parameters. The transformation requires identifying the function D(φ) when converting from θ to φ, which can be complex depending on the nature of the original function. Not all pdfs in the exponential family can be naturally parameterized due to restrictions on the forms of A, B, C, and D functions. The discussion highlights the need for clarity on whether φ is a scalar or vector and the challenges in rewriting functions involving multiple variables. Understanding these concepts is crucial for effectively applying natural parametrization in statistical modeling.
WantToBeSmart
Messages
10
Reaction score
0
I am struggling to understand the concept of natural parametrization of pdf of exponential family. Say that we have a function with the following pdf:

f(x;\theta)=exp\left[\sum_{j=1}^k A_j(\theta)B_j(x)+C(x)+D(\theta)\right]

where A and D are functions of \theta alone and B and C are functions of x alone.

Natural parametrization.

f(x;\phi)=exp\left[\sum_{j=1}^k \phi_jB_j(x)+C(x)+D(\phi)\right]

where \phi_j=A_j(\theta)

My two questions are:

1 How to I find D(\phi)?
2 Can we perform natural parametrization on all pdfs belonging to the exponential family? If not why is that the case?

Thank you in advance!
 
Last edited:
Physics news on Phys.org
WantToBeSmart said:
1 How to I find D(\phi)?
It isn't clear from your notation whether \phi is a scalar or a vector.

2 Can we perform natural parametrization on all pdfs belonging to the exponential family? If not why is that the case?

I had to look up "natural parameterization" on the web and from that glance, I think what you are asking entails such questions as: How do we write an arbitrary function of two variables as a sum of two functions, each involving one variable? I don't know a procedure for doing that. If you allowed to define new variables then for f(x,y) = xy, one could certainly set p = xy and write f(x,y) as a function of one variable p. For a more complicated function, I think it is a complicated question. Perhaps some other forum member will know the answer.
 
If there are an infinite number of natural numbers, and an infinite number of fractions in between any two natural numbers, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and... then that must mean that there are not only infinite infinities, but an infinite number of those infinities. and an infinite number of those...

Similar threads

  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
7K