Can You Estimate Parameters for a Non-Closed Form Probability Distribution?

AI Thread Summary
Estimating parameters for a non-closed form probability distribution can be challenging, especially when using maximum likelihood estimation (MLE). The discussion highlights difficulties in deriving the necessary derivatives for parameter n, suggesting that if the function f is not indexed by i, it can be differentiated with respect to n. An alternative approach involves testing various values of n and estimating parameters x and y for each, resulting in multiple estimates. To determine the best estimate among these, one can use likelihood tests to compare log-likelihood values, selecting the estimate with the highest likelihood. This method provides a systematic way to evaluate parameter estimates when faced with complex distributions.
jimmy1
Messages
60
Reaction score
0
I have a probability distribution of the form \sum_{i=0}^n f(n,x,y). There is no closed form expression for it. I need to know if there is any method that I can use to estimate the parameters {n, x, y} given some data from the above distribution.
I've tried a maximum likelihood approach, but I'm having trouble getting the derivative with respect to n. Is it possible to get this derivative, and use a maximum likelihood approch to estimate n
 
Physics news on Phys.org
Is your f indexed by i? If not, then you have (n+1)f(n,x,y), which is differentiable w/r/t/ n, as long as f is.

If f is indexed by i, then you might think of the sum as an integral and may be able to apply Leibniz's Rule (see under "Alternate form": http://en.wikipedia.org/wiki/Leibniz's_rule).
 
Last edited:
Thanks for the reply. I had a look at that Leibniz's Rule link, but I'm not fully sure how to go about using it??

Anyway, I was thinking of a slightly more simple idea. I basically need an estimate of the 3 parameters {n, x, y}, preferiably using MLE. Since it's difficult to get the derivative w.r.t n, I was thinking of trying various values of n (say n=1,..,50), and for each value of n estimate MLE of x,y.

So basically, I now end up with 50 different estimates for {n, x, y}. So my question is, is there any mathematical way to tell which one of these 50 estimates is the best one? ie. Is there some sort of likelihood test I could use?
 
I'd just look at the (log) likelihood numbers and select the largest.
 
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...

Similar threads

Back
Top