Mathematica: Problem Computing Fisher Information of pdf

Click For Summary

Discussion Overview

The discussion revolves around calculating the Fisher information for a specific probability density function (pdf) using Mathematica. Participants explore issues related to the integration of the Fisher information expression and the challenges encountered in obtaining results from Mathematica.

Discussion Character

  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant presents a pdf and attempts to compute the Fisher information using an integral in Mathematica, but the software returns the integral itself without evaluation.
  • Another participant provides a different expression for the integrand and successfully computes an indefinite integral, questioning whether their approach is correct.
  • A third participant confirms the correctness of the integrand and inquires about Mathematica functions that could evaluate the integrand from the indefinite integral.
  • A fourth participant discusses the complexities of definite and indefinite integrals in Mathematica, suggesting that assumptions about the coefficients may help in evaluating the integrals.
  • This participant also proposes testing with plausible values for the parameters to see if Mathematica can provide sensible results.

Areas of Agreement / Disagreement

Participants generally agree on the correctness of the integrand derived by one of the contributors, but there is no consensus on how to resolve the integration issue in Mathematica. Multiple perspectives on the challenges of integration remain unresolved.

Contextual Notes

Participants note the potential need for specific values for parameters to assist Mathematica in evaluating the integral, highlighting the dependence on the relationships between coefficients and the nature of the functions involved.

jcates7
Messages
3
Reaction score
0
Hello,

I'm trying to calculate Fisher information (and eventually the Cramer-Rao lower bound) for this particular pdf with Mathematica:

\text{pte}[t,\Theta ] = \frac{P_{\text{ec}}}{\tau _d-\tau _r}\left[e^{\frac{-(t-\Theta )}{\tau _d}}-e^{\frac{-(t-\Theta )}{\tau _r}}\right]; \text{domain}[\text{pte}] = \{t,-\infty,\infty\}\&\&\{\Theta >0\}

So I want to find I(t|\Theta )

This seems relatively straightforward with:

\text{Integrate}\left[D[\text{Log}[\text{pte}],\Theta ]^2,\{t,-\infty ,\infty \}\right]

However, Mathematica doesn't want to compute the integral. It just returns the integral itself:

\int_{-\infty}^{\infty} \frac{\left(\frac{e^{-\frac{t-\Theta }{\tau _d}}}{\tau _d}-\frac{e^{-\frac{t-\Theta }{\tau _r}}}{\tau _r}\right){}^2 \left(\frac{P_{\text{ec}}}{\tau _d-\tau _r}\right)'\left[e^{-\frac{t-\Theta }{\tau _d}}-e^{-\frac{t-\Theta }{\tau _r}}\right]{}^2}{\frac{P_{\text{ec}}}{\tau _d-\tau _r}\left[e^{-\frac{t-\Theta }{\tau _d}}-e^{-\frac{t-\Theta }{\tau _r}}\right]{}^2} \, dt

Initially my thought is that there isn't a closed-form solution, but this is something I have seen calculated in journal papers with the same pdf. I'm not an experience Mathematica user. Is there something I have missed in the input (syntax or additional options) or are there any general simplifications that Mathematica would need?

Thanks!
 
Physics news on Phys.org
I get a different integrand than you do:

In[1]:= pte[t_,omega_]:=Pec/(taud-taur)(E^-((t-omega)/taud)-E^-((t-omega)/taur));
i=D[Log[pte[t,omega]],omega]^2

Out[2]= (1/(E^((-omega + t)/taud)*taud) - 1/(E^((-omega + t)/taur)*taur))^2/(E^(-((-omega + t)/taud)) - E^(-((-omega + t)/taur)))^2

And if I do an indefinite integral I get

In[3]:= Integrate[i,t]

Out[3]= (-(E^(omega/taud + t/taur)*t*(taud^2 + taud*taur + taur^2)) + E^(t/taud + omega/taur)*(taud*(taud - taur)*taur + t*(taud^2 + taud*taur + taur^2)) - (E^(t/taud + omega/taur) - E^(omega/taud + t/taur))*taud*taur*(taud + taur)*Log[E^(t/taud + omega/taur) - E^(omega/taud + t/taur)])/((E^(t/taud + omega/taur) - E^(omega/taud + t/taur))*taud^2*taur^2)

Have I made a mess out of this somehow?
 
No, that is the correct equation, and I get the same integrand when I copy it into my notebook. Is there an inherent mathematica function for me to now evaluate the integrand from the indefinite integral?

Should one expect, in general, for mathematica to have difficulties with definite integrals?

Thanks
 
Definite and indefinite integrals have many different special cases and complexities when dealing with complicated functions. IF we could assume non-negative and perhaps continuous then then we could just subtract the result of substituting your limits of integration. But Mathematica doesn't seem to be able to see what the limit will be without knowing the values for the rest of your coefficients.

What happens if you give plausible values to omega, taur and taud? Do you get sensible results for the definite, or indefinite, integrals then?

Sometimes Mathematica just needs a hint to be able to see how to find a solution. Do you know anything about the domains or relationships between your coefficients?
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
Replies
5
Views
2K
Replies
2
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 6 ·
Replies
6
Views
7K
  • · Replies 4 ·
Replies
4
Views
2K
Replies
2
Views
1K