Characteristic functions and functionals

In summary: The author defines a support space for a probability measure as a space where the sum of the diverging sequences almost everywhere.
  • #1
Matterwave
Science Advisor
Gold Member
3,971
328
Hello guys, I posted this question in the classical mechanics forum (thinking stochastic mechanics falls into the classical mechanics category) but I haven't gotten an answer there. I was told I'd be better off posting the question here. I don't know how to move a thread, so I'll just copy and paste from the other thread. Hopefully that's OK?

Hi, I reading a book on functional integration, and to develop its methods, the author takes us first through stochastic methods (which I'm guessing in the later parts of the book will lead to functionals and functional integrals, etc.). I'm just at the beginning parts, and he has defined a characteristic function of a stochastic variable X as:

$$C(t)\equiv \left<e^{itx}\right>=\int_{-\infty}^\infty e^{itx}d\mu(x)$$

Where ##\mu(x)## is the probability measure on X. The author gives immediately 4 properties of the characteristic function:

1. ##C(0)=1##

2.## |C(t)|\leq 1##

3. ##\Sigma_{j,k=1}^{K,K}\alpha_j^*\alpha_k C(t_k-t_j) \geq 0,\qquad \alpha_j\in \mathbb{C}##

4. ##C(t)## is continuous.

He goes on to say that properties 1-3 are trivial, and proves property 4. I can understand property 1 and 2, but I can't seem to make heads or tails of property 3. What is that property trying to say? Thanks.I'll put a second question I found in another chapter of the book (not dealing with characteristic functions) here instead of starting a new thread.

In this chapter, we are looking at products of probability measures:

$$d\mu_N(x)=\prod_{n=1}^N\sqrt{\frac{b}{2\pi}}e^{-bx_n^2/2}dx_n$$

Giving:

$$d\mu_N(x)=\left(\frac{b}{2\pi}\right)^{N/2}e^{-b\sum_{n=1}^N x_n^2/2}\prod_{n=1}^N dx_n$$

And we take ##d\mu(x)=\lim_{N\rightarrow\infty}d\mu_N(x)##.

In the previous section, the author just gave some "bad examples" on how not to take this limit, with explicit examples showing how if we assume that the probability measure is supported on only sequences such that ##\sum_{n=1}^\infty x_n^2<\infty## then our probability measure is only finitely additive. He then goes on to say that we should adopt the view that the measure is supported on a space such that the sum diverges to infinity almost everywhere (?). He does not give the definition of this support space yet.

Here I have a few questions. First of all, the author seemed to have concentrated mostly on the prefactors in his discussion, with only a passing remark that:

$$\mathfrak{D}x\equiv \prod_{n=1}^\infty dx_n$$

Is not a measure because it does not satisfy complete additivity. If this is not a measure, what hope do we have of making ##d\mu## a probability measure? Will the prefactors some how turn it into a measure? Secondly, when the author is talking about "sequences of x_n", we are, in the end, going to integrate over all x_n, for all n, so I don't understand how a "sequence" is coming into play here (unless he was maybe talking about only integrating over some x_n ranges, different for different n, to produce a sequence?).

Lastly, when he goes on to talk about support properties (which I was hoping to have some of my questions answered in this section) I run into a problem with the first equality he makes. He says, "we note that:

$$\int x_n^2 d\mu(x)=\int_{-\infty}^\infty y^2\sqrt{\frac{b}{2\pi}}e^{-by^2/2}dy=b^{-1}$$

independently of n." I don't understand this at all. What happened to the infinite product defined earlier? How did he turn all of those integrals over all the infinitely many x_n into 1 single integral? I have no idea what to make of this. Thanks.
 
Last edited by a moderator:
Physics news on Phys.org
  • #2
$$\Sigma_{j,k=1}^{K,K}\alpha_j^*\alpha_k C(t_k-t_j) \geq 0,\qquad \alpha_j\in \mathbb{C}$$
What this means is that if you choose any set of times (or whatever the ##t## represents), ##t_1,\ldots,t_K##, and form a matrix ##M## whose ##j,k##'th element is ##[M]_{j,k} = C(t_k - t_j)##, then ##M## is positive semidefinite. This means, by definition, that ##C## is a positive-definite function:

http://en.wikipedia.org/wiki/Positive_definite_function

It's quite easy to prove: just substitute the integral expression for ##C(t_k-t_j)## and interchange the order of integration and summation.
 
Last edited:
  • #3
jbunniii said:
What this means is that if you choose any set of times (or whatever the ##t## represents), ##t_1,\ldots,t_K##, and form a matrix ##M## whose ##j,k##'th element is ##[M]_{j,k} = C(t_k - t_j)##, then ##M## is positive semidefinite. This means, by definition, that ##C## is a positive-definite function:

http://en.wikipedia.org/wiki/Positive_definite_function

It's quite easy to prove: just substitute the integral expression for ##C(t_k-t_j)## and interchange the order of integration and summation.

Ah, I just needed a more intuitive understanding of what he was trying to say with that property. This was really helpful, thanks!

Any hints on the latter questions?
 
  • #4
Matterwave, could you perhaps tell us which book you are reading and on which page all of this is happening?
 
  • #5
Matterwave said:
Lastly, when he goes on to talk about support properties (which I was hoping to have some of my questions answered in this section) I run into a problem with the first equality he makes. He says, "we note that:

$$\int x_n^2 d\mu(x)=\int_{-\infty}^\infty y^2\sqrt{\frac{b}{2\pi}}e^{-by^2/2}dy=b^{-1}$$

independently of n." I don't understand this at all. What happened to the infinite product defined earlier? How did he turn all of those integrals over all the infinitely many x_n into 1 single integral? I have no idea what to make of this. Thanks.

To explain this, notice that

[tex]\int_{-\infty}^{+\infty} \sqrt{\frac{b}{2\pi}} e^{-bx^2/2} dx = 1[/tex]

So take any ##n## and let ##k\leq n##. Thus if we introduce

[tex]d\nu_n(x_n) = \sqrt{\frac{b}{2\pi}} e^{-bx_n^2/2}dx_n[/tex]

then we see that

[tex]\int_{-\infty}^{+\infty} d\nu_n(x_n) = 1[/tex]

So, if we want to calculate

[tex]\int_{-\infty}^{+\infty} x_k^2 d\mu_n(x)[/tex]

then we need to calculate

[tex]\int_{-\infty}^{+\infty}... \int_{-\infty}^{+\infty} x_k^2 d\nu_1(x_1)...d\nu_n(x_n)[/tex]

We can reshuffle the integrals so that ##d\nu_k(x_k)## comes last. We get

[tex]\int_{-\infty}^{+\infty} x_k^2\int_{-\infty}^{+\infty}... \int_{-\infty}^{+\infty} d\nu_1(x_1)...d\nu_n(x_n)d\nu(x_k)[/tex]

Now we can apply the above result with the ##d\nu_n(x_n)## to obtain that this is equal to

[tex]\int_{-\infty}^{+\infty} x_k^2 d\nu_k(x_k)[/tex]

Thus,

[tex]\int_{-\infty}^{+\infty} x_k^2 \sqrt{\frac{b}{2\pi}} e^{-bx_k^2/2}dx_k[/tex]

which can then be calculated to yield ##b^{-1}##. So we conclude that

[tex]\int_{-\infty}^{+\infty} x_k^2 d\mu_n(x) = b^{-1}[/tex]

Now by taking limits, we see that

[tex]\int_{-\infty}^{+\infty} x_k^2 d\mu(x) = b^{-1}[/tex]
 
  • #6
micromass said:
Matterwave, could you perhaps tell us which book you are reading and on which page all of this is happening?

I'm reading John Klauder's "A Modern approach to Functional Integration". This material is in chapter 2 and 3.

Thanks for that explanation, that was clear. :)

I'm still a little confused on what he means when he discusses "sequences" of ##x_n## though since we are going to integrate over all ##x_n##, for every n, from -infinity to +infinity, in the end. This is around section 3.1 and 3.2.
 
  • #7
Matterwave said:
I'm reading John Klauder's "A Modern approach to Functional Integration". This material is in chapter 2 and 3.

Thanks for that explanation, that was clear. :)

I'm still a little confused on what he means when he discusses "sequences" of ##x_n## though since we are going to integrate over all ##x_n##, for every n, from -infinity to +infinity, in the end. This is around section 3.1 and 3.2.

He wants to define a measure on an infinite-dimensional space. This is a space of sequences. So let ##\mathbb{R}^\mathbb{N}## by definition all the sequences in ##\mathbb{R}##, we want to define integrals of functions ##\mathbb{R}^\mathbb{N}\rightarrow \mathbb{R}##.
 
  • #8
Are all the sequences in ##\mathbb{R}## "filling" ##\mathbb{R}^N## so to speak? It seems then that if you preclude certain classes of sequences (because they mess up your measure), then you are leaving "holes" in ##\mathbb{R}^N## or some such?
 
  • #9
Matterwave said:
Are all the sequences in ##\mathbb{R}## "filling" ##\mathbb{R}^N## so to speak? It seems then that if you preclude certain classes of sequences (because they mess up your measure), then you are leaving "holes" in ##\mathbb{R}^N## or some such?

Yes, you won't get a measure on entire ##\mathbb{R}^\mathbb{N}##. But I do think that he ends up with a measure on ##\ell^2##, which is also a good thing. The space ##\ell^2## is actually complete, so there are no holes. The space ##\mathbb{R}^\mathbb{N}## is of course a lot larger, maybe too large.
 
  • #10
Hmmm, ok, thanks for the help! :)
 

Related to Characteristic functions and functionals

1. What is a characteristic function?

A characteristic function is a mathematical function that describes the probability distribution of a random variable. It is defined as the Fourier transform of the probability density function (PDF) of the variable. It has properties that make it useful in probability and statistics, such as being bounded between 0 and 1 and having a unique inverse.

2. What is a functional?

A functional is a mathematical function that takes another function as its input and returns a real-valued number as its output. In other words, it maps a function to a number. Functionals are commonly used in optimization problems and in the study of calculus of variations.

3. How are characteristic functions and functionals related?

Characteristic functions and functionals are related in that the characteristic function of a random variable can be seen as a special type of functional that maps the PDF of the variable to its probability distribution. This allows for the use of functionals in the analysis and manipulation of characteristic functions.

4. What are some applications of characteristic functions and functionals?

Characteristic functions and functionals have many applications in probability, statistics, and theoretical physics. They are used in the analysis of random processes, hypothesis testing, and estimation of parameters in statistical models. In theoretical physics, they are used in the study of quantum mechanics and quantum field theory.

5. How are characteristic functions and functionals calculated?

Characteristic functions and functionals can be calculated using mathematical techniques such as Fourier transforms and functional analysis. In some cases, they can also be derived analytically from the PDF of a random variable. In practice, numerical methods may be used to approximate these values when analytical solutions are not possible.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
758
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Calculus and Beyond Homework Help
Replies
14
Views
533
  • Set Theory, Logic, Probability, Statistics
Replies
27
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
2K
Back
Top