PDA

View Full Version : How probable are realizations of stochastic processes? (was: EEQT)


Arnold Neumaier
Aug24-04, 04:52 AM
<jabberwocky><div class="vbmenu_control"><a href="jabberwocky:;" onClick="newWindow=window.open('','usenetCode','toolbar=no, location=no,scrollbars=yes,resizable=yes,status=no ,width=650,height=400'); newWindow.document.write('<HTML><HEAD><TITLE>Usenet ASCII</TITLE></HEAD><BODY topmargin=0 leftmargin=0 BGCOLOR=#F1F1F1><table border=0 width=625><td bgcolor=midnightblue><font color=#F1F1F1>This Usenet message\'s original ASCII form: </font></td></tr><tr><td width=449><br><br><font face=courier><UL><PRE>Nick Maclaren wrote:\n&gt; In article &lt;4124B703.1090900@univie.ac.at&gt;,\n&gt; Arnold Neumaier &lt;Arnold.Neumaier@univie.ac.at&gt; writes:\n\n&gt; |&gt; &gt; Large ensembles will not help. They need to be infinite.\n&gt; |&gt;\n&gt; |&gt; Strictly speaking, yes. But in the approximations physicists are\n&gt; |&gt; generally working, this amounts to the same. In the limit of arbitrarily\n&gt; |&gt; large samples, the statistical uncertainty goes to zero, under reasonable\n&gt; |&gt; assumptions.\n&gt;\n&gt; Not necessarily. There are realistic problems where the law of\n&gt; large numbers does not apply.\n\nThat\'s why I had added the phrase \'under reasonable assumptions\',\nwhich excludes the situations you are talking about.\n\n\n&gt; |&gt; In a stochastic setting, _every_ realization of a stochastic process has\n&gt; |&gt; probability 0; exactly one of them actually happens - - - the certainty\n&gt; |&gt; status of a stochastic model for a single history seems comparatively\n&gt; |&gt; poor.\n&gt;\n&gt; Again, that is wrong. It doesn\'t apply to discrete measures, such\n&gt; as when the spin of an electron can be either up or down.\n\nThis is not a counterexample. Taking for simplicity the stochastic process\ndefined by independent flips of a fair coin, a realization is an infinite\nbinary sequence, and each of these has probability zero.\n\nThe case of spin is more difficult to analyze because as stated, it is\nnot a well-defined stochastic process. If it is taken as a continuous\nmeasurement, the flip is at random times, and so even a single flip at\na definite time has probability zero.\n\nIf it is taken as a discrete process, we need to specify a measuring\nprotocol that applies at definite, equidistant times. Then it is likely\nthat there are some correlations, and probabilities even of finite\npieces of a particular realization are hard to get by. Nevertheless,\nunder reasonably random circumstances (for example, when measuring spins\nof independent electrons), the probability of the most likely sequence\nof N measurements decreases exponentially with N, and the probability of\na complete realization (infinite sequence) is again zero.\n\n\nArnold Neumaier\n\n</UL></PRE></font></td></tr></table></BODY><HTML>');"> <IMG SRC=/images/buttons/ip.gif BORDER=0 ALIGN=CENTER ALT="View this Usenet post in original ASCII form">&nbsp;&nbsp;View this Usenet post in original ASCII form </a></div><P></jabberwocky>Nick Maclaren wrote:
> In article <4124B703.1090900@univie.ac.at>,
> Arnold Neumaier <Arnold.Neumaier@univie.ac.at> writes:

> |> > Large ensembles will not help. They need to be infinite.
> |>
> |> Strictly speaking, yes. But in the approximations physicists are
> |> generally working, this amounts to the same. In the limit of arbitrarily
> |> large samples, the statistical uncertainty goes to zero, under reasonable
> |> assumptions.
>
> Not necessarily. There are realistic problems where the law of
> large numbers does not apply.

That's why I had added the phrase 'under reasonable assumptions',
which excludes the situations you are talking about.


> |> In a stochastic setting, _every_ realization of a stochastic process has
> |> probability 0; exactly one of them actually happens - - - the certainty
> |> status of a stochastic model for a single history seems comparatively
> |> poor.
>
> Again, that is wrong. It doesn't apply to discrete measures, such
> as when the spin of an electron can be either up or down.

This is not a counterexample. Taking for simplicity the stochastic process
defined by independent flips of a fair coin, a realization is an infinite
binary sequence, and each of these has probability zero.

The case of spin is more difficult to analyze because as stated, it is
not a well-defined stochastic process. If it is taken as a continuous
measurement, the flip is at random times, and so even a single flip at
a definite time has probability zero.

If it is taken as a discrete process, we need to specify a measuring
protocol that applies at definite, equidistant times. Then it is likely
that there are some correlations, and probabilities even of finite
pieces of a particular realization are hard to get by. Nevertheless,
under reasonably random circumstances (for example, when measuring spins
of independent electrons), the probability of the most likely sequence
of N measurements decreases exponentially with N, and the probability of
a complete realization (infinite sequence) is again zero.


Arnold Neumaier

Nick Maclaren
Aug25-04, 02:42 AM
<jabberwocky><div class="vbmenu_control"><a href="jabberwocky:;" onClick="newWindow=window.open('','usenetCode','toolbar=no, location=no,scrollbars=yes,resizable=yes,status=no ,width=650,height=400'); newWindow.document.write('<HTML><HEAD><TITLE>Usenet ASCII</TITLE></HEAD><BODY topmargin=0 leftmargin=0 BGCOLOR=#F1F1F1><table border=0 width=625><td bgcolor=midnightblue><font color=#F1F1F1>This Usenet message\'s original ASCII form: </font></td></tr><tr><td width=449><br><br><font face=courier><UL><PRE>In article &lt;4125E601.5070604@univie.ac.at&gt;,\nArnold Neumaier &lt;Arnold.Neumaier@univie.ac.at&gt; writes:\n|&gt; &gt;\n|&gt; &gt; Not necessarily. There are realistic problems where the law of\n|&gt; &gt; large numbers does not apply.\n|&gt;\n|&gt; That\'s why I had added the phrase \'under reasonable assumptions\',\n|&gt; which excludes the situations you are talking about.\n\n"Under reasonable assumptions" can exclude widespread, realistic\nproblems? See another posting for examples.\n\n|&gt; This is not a counterexample. Taking for simplicity the stochastic process\n|&gt; defined by independent flips of a fair coin, a realization is an infinite\n|&gt; binary sequence, and each of these has probability zero.\n\nSorry - my fault. You were using the term "stochastic process"\nin its technical sense, and I did not realise. Yes, you are\ncorrect.\n\n|&gt; The case of spin is more difficult to analyze because as stated, it is\n|&gt; not a well-defined stochastic process. If it is taken as a continuous\n|&gt; measurement, the flip is at random times, and so even a single flip at\n|&gt; a definite time has probability zero.\n\nContinuous stochastic processes are a perfectly good mathematical\nmodel - Kolmogorov and other Russian probabilists have worked on\nthem. They are, however, so unspeakably evil to handle that most\npeople who know about them recoil in horror at the thought of\ntouching them and discretise the problem ....\n\nNo, I don\'t know anything more about them than that :-)\n\nThis is, however, relevant to quantum mechanics, where analysing\ninteractions over time is very close to continuous Markov theory\n(which is the model I am referring to). There be dragons. Or\nat least that is what I was told, a long while back. Whether\nthis accounts for any of the current issues is another matter,\nbut it is worth noting that the area is harder than it appears\n(even considered as pure mathematics).\n\n\nRegards,\nNick Maclaren.\n\n</UL></PRE></font></td></tr></table></BODY><HTML>');"> <IMG SRC=/images/buttons/ip.gif BORDER=0 ALIGN=CENTER ALT="View this Usenet post in original ASCII form">&nbsp;&nbsp;View this Usenet post in original ASCII form </a></div><P></jabberwocky>In article <4125E601.5070604@univie.ac.at>,
Arnold Neumaier <Arnold.Neumaier@univie.ac.at> writes:
|> >|> > Not necessarily. There are realistic problems where the law of
|> > large numbers does not apply.
|>
|> That's why I had added the phrase 'under reasonable assumptions',
|> which excludes the situations you are talking about.

"Under reasonable assumptions" can exclude widespread, realistic
problems? See another posting for examples.

|> This is not a counterexample. Taking for simplicity the stochastic process
|> defined by independent flips of a fair coin, a realization is an infinite
|> binary sequence, and each of these has probability zero.

Sorry - my fault. You were using the term "stochastic process"
in its technical sense, and I did not realise. Yes, you are
correct.

|> The case of spin is more difficult to analyze because as stated, it is
|> not a well-defined stochastic process. If it is taken as a continuous
|> measurement, the flip is at random times, and so even a single flip at
|> a definite time has probability zero.

Continuous stochastic processes are a perfectly good mathematical
model - Kolmogorov and other Russian probabilists have worked on
them. They are, however, so unspeakably evil to handle that most
people who know about them recoil in horror at the thought of
touching them and discretise the problem ....

No, I don't know anything more about them than that :-)

This is, however, relevant to quantum mechanics, where analysing
interactions over time is very close to continuous Markov theory
(which is the model I am referring to). There be dragons. Or
at least that is what I was told, a long while back. Whether
this accounts for any of the current issues is another matter,
but it is worth noting that the area is harder than it appears
(even considered as pure mathematics).


Regards,
Nick Maclaren.