Register to reply 
Infinite Distribution 
Share this thread: 
#1
Mar1714, 04:11 AM

P: 428

It seems to me that if we consider different methods of generating a distribution of an infinite number of samples of and unbounded real number then we get some distinct results.
1) If we randomly sample a value, then its probability must be nonzero, which is also true of any other value. 2) We pick a random value then iteratively increase and decrease this value by a finite, random amount. 3) We take repeated random samples, resulting infinite spacing. Obviously I'm not the first to think of this so my question is, what is the mathematical formalism for this? What do I look for to find out more? 


#2
Mar1714, 06:59 AM

Homework
Sci Advisor
HW Helper
Thanks
P: 13,067

Some observations:
1.1 a continuous distribution can still, in principle, get specific values. The probability of some exact value is 1 even though the probability of any particular exact value is zero. In realworld measurements, though, continuous distributions are more an idealization  you cannot cut arbitrarily fine. 1.2 a non zero probability of some value does not mean that any other values are non zero. Unless by "unbounded real number" you mean that the probabability density is nonzero for all values but then that would be a tautology. 2. As in a stochastic process? Random walks or brownian motion? 3. The number of samples does not dictate the spacing of the results. The resolution of the sampling process does that. Idealistically though, this would produce a sum of delta functions. The usual way to demonstrate a continuous random variable's probability density function if to take many samples in groups and construct a histogram. The more samples, the narrower the bars in the histogram can be. Keep this up and a smooth shape may emerge. This would be the "central limit theorem". So it looks to me like you want a text on stochastic processes maybe  or just an introductory stats book. 


#3
Mar1714, 08:57 AM

P: 428

Regarding your observations: 1.1) I understand your point but I don't think we can say the probability of sampling something that we have actually sampled is zero. If we have sampled it, there exists a chance however small that we could sample it again. It's infinitesmial, but nonzero. 1.2) Perhaps I should have specified that I'm talking about a situation where all values are possible and I'm just offering a symmetry argument, in that if one value has nonzero probability then all values have nonzero probability. 2) It just a sampling scheme to generate an infinite number of samples. I guess we can call it a unidirectional random walk in each direction. 3) I'm just saying that any 2 numbers randomly sampled from all real numbers will differ by an infinite amount. The whole concept of probability gets a bit sketchy, but I think I've avoided making an incorrect statement. I'm sure there exists a more formal treatment of this, I just don't know where to start looking for it. 


#4
Mar1714, 09:35 AM

P: 428

Infinite Distribution
I think I've found the answer.
Measure Theory seems to be what I'm looking for. 


#5
Mar1914, 10:19 PM

Homework
Sci Advisor
HW Helper
Thanks
P: 13,067

People trying to help you will be aware of many more possibilities than you are so you need to help narrow it down. While you have not specified any particular probability density distribution you are specifying what kind you are interested in. i.e. It is a probability density, it is continuous (because you wanted any real number value to be possible), and, it appears, that it is nonzero for all real number values. So you have pdf: ##p(x): x\in (\infty, \infty)## and $$P(a<x<b)=\int_a^b p(x)\;\text{d}x$$ That was pretty much what I was working from when I was trying to understand what you wanted. Since you insisted on a pdf as above, then the probability that x=a (some specific real number) is given by: $$P(x=a)=\int_a^a p(x)\;\text{d}x=0$$ In practice, a real life measurement always has some uncertainty  i.e. there are a range of possible values that will give the same measurement (eg. from rounding off). I know it seems logical that, if you got some value off a random sample, then there must be a nonzero probability of getting it again, but that is not how probability, or measurement, works. There is a nonzero probability of getting very close to that value  but the probability of getting exactly that value is zero. You may get so close to the initial value that your equipment is unable to tell the difference. This is where I started to think you may need some theory about how measurements happen rather than theories about how probability density functions may be set up or modelled. However  it is very unusual for a real measurement to be able to take on any real number value at all ... there is always some sort of restriction determined by the type of thing being measured. But you cannot deduce the type of distribution from a single measured value. Anyway  a random walk could be used to generate a single set of N>0 random numbers ... a single sample, size N ... as follows: let ##X = \{x_n\}## where each ##x_n=\sum_{i=1}^M s_i## is the result of m>0 random steps from the origin. The ith step size ##s\in \{s_i\}\sim \text{H}(1,1)## is distributed according to a top hat defined as: $$X\sim \text{H}(a,b) \implies p(x)=\begin{cases} \frac{1}{ba} &: a<x<b\\ 0 &: \text{else} \end{cases}$$ ... this would be a stochastic process. If you have two real numbers, then they must differ by a finite amount. It looks to me like you are shaky on the foundations of probability and statistics though  you are certainly writing as if you are not used to the topics  but that may be due to uncertainty about what you are asking about too. I wrote all that so you may have better luck with questions here in the future. Have fun ;) 


#6
Mar2014, 02:27 PM

Sci Advisor
P: 3,314

Your terminology is confusing. By "an infinite distribution of samples", you may be referring to a probability distribution over an infinite number of values, each of which represents a possible realization ("sample value") of a random variable X. Measure theory side steps questions about actually taking random samples. The results from measure theory (and sophisticated statements of probability theory) don't assert that you can actually take random samples. They always say things like "If we take..." or "If we have.." or "Let S be a random sample...". There is no explicit assumption that you can actually take a random sample that has a precise value  such as taking a random sample from a normal distribution with mean 0 and variance 1. The results and definitions only tell you what happens if you could take such a sample. The study of how to approximate taking a random sample from a continuous probability distribution using computer algorithms falls under the heading of "numerical analysis", which is a fairly practical sort of mathematics  as opposed to measure theory, which is abstract. The assumption that you have a random sample from a continuous distribution such as a normal distribution assumes than an event with probability 0 has occurred. This makes a distinction between an event with 0 probability versus what is called in common speech "an impossible event". For measure theory, this is not a paradox because measure theory doesn't study the physical possibility or impossibility of events. There are no definitions or theorems in measure theory that say anything about physical impossibility. Since measure theory makes no comment on physical impossibility, interpreting a statement from measure theory as a statement about certainty or impossibility in the physical world depends on a person's beliefs and tastes. 


Register to reply 
Related Discussions  
Biased distribution on semiinfinite axis  Set Theory, Logic, Probability, Statistics  1  
Charge Distribution in an infinite plate  Calculus & Beyond Homework  13  
Properties of a distribution function at infinite  Advanced Physics Homework  1  
Gauss law and infinite spherical charge distribution  Introductory Physics Homework  9  
Gauss law and infinite spherical charge distribution  Introductory Physics Homework  0 