To give you some feeling of what's going on I can try to elaborate on what peteratcam and others have said. The analogy with statistical analysis is a very good one and goes a long way in understanding how things work.
Let's say you have a set \mathbf{x}=(x_1,x_2,..,x_n)^T of statistical...