Classical definition of probability & kolmogorovs axioms

In summary: However, in the last few decades both approaches have been seen as complementary and have been integrated into various fields such as machine learning and genetic algorithms.In summary, Bayes' theorem shows that two probability measures can be consistent with each other, even though they differ from the classical definition.
  • #1
macca1994
19
0
I've seen in some probability theory books that the classical definition of probability is a probability measure, it seems fairly trivial but what is the proof for this? Wikipedia gives a very brief one using cardinality of sets. Is there any other way?
 
Physics news on Phys.org
  • #2
There is no proof. It's a definition. Definitions never have proofs. The only thing you can ask is why this definition is the right one and why it encapsulates our naive understanding of probability. To answer this question, you need to work out some examples of probability spaces. For example, take two dice and throw them. Describe the probability space and see if the theory matches the experiment.
 
  • #3
One is Kolmogorov's axiomatic approach, as you mentioned in the title. Another is Baye's conditional approach...which is a different measure than the classical one.
 
  • #4
oh okay, so you prove that it obeys the axioms by kolmogorov?
 
  • #5
macca1994 said:
oh okay, so you prove that it obeys the axioms by kolmogorov?
Which one? Classical defn.? The answer is no, these two are different measures.
 
  • #6
macca1994 said:
oh okay, so you prove that it obeys the axioms by kolmogorov?


Using fairly basic set theory principals and Kolmogorov's 3 basic axioms you can prove/create more postulates (much like the Euclidian approach to geometry). Then from there you can show how and why things in classical probability work the way they do. You can also state Bayes laws in terms of Kolomogorov axioms.

-Dave K
 
  • #7
macca1994 said:
what is the proof for this? Wikipedia gives a very brief one using cardinality of sets.

I doubt it. As micromass said, definitions don't have proofs. A definition is not a theorem. Perhaps what you saw in the Wikipedia was a demonstration that the cardinality function on finite sets statisfies the definition of a measure. Such a demonstration is an example of a measure, not a proof of the definition of a measure. (When a mathematical definition for something is invented it is reassuring to demonstrate that at least one example of the thing exists. Such a demonstration does not make the definition "true". It only indicates that it is not futile to study the thing that is defined.)
 
  • #8
ssd said:
One is Kolmogorov's axiomatic approach, as you mentioned in the title. Another is Baye's conditional approach...which is a different measure than the classical one.
Bayes' (not Baye's) theorem is consistent with Kolmogorov's axiomatization of probability. It derives from Kolmogorov's axioms.

Yes, there is a dispute between frequentists and Bayesianists over the meaning and validity of prior probabilities, but that's a debate over interpretations of probability, not over fundamentals.
 
  • #9
D H said:
Bayes' (not Baye's) ...

Right. Thanks.

What I really intended to mean is, through Bayes' approach we (first) had the taste of having a different probability measure than the classical approach. More than a century later we again had another probability measure due to Kolmogorov, differing from the classical one. Historically, Bayes' stood alone for many years fighting(!) with the classical.
 
Last edited:

1. What is the classical definition of probability?

The classical definition of probability is a statistical theory that states that the probability of an event is equal to the number of favorable outcomes divided by the total number of possible outcomes. In other words, it assumes that all outcomes are equally likely to occur.

2. Who developed the classical definition of probability?

The classical definition of probability was developed by mathematician and physicist Blaise Pascal in the 17th century. It was later refined by mathematician Pierre-Simon Laplace in the 18th century.

3. What are Kolmogorov's axioms?

Kolmogorov's axioms are a set of three mathematical rules that form the foundation of modern probability theory. They state that probabilities must be non-negative, the probability of the entire sample space must be equal to 1, and the probability of the union of two disjoint events is equal to the sum of their individual probabilities.

4. How does the classical definition of probability differ from other definitions?

The classical definition of probability is based on the assumption that all outcomes are equally likely, while other definitions, such as the frequentist and subjective definitions, take into account factors such as past occurrences and personal beliefs. Additionally, the classical definition only applies to simple events, while other definitions can handle more complex events.

5. What are some limitations of the classical definition of probability?

The classical definition of probability has several limitations, including the fact that it relies on the assumption of equally likely outcomes, which may not always be true in real-world situations. It also does not account for events with multiple outcomes or events that are dependent on each other. Additionally, it does not provide a way to handle events with infinite outcomes.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
11
Views
478
  • Set Theory, Logic, Probability, Statistics
Replies
13
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
19
Views
2K
  • Set Theory, Logic, Probability, Statistics
2
Replies
57
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
311
  • Set Theory, Logic, Probability, Statistics
Replies
21
Views
2K
Back
Top