Variation Distance: Explaining Finite Cases

  • Context: Graduate 
  • Thread starter Thread starter boboYO
  • Start date Start date
  • Tags Tags
    Variation
Click For Summary

Discussion Overview

The discussion revolves around the concept of total variation distance of probability measures, specifically in finite cases. Participants explore the equivalence between two formulations of this distance and seek clarification on their implications.

Discussion Character

  • Technical explanation, Conceptual clarification, Debate/contested

Main Points Raised

  • One participant presents a counterexample to the claim that the maximum difference and the half-sum of differences are equivalent in all cases.
  • Another participant suggests that the term "equivalent" may refer to the same topology being defined by both metrics on the set of probability measures.
  • A third participant agrees with the previous point, clarifying that "equivalent" indicates that the metrics yield the same results across probability measures, rather than being numerically equal.

Areas of Agreement / Disagreement

Participants express differing interpretations of the term "equivalent" in the context of the metrics, indicating that there is no consensus on the precise meaning or implications of the equivalence.

Contextual Notes

The discussion highlights potential misunderstandings regarding the definitions and implications of the metrics involved, as well as the conditions under which they may be considered equivalent.

boboYO
Messages
106
Reaction score
0
I was doing some reading and I came across this:

http://en.wikipedia.org/wiki/Total_variation_distance_of_probability_measures

So apparently for the finite case,

\max_{x} ( \left| P(x) - Q(x) \right|)\quad \mbox{ is equivalent to}\quad \frac{1}{2} \sum_x {\left| P(x)-Q(x)\right|}


but isn't this is a counterexample?
Code:
x         1        2        3        4
P(x)    0.25     0.25     0.25      0.25

Q(x)    0.10     0.20     0.35      0.35

|P-Q|   0.15     0.05     0.10      0.10

sum(|P-Q|)/2= 0.2

max(|P-Q|)=0.15



So I was thinking, maybe they meant 'equivalent' in a different sense? Could somebody please explain?
 
Physics news on Phys.org
I believe they might mean that those two metrics define the same topology on the set of probability measures.
 
Rochfor1 is correct. "Equivalent" simply means that they will give the same results in any probability measures, not that they are equal.
 
Thanks guys.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 3 ·
Replies
3
Views
3K