- #1
birulami
- 155
- 0
Hi,
not sure whether this is a good question.
How would I define the entropy of a tuple of N real numbers, each between zero and some fixed maximum value?
Of course I would expect the entropy to be minimal if they are all identical and maximal if they are all "completely random".
If [itex]v_i[/itex] are the values and [tex]M[/tex] is the allowed maximum, then
[itex]-\sum_i \frac{v_i}{M} \log(\frac{v_i}{M})[/itex]
would be my candidate. Any comments?
not sure whether this is a good question.
How would I define the entropy of a tuple of N real numbers, each between zero and some fixed maximum value?
Of course I would expect the entropy to be minimal if they are all identical and maximal if they are all "completely random".
If [itex]v_i[/itex] are the values and [tex]M[/tex] is the allowed maximum, then
[itex]-\sum_i \frac{v_i}{M} \log(\frac{v_i}{M})[/itex]
would be my candidate. Any comments?
Last edited: