mutual information. concave/convex


by PetitPrince
Tags: concave or convex, information, mutual
PetitPrince
PetitPrince is offline
#1
Nov20-11, 09:17 AM
P: 1
hi everybody,

while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x).

the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i didn't get how they can conclude the convexity of I(x,y) as a function of p(x|y) from the convexity of the relative entropy D(p||q).

here is a piece of the proof i didnt understand
http://ocw.usu.edu/Electrical_and_Co...y/lecture3.pdf

if you have any idea, i'd very much appreciate it.

thank you in advance.
Phys.Org News Partner Science news on Phys.org
SensaBubble: It's a bubble, but not as we know it (w/ video)
The hemihelix: Scientists discover a new shape using rubber bands (w/ video)
Microbes provide insights into evolution of human language

Register to reply

Related Discussions
Optics problem: concave or convex Introductory Physics Homework 1
concave & convex bridges.. General Physics 1
Convex and Concave Lens Introductory Physics Homework 3
Concave mirror vs. Convex Introductory Physics Homework 1
Convex & Concave Problems Introductory Physics Homework 9