mutual information. concave/convex

by PetitPrince
Tags: concave or convex, information, mutual
PetitPrince is offline
Nov20-11, 09:17 AM
P: 1
hi everybody,

while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x).

the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i didn't get how they can conclude the convexity of I(x,y) as a function of p(x|y) from the convexity of the relative entropy D(p||q).

here is a piece of the proof i didnt understand

if you have any idea, i'd very much appreciate it.

thank you in advance.
Phys.Org News Partner Science news on
NASA's space station Robonaut finally getting legs
Free the seed: OSSI nurtures growing plants without patent barriers
Going nuts? Turkey looks to pistachios to heat new eco-city

Register to reply

Related Discussions
Optics problem: concave or convex Introductory Physics Homework 1
concave & convex bridges.. General Physics 1
Convex and Concave Lens Introductory Physics Homework 3
Concave mirror vs. Convex Introductory Physics Homework 1
Convex & Concave Problems Introductory Physics Homework 9