Register to reply

Mutual information. concave/convex

by PetitPrince
Tags: concave or convex, information, mutual
Share this thread:
Nov20-11, 09:17 AM
P: 1
hi everybody,

while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x).

the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i didn't get how they can conclude the convexity of I(x,y) as a function of p(x|y) from the convexity of the relative entropy D(p||q).

here is a piece of the proof i didnt understand

if you have any idea, i'd very much appreciate it.

thank you in advance.
Phys.Org News Partner Science news on
Experts defend operational earthquake forecasting, counter critiques
EU urged to convert TV frequencies to mobile broadband
Sierra Nevada freshwater runoff could drop 26 percent by 2100

Register to reply

Related Discussions
Optics problem: concave or convex Introductory Physics Homework 1
Concave & convex bridges.. General Physics 1
Convex and Concave Lens Introductory Physics Homework 3
Concave mirror vs. Convex Introductory Physics Homework 1
Convex & Concave Problems Introductory Physics Homework 9