Register to reply

Mutual information. concave/convex

by PetitPrince
Tags: concave or convex, information, mutual
Share this thread:
Nov20-11, 09:17 AM
P: 1
hi everybody,

while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x).

the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i didn't get how they can conclude the convexity of I(x,y) as a function of p(x|y) from the convexity of the relative entropy D(p||q).

here is a piece of the proof i didnt understand

if you have any idea, i'd very much appreciate it.

thank you in advance.
Phys.Org News Partner Science news on
Bees able to spot which flowers offer best rewards before landing
Classic Lewis Carroll character inspires new ecological model
When cooperation counts: Researchers find sperm benefit from grouping together in mice

Register to reply

Related Discussions
Optics problem: concave or convex Introductory Physics Homework 1
Concave & convex bridges.. General Physics 1
Convex and Concave Lens Introductory Physics Homework 3
Concave mirror vs. Convex Introductory Physics Homework 1
Convex & Concave Problems Introductory Physics Homework 9