New Reply

mutual information. concave/convex

 
Share Thread Thread Tools
Nov20-11, 09:17 AM   #1
 

mutual information. concave/convex


hi everybody,

while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x).

the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i didn't get how they can conclude the convexity of I(x,y) as a function of p(x|y) from the convexity of the relative entropy D(p||q).

here is a piece of the proof i didnt understand
http://ocw.usu.edu/Electrical_and_Co...y/lecture3.pdf

if you have any idea, i'd very much appreciate it.

thank you in advance.
 
PhysOrg.com
PhysOrg
science news on PhysOrg.com

>> Hong Kong launches first electric taxis
>> Morocco to harness the wind in energy hunt
>> Galaxy's Ring of Fire
New Reply
Thread Tools


Similar Threads for: mutual information. concave/convex
Thread Forum Replies
Optics problem: concave or convex Introductory Physics Homework 1
concave & convex bridges.. General Physics 1
Convex and Concave Lens Introductory Physics Homework 3
Concave mirror vs. Convex Introductory Physics Homework 1
Convex & Concave Problems Introductory Physics Homework 9