| New Reply |
mutual information. concave/convex |
Share Thread | Thread Tools |
| Nov20-11, 09:17 AM | #1 |
|
|
mutual information. concave/convex
hi everybody,
![]() while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x). the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i didn't get how they can conclude the convexity of I(x,y) as a function of p(x|y) from the convexity of the relative entropy D(p||q). here is a piece of the proof i didnt understand http://ocw.usu.edu/Electrical_and_Co...y/lecture3.pdf if you have any idea, i'd very much appreciate it. thank you in advance. |
| PhysOrg.com |
science news on PhysOrg.com >> Hong Kong launches first electric taxis >> Morocco to harness the wind in energy hunt >> Galaxy's Ring of Fire |
| New Reply |
| Thread Tools | |
Similar Threads for: mutual information. concave/convex
|
||||
| Thread | Forum | Replies | ||
| Optics problem: concave or convex | Introductory Physics Homework | 1 | ||
| concave & convex bridges.. | General Physics | 1 | ||
| Convex and Concave Lens | Introductory Physics Homework | 3 | ||
| Concave mirror vs. Convex | Introductory Physics Homework | 1 | ||
| Convex & Concave Problems | Introductory Physics Homework | 9 | ||