1. Not finding help here? Sign up for a free 30min tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Help with entropy calculation (binary erasure channel)

  1. Mar 11, 2008 #1

    Simfish

    User Avatar
    Gold Member

    So in a binary erasure channel, the book says that H(Y) [of the output] = H((1-p)(1-a),a,p(1-a)) = H(a) + (1-a)H(p), where p = Pr (X=1) [rather than X = 0] and a is the probability that ANY input of X would be erased. the problem is, how do you get from H((1-p)(1-a),a,p(1-a)) = H(a) + (1-a)H(p),? there are 3 inputs to the entropy function and they're not independent (I think) so you can't just brute force the entropy algorithm. The main thing I'm confused about is how do you get (1-a)H(p), with the (1-a) term outside of the entropy term?
     
  2. jcsd
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Can you help with the solution or looking for help too?



Similar Discussions: Help with entropy calculation (binary erasure channel)
  1. Algebra help (Replies: 0)

  2. Project help (Replies: 0)

  3. Need help (Replies: 0)

Loading...