1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

A good book to introduce information theory?

  1. Sep 1, 2015 #1
    Hi all!

    I would like to learn the basics of information theory and want a good book to do so.

    My math level is that of a second year undergraduate physics student, but I don't mind if I have to struggle a bit through it.

    Thanks!
     
  2. jcsd
  3. Sep 1, 2015 #2

    vanhees71

    User Avatar
    Science Advisor
    2016 Award

    I only know physics books on statistical physics using the information-theoretical approach. My favorites are

    Amnon Katz. Principles of Statistical Mechanics. W. H. Freeman and Company, San Francisco and London, 1967.
    Arthur Hobson. Concepts in Statistical Mechanics. Gordon and Breach Science Publishers, 2 edition, 1987.
     
  4. Sep 3, 2015 #3

    jasonRF

    User Avatar
    Science Advisor
    Gold Member

    I am not an expert on this subject. But an easy and fun read on this topic is by Pierce:
    https://www.amazon.com/Introduction...1441330289&sr=8-1&keywords=pierce+information
    EDIT: I highly recommend Pierce.

    David MacKay has some notes and a related textbook online:
    http://www.inference.phy.cam.ac.uk/mackay/info-theory/course.html
    http://www.inference.phy.cam.ac.uk/mackay/itila/

    Shannon's original work may also be useful:
    http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6773024

    jason
     
  5. Sep 3, 2015 #4

    phinds

    User Avatar
    Gold Member
    2016 Award

    Shannon's original work, referenced by jason as the original Bell Labs paper, is also available in a paperback that is still in print 50+ years after having been written. It's "the Mathematical Theory of Communication" and is the seminal work in the field. You can get it used on Amazon for less than $20.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Have something to add?
Draft saved Draft deleted



Similar Discussions: A good book to introduce information theory?
Loading...