1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

A good book to introduce information theory?

  1. Sep 1, 2015 #1
    Hi all!

    I would like to learn the basics of information theory and want a good book to do so.

    My math level is that of a second year undergraduate physics student, but I don't mind if I have to struggle a bit through it.

  2. jcsd
  3. Sep 1, 2015 #2


    User Avatar
    Science Advisor
    Gold Member
    2017 Award

    I only know physics books on statistical physics using the information-theoretical approach. My favorites are

    Amnon Katz. Principles of Statistical Mechanics. W. H. Freeman and Company, San Francisco and London, 1967.
    Arthur Hobson. Concepts in Statistical Mechanics. Gordon and Breach Science Publishers, 2 edition, 1987.
  4. Sep 3, 2015 #3


    User Avatar
    Science Advisor
    Gold Member

    I am not an expert on this subject. But an easy and fun read on this topic is by Pierce:
    EDIT: I highly recommend Pierce.

    David MacKay has some notes and a related textbook online:

    Shannon's original work may also be useful:

  5. Sep 3, 2015 #4


    User Avatar
    Gold Member

    Shannon's original work, referenced by jason as the original Bell Labs paper, is also available in a paperback that is still in print 50+ years after having been written. It's "the Mathematical Theory of Communication" and is the seminal work in the field. You can get it used on Amazon for less than $20.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Have something to add?
Draft saved Draft deleted