Information theory Definition and 58 Threads

Let's suppose I have a speech signal with frequency content >300 Hz. I then add noise to this signal, that happens to be somewhere below 300 Hz. I then high-pass filter the signal (300+ Hz) and I have increased the mutual information and seemingly violated the data processing inequality. Can...

Right guys i am on my 3rd year at uni doing computer network management & design, i have passed everything apart from network design and I am having to take a resit. I don't understand information theory AT ALL. They went over it in class but made no sense, i also asked the tutor to...

need sum help please:) (information theory) Hello. I'm working on an information theory-related problem that involves doing a nasty sum. The problem is this: in a widget factory there is a conveyor belt with N widgets on it, and an unknown fraction \xi = a/N of them are defective. You...

Hi, Some Qs on information -- something rather new to me. I'm not quite sure what to do with these: Homework Statement a) Lack of information is defined as S_{info} = - \sum_{i} p_{i}log_{2}p_{i} (p_{i} is the probability of the outcome i). Calculate the entropy associated with the...

There are in fact many "information theories". Broadly speaking all of these actually define a notion of "information" in terms of a notion of "entropy". In fact, from a basic notion of "entropy", many of these theories define a "conditional entropy" and from this "information". The most...

Is information theory the crucible of astrophysics in the 21st century? The number and quality of cosmologically related IT papers in the past year is impressive. I am admittedly swayed by this approach. For example: arXiv:0708.2837 The Physics of Information Authors: F. Alexander Bais, J...

I have recently been studying Gregory Chaitin's "algorithmic information theory" for a school project. It describes the complexity of mathematical objects by the size of the smallest Turing machine program capable of computing them (in bits). It also defines a "random" object as one with an...

I have to choose between two classes because of a schedule conflict: CS 575, combinatorics and graph theory This course is taught by the chief undergraduate advisor and earlier I mentioned to him that I'd be taking the course. So politically it may be a good idea. The course says it...