What is Information: Definition and 999 Discussions

Information can be thought of as the resolution of uncertainty; it answers the question of "What an entity is" and thus defines both its essence and the nature of its characteristics. The concept of information has different meanings in different contexts. Thus the concept becomes synonymous to notions of constraint, communication, control, data, form, education, knowledge, meaning, understanding, mental stimuli, pattern, perception, proposition, representation, and entropy.
Information is associated with data. The difference is that information resolves uncertainty. Data can represent redundant symbols, but approaches information through optimal data compression.
Information can be transmitted in time, via data storage, and space, via communication and telecommunication. Information is expressed either as the content of a message or through direct or indirect observation. That which is perceived can be construed as a message in its own right, and in that sense, information is always conveyed as the content of a message.
Information can be encoded into various forms for transmission and interpretation (for example, information may be encoded into a sequence of signs, or transmitted via a signal). It can also be encrypted for safe storage and communication.
The uncertainty of an event is measured by its probability of occurrence. Uncertainty is inversely proportional to the probability of occurrence. Information theory takes advantage of this fact by concluding that more uncertain events require more information to resolve their uncertainty. The bit is a typical unit of information. It is 'that which reduces uncertainty by half'. Other units such as the nat may be used. For example, the information encoded in one "fair" coin flip is log2(2/1) = 1 bit, and in two fair coin flips is log2(4/1) = 2 bits. A 2011 Science article estimated that 97% of technologically stored information was already in digital bits in 2007, and that the year 2002 was the beginning of the digital age for information storage (with digital storage capacity bypassing analog for the first time).

View More On Wikipedia.org
  1. P

    Solving a collision question, is there enough information?

    See working attached. My problem is that I have come up with 3 equations but 4 unknowns (mq, up, vp, vq). Is this problem solvable? The answers say: a) 0.5 m/s b) 0.65 m/s and c) 0.34 m/s Many thanks
  2. K

    I Is this system a superposition?

    Suppose a blind man builds a machine that paints three apples with three colors, either red, blue or green. Once the machine has done this, are the three apples in the following superposition: or is the wavefunction just one of It feels like because the man is blind, the apples should be in...
  3. Arman777

    Mutual Information from this Gaussian Distribution

    Let us suppose we are given a Gaussian Distribution in the form of $$p(x,y) \propto exp(-\frac{1}{2}x^2 - \frac{1}{2}by^2 - cxy)$$ What are the equations that I need to use to obtain Mutual Information ?
  4. Lilian Sa

    A Looking for sources of information on Black Holes

    hey Im new here, I am a masters degree student. I woud ask about any good source for understanding black hole for a master's degree student. thanks
  5. bhobba

    COVID Medical Information On Brisbane Lockdown

    I originally posted in the general section that where I am in Brisbane we are now in lockdown. Further medical information has emerged on what is happening with 8 new cases overnight so I will post it here...
  6. Helena Wells

    I Discover SiGe Alloy: Energy Band Diagram & Info

    Where can I find information for the SiGe alloy?I know it exists and I know it is a semiconductor. How does the energy band diagram look like?
  7. AndreasC

    Other What are some good resources for learning about information theory?

    As I've been studying statistical mechanics as well as some other things, I keep hearing about "information theory". For instance, I've heard about information theory as it relates to entropy, regarding some theorems of statistical mechanics, and I even heard about it in a Carl Bender lecture...
  8. G

    I Hawking Radiation: Info vs Semanticity? - Hossenfelder

    In this video How we know that Einstein's General Relativity can't be quite right - YouTube , Hossenfelder says: "The [Hawking] radiation is entirely random and does not carry any information..." I have heard and read this from a number of other sources, and never understood. Completly random...
  9. Frabjous

    A Information Geometry: Is there any there there?

    Recently came across this concept. It looks like a combination of dg and statistics. It sounds interesting, but I do not feel competent enough to make an informed decision. For example see https://arxiv.org/abs/1808.08271
  10. danielhaish

    B Why can't energy or information go faster than light?

    as I read here http://www.bbc.com/earth/story/20160429-the-real-reasons-nothing-can-ever-go-faster-than-light#:~:text=But%20light%20is%20made%20up,when%20particles%20like%20electrons%20cannot%3F&text=The%20natural%20energy%20they%20possess,are%20already%20at%20top%20speed. things with mass...
  11. BWV

    Is information theory useful in biology?

    I only see it brought up in creationist attacks on evolution, definitely NOT trying to bring that up - curious if and how real biological science uses it. There are a couple of (expensive) older books and paywalled papers that seem legit, but cannot find much else for example...
  12. Sunny Singh

    I Information content of a qubit

    I have just started reading Neilson and chuang's book on quantum computing and two times already have they said that when a qubit is not observed, it can contain infinite information. "How much information is represented by a qubit? Paradoxically, there are an infinite number of points on the...
  13. A

    Evolution — information increase and entropy

    Not sure whether this is the right category but bear with me.I've seen graphics where the information increase with time of evolution is projected like the one in the link below from Carl Sagan's book https://www.researchgate.net/figure/Page-from-the-book-of-Carl-Sagan-21_fig2_322153131 Now I...
  14. H

    I Information diagram for entangled particles?

    Hi Pf I read that when two particles are maximally entangled , all the information is in the correlations between the particles. If we need 1 bit to describe one particles. Are two bits in the correlations? three particles may be entangled and then we need to considere 3 bits. As entanglement...
  15. D

    A Suggested reading for quantum information applications in QFT

    What would you say is essential reading for those of us who want to understand how exactly is QFT benefiting from QI? Can anyone give a summary of what is happening, and where to start reading? (at postgraduate/entry-research-level).
  16. notaphysicsmajor79

    Brain function & bipolar: fluid volume & speed of information in tubes

    This is a long post with limited amount of physics in it (but it is a physics question, so hopefully it is allowed). I am a scientist but trained as an ecologist (PhD) and despite my long interest in physics, my knowledge of it remains rather rudimentary. Apologies for that, in advance. I am...
  17. allisrelative

    B Is information the 5th state of matter?

    Recent Science headlines are abuzz about a new theory. Physicists claim information is the fifth state of matter. By 2245, half of Earth’s mass could be converted to digital bits https://www.zmescience.com/science/news-science/information-fifth-state-matter-0252/ Digital Information Threatens...
  18. kfjvj

    A How is physical Information "encoded"?

    I've been reading about the Holographic Principle, and this concept of information in physics came up. The idea that physical particles and interactions can be described in bits. But, how exactly would those bits work? Is this even a meaningful question? Could someone provide a concrete...
  19. allisrelative

    I Does Decoherence get rid of all Quantumness?

    The answer is no and even when decoherence occurs for Wigner's Friend in the lab, quantum coherence remains. Let's start with the paper that illustrates this. Assisted Macroscopic Quantumness CONT. https://arxiv.org/abs/1711.10498 Wow, I recently read this paper and the results are simply...
  20. W

    A Feature Selection, Information Gain and Information Entropy

    Sorry for being fuzzy here, I started reading a small paper and I am a bit confused. These are some loose notes without sources or refs. Say we start with a collection F of features we want to trim into a smaller set F' of features through information gain and entropy (where we are using the...
  21. scottdave

    Claude Shannon "The Bit Player" movie free screening

    This weekend (June 26-28) the IEEE Information Theory Society is showing a free screening of The Bit Player - a movie about Claude Shannon (the "father" of information theory) The website below has the link and password for Vimeo...
  22. C

    I Akaike Information Criterion Vs Likelihood Ratio Test

    Hello, I want to understand the difference between both goodness-of-fit tests, I would be glad if you could help me: Akaike Information criterion is defined as: ## AIC_i = - 2log( L_i ) + 2K_i ## Where ##L_i## is the likelihood function defined for distribution model ##i## . ##K_i## is the...
  23. J

    A Why is the quantum Fisher information useful in quantum metrology?

    I'm getting interested in quantum-enhanced metrology and have come across the quantum Fisher information (QFI) as a measure of how much a quantum state ##|\Psi(\theta)\rangle## changes with respect to some variable, for example, the phase accumulated during an interferometer, ##\theta##. This is...
  24. K

    A Quantum Information research frontier

    I want to pursue research in Quantum Information Theory. I am surveying research topics before applying for PhD in Physics. Can somebody please enlighten me on the latest broad research problems being pursued in Quantum Information?
  25. S

    Wigner's Friend and algorithmic information

    I'm working on a novel involving QM ideas. What I'm most excited about is the prospect of taking a view on Markus Muller's propositions involving reality and algorithmic information theory. I'm trying to make it work with the Wigner's Friend thought experiment. Are there any ideas on how...
  26. Z

    Python Displaying system information using psutil

    Hi, I am getting following error message: I have written the following code which should display the system information of a simple program which I am running as a function: import psutil import osclass Counting_SysInfo: def __init__(self, i): self.i = i def...
  27. S

    A Algorithmic information theory's QM view of reality

    Where can I learn more about this conception of reality?
  28. S

    I Understanding algorithmic information theory's reality

    Where and how could a layperson begin to understand algorithmic information theory and its proposed version of reality? I just read some "bits" (pun intended) about its strings of events and how it proposes algorithms can predicts how subjective timelines will continue, and I want to learn more!
  29. T

    The variation of the information content of a large Einstein solid

    For ##q >> N ##. ##\Omega \approx \left( \frac{eq}{N} \right)^N \text{ } (2)## (Schroeder, An introduction to thermal physics (2.21)). Can we argue that: ##\Delta I = - \Delta S \text{ } (3)?## How large can ##\Delta N##, be? Thank you for your time.
  30. G

    Programs Quantum Computation and Information Master's Degree

    I'm in a Physics BSc programme and I would like to delve into quantum computation and quantum information. There are two master's degree in Europe that I find interesting in particular: Quantum Engineering MSc at ETH Zurich and Applied Physics MSc at TU Delft (track in Quantum Devices and...
  31. entropy1

    I Does information get lost by measurement?

    If we consider quantum wavefunction-collapse, when we end up in a world-thread with a specific value of the measurement outcome, has information got lost?
  32. K

    I How is the information of a change in position of a star transmitted?

    Gravity is the curvature of space time. Stars move relative to each other. How is the information of this change transmitted through spacetime? I have just finished reading "Reality is not what it seems - The journey to quantum gravity" by Carlo Rovelli. (Can the content of a book be discussed...
  33. BillTre

    Why Information Grows: book review

    I recently read Cesar Hidalgo’s 2015 book: “Why Information Grows”, which I heard about recently on Sean Carroll’s podcast (I like it). It’s mostly an economics book that derives its main ideas from how information underlies organization in the universe, as well as in economic dynamics. I like...
  34. Z

    I Information in a light beam relative to the width of the beam?

    In the process of trying to understand holography I encountered a detail that I kind of knew before, but just now I realized I have no idea how it works, how is it even possible. I’m talking about a simple pinhole camera where supposedly no matter how tiny a hole is a beam of light would still...
  35. J

    B Can Info Travel FTL? Understanding Speed of Information

    Summary: Can the speed of information be faster than light? Say you had two people in space and they were 10 light years apart. Each person has a light bulb and battery connected to an electrical switch. Pressing the switch turns the light on, once it is released it springs back to the off...
  36. Arman777

    I What kind of information can we extract from this equation?

    In cosmology, we are using the Friedmann equations for the evolution of the universe. And we are using this equation a lot. $$\frac{H^2}{H_0^2} = \Omega_ma^{-3} + \Omega_{\Lambda} + \Omega_ra^{-4}$$ If we write ##a(t)## in terms of z, $$H(z) = H_0\sqrt{\Omega_m(1+z)^{3} + \Omega_{\Lambda} +...
  37. Quantum Alchemy

    I How does Classical Physics explain Quantum Entanglement?

    As a Computer Programmer, it's hard to wrap my head around Quantum Entanglement and non locality being explained in the context of Classical Physics. In other words, if the universe at it's core is physical where does Quantum Entanglement fit within a physical picture of reality? There's been...
  38. zonde

    I Can we copy information using reversible operations?

    I am trying to investigate my doubts that reversible operations can model (or at least mimic) information copy process. For simple model I take two numbers ##A \neq B##. Now I can't copy value of A into B without erasing (irreversibly) value of B. However I can use transformation that replaces...
  39. jackmiller2003

    I Time Delay Information Transfer with Entangled Particles

    Hello, my name is Jack and I'm a year 11 student in Australia. After listening to, and reading some information regarding quantum entanglement, I'm still a little unsure about the solution to a thought experiment: Let's say that I create a situation in which multiple pairs of particles are...
  40. Z

    File Header Size Information Required for Document Files

    Hi, I want to change the header of some document files like pdf, ms word, libre office programatically. I know that I have to use some byte type command like putc(..) and getc(). But I don't the header size of the above mentioned file formats.I saw a list of file format at wikipedia...
  41. N

    A Conservation of Quantum Information

    I can't seem to wrap my head around the notion of conservation of quantum information. One thing that might help that is if someone can tell me what the associated symmetry is. For example, phase symmetry leads to conservation of electric charge according to Noether's theorem; a fact that...
  42. jim mcnamara

    Information on Sulfur hexafluoride?

    Anybody know more about this? It is in DISCUSSION forums since I do not see any decent references on the subject. Maybe I'm having a bad day... ##SF_{6}## - Prevents fires from electrical shorts, used in high kVa distribution lines - at connection points, substations, and "ties" Apparently...
  43. W

    B Is information lost when a photon is absorbed?

    Suppose I fire a photon with an upward spin towards a hydrogen atom. It is absorbed by the hydrogen atom's electron which subsequently emits a photon when it returns to its ground state. I then fire another photon with a downward spin towards the same hydrogen atom and the same thing happens...
  44. cromata

    Quantum Quantum information recommendation

    I am 3rd year physics student (actually I have just finished it). I have good knowledge on basics of quantum mechanics: I had 1 semester of Introduction to Quantum Physics and then 2 semesters of Quantum Physics. Our literature were Griffiths (Introduction to Quantum Mechanics) and ''Gennaro...
  45. Creedence

    I Extracting Info from a Black Hole: Robert's Hypothetical Process

    I just wandering about the following hypotetical process to get some information from the inside of a black hole. 1. Drop a satellite into the black hole on a nearly tangential orbit. 2. After it crossed the event horizon drop a large mass after it (for example a small black hole). 3. This mass...
  46. anorlunda

    Animated Display of Quantitative Information

    I'm sure that many PF members are fans of the seminal book The Visual Display of Quantitative Information by Edward R. Tufte But books on dead trees can only show static information. How about quanitative information depicted with the help of audio and/or video? I would like to nominate...
  47. S

    I "It from Bit" and the multiverse?

    Did physicist John Archibald Wheeler propose the existence of multiple universes through his "It from Bit" or "Participatory Universe Principle" or "Law without Law and Pregeometry"? Is the multiverse related to Wheeler's ideas? I've been told that It can produce multiple universes, obviously...
  48. F

    A Forecast with Fisher formalism : loss or gain of information

    In the context of a forecast, I am currently working on Fisher's formalism which is part of a more general theory, that of information. My problem applies to estimating cosmological parameters from input data with the Fisher formalism and recipes to build a Fisher matrix. The context is...
  49. N

    Calculate the thermal diffusivity from minimal information

    So I started from the heat governing equation above. There is no heat generation or matter flow, so I simplified it to dT/dt = A d^(2)T/dx^(2). Now I assume dT/dt = (278.15K-277.38K)/(1200s-900s) = 0.0025667. But then I'm stuck with the d^(2)T/dx^(2). Is the x just 0.20 m? For T I used 288.15K...
Back
Top