What is Information: Definition and 999 Discussions

Information can be thought of as the resolution of uncertainty; it answers the question of "What an entity is" and thus defines both its essence and the nature of its characteristics. The concept of information has different meanings in different contexts. Thus the concept becomes synonymous to notions of constraint, communication, control, data, form, education, knowledge, meaning, understanding, mental stimuli, pattern, perception, proposition, representation, and entropy.
Information is associated with data. The difference is that information resolves uncertainty. Data can represent redundant symbols, but approaches information through optimal data compression.
Information can be transmitted in time, via data storage, and space, via communication and telecommunication. Information is expressed either as the content of a message or through direct or indirect observation. That which is perceived can be construed as a message in its own right, and in that sense, information is always conveyed as the content of a message.
Information can be encoded into various forms for transmission and interpretation (for example, information may be encoded into a sequence of signs, or transmitted via a signal). It can also be encrypted for safe storage and communication.
The uncertainty of an event is measured by its probability of occurrence. Uncertainty is inversely proportional to the probability of occurrence. Information theory takes advantage of this fact by concluding that more uncertain events require more information to resolve their uncertainty. The bit is a typical unit of information. It is 'that which reduces uncertainty by half'. Other units such as the nat may be used. For example, the information encoded in one "fair" coin flip is log2(2/1) = 1 bit, and in two fair coin flips is log2(4/1) = 2 bits. A 2011 Science article estimated that 97% of technologically stored information was already in digital bits in 2007, and that the year 2002 was the beginning of the digital age for information storage (with digital storage capacity bypassing analog for the first time).

View More On Wikipedia.org
  1. I

    Programs Topics at the junction of AdS/CFT and quantum information

    I have been asked to draft a (informal) research proposal for a PhD thesis. I have some background in quantum information and my interests are leaning towards the AdS/CFT correspondence. I was wondering if you could suggest a few (preferably recent) theory papers at the junction of quantum...
  2. A

    Finding the partial derivative from the given information

    It seems that the way to combine the information given is z = f ( g ( (3r^3 - s^2), (re^s) ) ) we know that the multi-variable chain rule is (dz/dr) = (dz/dx)* dx/dr + (dz/dy)*dy/dr and (dz/ds) = (dz/dx)* dx/ds + (dz/dy)*dy/ds ---(Parentheses indicate partial derivative) other perhaps...
  3. mesa

    MSRE prompt supercriticality event, looking for information

    I am looking for information on a supposed prompt supercriticality event that occurred at ORNL while the MSRE reactor was running under Syd Ball. This incident was told to me by an engineer that is actively involved in reigniting interest in MSR based reactors. According to his summary, "Syd...
  4. S

    B Loss of information and Quantum Determinism

    Other than with black holes, are there any other natural ways that quantum information can be lost, and thus jeopardize quantum determinism?
  5. mertcan

    I AICc value derivation (Akaike information criteria for finite samples)

    Hi everyone, initially let me introduce a concept widely used in ARIMA in the following. $$AICc = AIC + \frac {2k^2+2k} {n-k-1}$$ where n denotes the sample size and k denotes the number of parameters. Thus, AICc is essentially AIC with an extra penalty term for the number of parameters. Note...
  6. S

    What sort of culling of visual information does the brain do?

    The brain receives a lot of visual information some of which is redundant visual information. I am imagining it like the brain receiving a 1000 pixel wide by 1000 tall image of a road. The brain has received 1,000,000 bits/pixels of information. I am assuming the brain doesn't need all that...
  7. mertcan

    I Bayesian Information Criterion Formula Proof

    Hi everyone, while I was digging arima model I saw that BIC value is given as $k*log(n)-2*log(L)$ where $L$ is the maximized value of likelihood function whereas $k$ is number of parameters. I have found the proof of AIC but no any clue about that. I wonder how it is derived. Could you help me...
  8. SolitaryMan

    Studying Fields related to Quantum Information

    I am a master student in theoretical physics from Italy and I would like to know more about fields related to "Quantum Information". I've been to some seminars and I think that these fields are very interesting, but I need to understand before applying for a PhD. What should I do?
  9. H

    A Irreversible processes. Heat equation, diffusion equation

    Both the heat equation and the diffusion equation describe processes which are irreversible, because the equations have an odd time derivative. But how can these equations describe the real world when we know that all processes in nature are reversible, information is always conserved? But these...
  10. Raschedian

    Information on Different Systems of Units and Measurements

    Hello everyone! I would like to ask a rather comprehensive question. I would appreciate it if you could help me with this. I have started reading a chemistry textbook recently and typically in the first chapter of any basic chemistry course, you come across, measurement, unit conversion, etc...
  11. hagopbul

    About some information on research funding

    Hello all: I need to ask this rocky question, if you want some funding for a research project and you are outside academic sphere currently , how to get it ? Where to apply ? And how to find team member, considering the project is a short one ? What about patents ? Best H
  12. entropy1

    B Is the Universe information?

    Is the problem with interpretations of quantum mechanics that one can describe the universe consisting of "stuff" that exists ontologically in different but conflicting ways, so that the universe can really only be described informationally instead of ontologically? That is: does the universe...
  13. F

    I Why does information need probability?

    I have only recently started studying information theory and I am stuck even trying to understand the basic problem and concept of information theory. My question is why does information need a probability? I have read some text that starts by introducing the idea that the amount of information...
  14. nomadreid

    I Uncertainty: balance of two aspects?

    There are two aspects of uncertainty (a) how far different from the situation where all possibilities are of equal probability (b) how spread out the values are. In discussions about (Shannon) entropy and information, the first aspect is emphasized, whereas in discussions about the standard...
  15. S

    I Information Paradox in Black Holes and BSM

    If they could solve the information loss paradox in black hole https://en.wikipedia.org/wiki/Black_hole_information_paradox What other related problems it could solve in Beyond Standard Models or unsolved quantum questions, etc.? If the LHC could no longer detect new particles, could beyond...
  16. D

    Is Time a Form of Information Transfer Between Particles?

    More specfically can time be defined as information being passed from particle to particle?
  17. ImTrashAtPhysics

    How to use extra information in physics exams

    Hi all, I don’t know if posts like this are allowed and if not mods please remove but I am currently enrolled in Gen Physics 1 w/Calc(I don't know why I challenged myself with this class when normal Physics 1 would’ve worked for me as a biochem major) and am struggling to do understand the...
  18. O

    Studying Integrated information theory requirements

    Hi, I’m interested in self studying so that I can learn / understand integrated information theory about counciousness. I was wondering if anyone could help me identify what courses (I’m looking at using MIT’s opencourseware to study although just types of math is all that is needed) I would...
  19. D

    Peukerts Law Based on Manufacturer Information

    So I have been trying to derive peukerts exponent based on assumptions I know this won't be accurate but I am curious about the data. So I don't know the time to discharge the battery so I guessed 3 Hours the capacity at a 20 hour rate is 40Ah meaning the manufacturer rated discharge current was...
  20. S

    A Could information in a boundary be modified once encoded?

    Could information in a boundary be modified once encoded in holographic principle?There are models of universes where holographic principle has a different correspondence (there is absolutely no reason to assume that this would hold true for all possible universes. You could have a universe...
  21. H

    A Using atoms for information storage

    If this is not in the correct area please move it as I am not sure. Also the same with the prefix. I have searched this on the forum and could not find anything relating to it. https://phys.org/news/2018-09-scientists-mechanism-storage-atom.html
  22. H

    A Information and successive measurments

    Suppose you measure the spin of an electron along some axis, we get the result +1 with probability 0.5 and -1 with probability 0.5. The average information we receive is 1 bit of information. Now if we rotate our apparatus 90 degrees and make a new measurement, we will as before get the value +1...
  23. S

    I Can Black Holes Store More Information Than We Think?

    I have a question about black holes. So imagine that we start putting energy in some region of space, until we reach Schwarzschild radius. We also reach the maximum amount of information we can store in that region of space. Still, the energy continues to collapse in smaller and smaller space...
  24. G

    Inertial loads -- Sources of information needed

    I'm working with Aerodesign, and I want to study "Inertial loads" but I can't find books about the subject, do you know any? thank you
  25. M

    B Quantum Entanglement: Hidden Information vs. Time

    So let me preface this by saving, I am a computer programmer, not a physicist, and the main reason I became interested in quantum mechanics has a lot to do with the recent developments in quantum computing and quantum entanglement in general, although I do have a lot of curiosity about the inner...
  26. P

    Classically communicate information faster then light?

    Where in this though-experiment do I get it wrong? Even though no mass can travel faster then c, maybe information can? And I'm not talking about quantum entanglement etc. Consider a pipe, filled with balls that are very tightly arranged. If I push the outermost ball on one side of the pipe...
  27. C

    B In night vision equipment, how does 'information' transfer?

    So I read a couple of explanations of how night-vision equipment works. Unfortunately I don't remember the sources but my recollection/understanding is that infrared light is converted into electrons and then into visible light. So my question is how does the information by which I mean (the...
  28. W

    If entropy increases, where does the information come from?

    For ex. if two particles close to each other require n bits of info to describe them, why does it take n bits to describe them when they are far apart? Shouldn't the information content be the same for the macrosystem?
  29. W

    I How many bits or bytes of information are present in 1 atom

    My guess is the number is huge,but I don't know what transformations from the hip Iwould use to figure this out.
  30. Josh S

    I Do we "lose" information when viewing objects at a distance?

    Hey Everyone! So disclaimer, I'm not involved with physics professionally or educationally, it's just a hobby I like to think about, so please excuse my ignorance :). Anyway, I had a thought, and I was wondering if you guys could elucidate it. Imagine that we have a hypothetical telescope...
  31. anorlunda

    Insights How to Better Define Information in Physics - Comments

    Greg Bernhardt submitted a new PF Insights post How to Better Define Information in Physics Continue reading the Original PF Insights Post.
  32. MichPod

    I Is information lost in wavefunction collapse?

    Having in mind the idea that "information is not lost" (referring to the black hole information paradox), is not the same rule violated in the wave function collapse? I.e. during the decoherence process information is not lost as this process of entanglement of some object with its environment...
  33. J

    A Mutual information of a noisy function

    So let suppose I have a random variable Y that is defined as follows: $$Y=\alpha x+ \mathcal{N}(\mu,\sigma) \text{ where } x \text{ } \epsilon \text{ }\mathbb {R}$$ and $$\mathcal{N}(\mu,\sigma)\text{ is a i.i.d. normally distributed random variable with mean }\mu\text{ and variance }\sigma$$ So...
  34. Luke Tan

    I Transfer of information via a rigid body?

    Let's say I have a ball 299792458m away and i want to apply a force to it. Evidently any information (for eg if i instantaneously increase my mass to increase the gravitational force) will travel at the speed of light and thus, the increase in gravitational force will only be felt by the ball 1...
  35. TheQuestionGuy14

    B Do Black Holes Destroy Information?

    Stephen Hawking proposed that black holes will eventually evaporate due to Hawking radiation, thus all information eaten by the black hole is destroyed. This violates basic physics, and hawking soon recanted his views, but there is still no real answer to whether they do or don't destroy...
  36. seanthinks

    Programs Math Major interested in Quantum Information Science

    I'm a math major interested in the field of quantum information science and quantum computing, but I'm unclear on what path to take to explore the field. The field is presented as being at the intersection of physics, computer science, and mathematics but it seems that a majority of the experts...
  37. Danny Boy

    A Information of system vs system, apparatus and environment

    Suppose we have a quantum system ##Q## with an initial state ##\rho^{(Q)}##. The measurement process will involve two additional quantum systems: an apparatus system ##A## and an environment system ##E##. We suppose that the system ##Q## is initially prepared in the state ##\rho_{k}^{(Q)}## with...
  38. Van Ladmon

    Information loss when taking the dot product of vector equations

    Homework Statement Is the following conclusion correct? Assume there's an equation with vectors on both sides. Taking the dot product of this equation with vectors on both sides loses information, but information will not lose when taking dot products with higher rank tensors on both sides...
  39. S

    A Information encoding in the Holographic principle

    Can whatever type of information be encoded in a boundary in holographic principle? in a question some years ago regarding holography (https://physics.stackexchange.com/questions/75436/are-stokes-theorem-and-gausss-theorem-examples-of-the-holographic-principle) It is said that AdS/CFT is the...
  40. Danny Boy

    A Defining Krauss operators with normal distribution

    I am interested in defining Krauss operators which allow you to define quantum measurements peaked at some basis state. To this end I am considering the Normal Distribution. Consider a finite set of basis states ##\{ |x \rangle\}_x## and a set of quantum measurement operators of the form $$A_C =...
  41. O

    Nearly Perfect Efficiency - 2nd Law of Thermodynamics

    Recently read this article on Physorg: https://phys.org/news/2018-01-efficiency.html My questions are: 1. If "converting" information into energy requires a system (the demon I suppose) having a photodiode, processor, laser (light trap) all expending energy in order to cause the conversion...
  42. Danny Boy

    A Von Neumann Entropy of a joint state

    Definition 1 The von Neumann entropy of a density matrix is given by $$S(\rho) := - Tr[\rho ln \rho] = H[\lambda (\rho)] $$ where ##H[\lambda (\rho)]## is the Shannon entropy of the set of probabilities ##\lambda (\rho)## (which are eigenvalues of the density operator ##\rho##). Definition 2 If...
  43. ExplosivePete

    Physics Is quantum information research well funded?

    I am applying to phd programs in physics right now. I am interested in doing research in quantum information science. I see there is a lot of interest and funding for quantum information science right now, but does anyone have any advice on whether or not this research will be well funded in the...
  44. J

    Good Online Database for EE Research information

    Hello All, To better qualify my question, I'm interested in finding a good online database, similar to SciFinder (which is a great resource for Chemistry researchers and engineers), but specifically aimed at EEs. With SciFinder, you can search for various topics in chemistry and it will scour...
  45. mertcan

    A Akaike information small sample AICc

    hi, initially I am aware that AICc value is $$ -2(*log-likelihood)+2K+2K*(K+1)/(n-K-1)$$ where n is sample size and K is number of model parameters. But I really do not know how last term of right hand side is added, also AIC value is $$ -2*(log-likelihood)+2K$$ , so AICc has some correction in...
  46. K

    A A question about the information loss paradox

    In the information loss paradox, people say that in quantum mechanics , time evolution is unitary. They usually do not say anything about the measurement process of if they do, they briefly say that the measurement process does not violate unitarity either if one takes into account the...
  47. S

    I What is the Conservation of Information in Quantum Mechanics?

    Hi everyone, I was watching Susskinsd's lectures posted on youtube about Quantum mechanics and he started explaining his -1st basic law of physics saying: the conservation of information means basically that if you start with 2 quantum states (vectors) which are observably different, or...
  48. S

    Relativity's role in forbidding FTL Information Transfer

    Imagine a (purely hypothetical) situation where someone proposes a scheme that exploits non-classical, nonlocal interference effects to transfer information between Alice and Bob. Apart from the accuracy and plausibility of the quantum mechanical part of the paper, would it be necessary for the...
  49. A

    B Black hole information paradox and determinism

    Hello, layman here, I have a simple question, could you please clear this up for me? Whenever I read about the information paradox, it always appears to me that it is automatically assumed that quantum fluctuations / virtual particle pairs are predictably random. Which leads to the loss of...
  50. D

    I How can information possibly be created?

    Isnt the creation of information the same as the creation of mass, or energy, in other words, not possIble? If I am an electron and at time =0 , my position and velocity are x y z and p q r, how can i have gained information when my position and velocity at time T are x2 y2 z2 and p2 r2 q2? My...
Back
Top