How is Information Measured and What Role Does Reducibility Play?

Thread starter precisionart
Start date May 4, 2012
Tags

Measure

AI Thread Summary

Information measurement can vary significantly based on the method used to quantify it. In the example of sending the symbol ∏ versus a string of digits like 3.14, the perceived information content can differ depending on the context and the information theory applied. Reducibility plays a crucial role, as it relates to how complex information can be simplified or compressed. Different measures of information, such as Shannon entropy or Kolmogorov complexity, can yield different values for the same messages, highlighting the subjective nature of information assessment.

May 4, 2012

precisionart

I am curious how information is measured. For example, if i send a message with the symbol ∏ to Bob and he replies with a string of digits 3.14... Does one message have more information than the other? How does reducibility factor in?

Computer science news on Phys.org

May 10, 2012

sru2

It depends on how you quantify information. By different measures, the value would change.

Thread 'The Human Cost of AI'

This week, I saw a documentary done by the French called Les sacrifiés de l'IA, which was presented by a Canadian show Enquête. If you understand French I recommend it. Very eye-opening. I found a similar documentary in English called The Human Cost of AI: Data workers in the Global South. There is also an interview with Milagros Miceli (appearing in both documentaries) on Youtube: I also found a powerpoint presentation by the economist Uma Rani (appearing in the French documentary), AI...

View full post »

Thread 'Poisoning an LLM'

https://techxplore.com/news/2025-10-size-doesnt-small-malicious-corrupt.html The researchers were able to poison an LLM with only 250 bad documents.

View full post »

Thread 'If you think having a backup is too expensive, try not having one'

https://www.datacenterdynamics.com/en/news/858tb-of-government-data-may-be-lost-for-good-after-south-korea-data-center-fire/ 858TB of government data may be lost for good after South Korea data center fire Destroyed drive wasn't backed up, officials say https://www.chosun.com/english/national-en/2025/10/02/FPWGFSXMLNCFPIEGWKZF3BOQ3M/ G drive as in GONE drive.

View full post »