Units of Computing Power: How Much for a 1cm^3 Cube?

Click For Summary
SUMMARY

The discussion centers on quantifying computing power in relation to physical systems, specifically how many units of computing power are required to simulate a 1cm³ cube of hot gas. The conversation references MIPS (Million Instructions Per Second) as a metric for measuring computing power and highlights the connection between information theory and thermodynamics. Key insights include the relationship between thermodynamic entropy and Shannon information, as discussed in the works of Jaynes and Landauer. The book "Decoding the Universe" is recommended for further exploration of these concepts.

PREREQUISITES
  • Understanding of MIPS (Million Instructions Per Second)
  • Familiarity with information theory and Shannon entropy
  • Basic knowledge of thermodynamics and entropy concepts
  • Awareness of Turing Machines and their relation to computation
NEXT STEPS
  • Research the relationship between thermodynamic entropy and Shannon information in detail
  • Explore the concept of maximum entropy thermodynamics
  • Study the implications of Landauer's principle on information processing
  • Read "Decoding the Universe" for insights on information and thermodynamics
USEFUL FOR

This discussion is beneficial for physicists, computer scientists, and anyone interested in the intersection of information theory and thermodynamics, particularly those exploring computational limits and simulations of physical systems.

aquaregia
Messages
21
Reaction score
0
I often hear about how solving some problem would require a computer "the size of the known universe", or something like that. Is there a "unit" of computing power?

How many units of this power would say a 1cm^3 cube of hot gas have? In other words assuming you wanted to simulate the actual atoms bouncing around, how many units would it take to simulate this perfectly?
 
Engineering news on Phys.org
aquaregia said:
I often hear about how solving some problem would require a computer "the size of the known universe", or something like that. Is there a "unit" of computing power?

How many units of this power would say a 1cm^3 cube of hot gas have? In other words assuming you wanted to simulate the actual atoms bouncing around, how many units would it take to simulate this perfectly?


I believe information theory deals with these theoretical limitations.

http://en.wikipedia.org/wiki/Information_entropy

From that article you can see there is a relationship between information processing and with the physical universe. Especially here:

"In fact, in the view of Jaynes (1957), thermodynamics should be seen as an application of Shannon's information theory: the thermodynamic entropy is interpreted as being an estimate of the amount of further Shannon information needed to define the detailed microscopic state of the system, that remains uncommunicated by a description solely in terms of the macroscopic variables of classical thermodynamics. For example, adding heat to a system increases its thermodynamic entropy because it increases the number of possible microscopic states that it could be in, thus making any complete state description longer. (See article: maximum entropy thermodynamics). Maxwell's demon can (hypothetically) reduce the thermodynamic entropy of a system by using information about the states of individual molecules; but, as Landauer (from 1961) and co-workers have shown, to function the demon himself must increase thermodynamic entropy in the process, by at least the amount of Shannon information he proposes to first acquire and store; and so the total entropy does not decrease (which resolves the paradox)."

I read a popular physics book, "decoding the universe" where the author is talking about how information and thermodynamic entropy are actually two forms of the same physical quantity, and that actually thermodynamic entropy is a special case of information entropy. It talks about the Turing Machine, and how it relates to thermodynamics. There is a definite limit on how the physical universe can represent and manipulate information, and it takes energy to do this.

I highly recommend reading this book if this topic interests you, although it won't give you detailed theory or equations to solve your particular question.
 

Similar threads

Replies
7
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 9 ·
Replies
9
Views
3K
Replies
14
Views
2K
  • · Replies 14 ·
Replies
14
Views
3K
Replies
29
Views
6K
  • · Replies 16 ·
Replies
16
Views
4K
Replies
4
Views
12K
  • · Replies 8 ·
Replies
8
Views
2K