I'm sure there are lots of way to define complexity in different

  • Thread starter Thread starter Cincinnatus
  • Start date Start date
  • Tags Tags
    Complexity
AI Thread Summary
Complexity can be defined in various contexts, including minimum description length, time complexity, and parameter complexity. Ideal compression is highlighted as a particularly useful definition, emphasizing independence from language richness. The distinction between compressing output samples and encoding the process itself is also noted. Additionally, space complexity is mentioned as a measure of the minimum space required for computation. The discussion briefly shifts to historical figures like Cincinnatus and Horatio, illustrating themes of heroism but ultimately remains focused on the definitions of complexity.
Cincinnatus
Messages
389
Reaction score
0
I'm sure there are lots of way to define complexity in different contexts. Some that I've heard of include:

-Minimum description length / Kolmogorov complexity
-time complexity - number of steps to compute
-parameter complexity - number of parameters needed to specify a model.

There are probably many more... Particularly, there must be some interesting information theoretic ways to talk about this. Does anyone here know about this?
 
Mathematics news on Phys.org
i love your handle. does everyone know that he was a roman citizen who accepted a high role in the government,perhaps senator or higher, did an outstanding job, and then simply returned to his farm? what a hero. unheard of today, unless maybe sam ervin counts, or jimmy carter.
 
I think ideal compression is the most useful definition. In ideal compression, you aren't dependent on the richness/versatility of the language used to describe the process. It should be noted, also, that there is a difference in compressing a sample of the output of a process, and encoding the process, itself.
 
Other than space complexity (what is the minimum amount of space needed to computer the answer, not including the input itself) I can't think of anything.

mathwonk said:
i love your handle. does everyone know that he was a roman citizen who accepted a high role in the government,perhaps senator or higher, did an outstanding job, and then simply returned to his farm? what a hero. unheard of today, unless maybe sam ervin counts, or jimmy carter.

I love Cincinnatus, he's one of my favorite ancient Roman heroes. Horatio (Gaius Horatius) is another; he's the quintessential man's man. He holds the way against hundreds of enemy soldiers while his men, from the other side of the bridge, take it down (at his command) to prevent them from sacking his city; when they collapsed the bridge Horatio, trapped on the wrong side and surrounded by hostiles, swims (in armor!) across to his own people. It was the "Superman" comic book of the early days of the Roman Republic.
 
Suppose ,instead of the usual x,y coordinate system with an I basis vector along the x -axis and a corresponding j basis vector along the y-axis we instead have a different pair of basis vectors ,call them e and f along their respective axes. I have seen that this is an important subject in maths My question is what physical applications does such a model apply to? I am asking here because I have devoted quite a lot of time in the past to understanding convectors and the dual...
Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
Back
Top