Can Four Parameters Really Model an Elephant?

  • Thread starter Thread starter Whirlwindx
  • Start date Start date
  • Tags Tags
    Parameters
Click For Summary
The saying highlights the issue of overfitting in mathematical modeling, suggesting that with enough parameters, any model can be made to fit any data, regardless of its validity. This is often criticized because models with excessive adjustable parameters can mislead researchers into believing they have a robust understanding of the data when they do not. The discussion emphasizes that a good model should have few parameters, ideally measurable independently, to ensure it accurately represents the underlying physics and can make reliable predictions. Ultimately, the point is to caution against the temptation to add parameters merely to achieve a better fit to existing data. Effective modeling should prioritize simplicity and predictive power over complexity.
Whirlwindx
Messages
1
Reaction score
0
There is a famous saying in physics: "With four parameters I can fit an elephant and with five I can make him wiggle his trunk."

Firstly, does anyone know who definitely said it?

Secondly, what exactly does it mean in Layman's terms? I have a rough idea, which goes as follows:

Researcher: I have a mathematical model, and with the parameters it has it fits the publishes data very well.

Supervisor: Your model fits the data. So what? With 4 parameters I can fit an elephant...
 
Physics news on Phys.org
There is a similar version: There is always a straight line that passes by three points.

All this means that accepting experimental errors, and/or statistical fluctuations you can always fit any rotten model to the experimental data (sometimes also rotten).

Better still, always introduce adjustable parameters in your model. This will help to fit experimental data.

If you have scruples you can always do a test like "Student test" or "\chi^2" that always remove all scruples.
 
mahalanobis.twoday.net/stories/264091/
 
lpfr said:
Better still, always introduce adjustable parameters in your model. This will help to fit experimental data.

Uh.. sarcasm? I think the point of the story is to mock the fact that if *any* model has "lots" of unknown parameters, those parameters can be adjusted to fit absolutely whatever data you already have (even data not corresponding to what the model was intended for). Hence, models with lots of adjustable parameters aren't very useful in either understanding the underlying physics or predicting future results; a good model has very few parameters (and preferably, even those can be independently measured rather than being arbitrarily adjusted), so at the very least, any good model can be proven false (no elephant would fit to a good model of a skateboard).
 
Quick question that I haven't been able to find the answer to. Greenhouse gasses both warm and cool the atmosphere by slowing heat loss to space. But what would happen without GHGs? I read that the earth would be colder (though still relatively warm), but why? Without GHGs the atmosphere would still be a similar mass and still warmed by conduction from the surface, yet without a means to radiate that heat to space. Why wouldn't the atmosphere accumulate heat over time, becoming warmer? How...
I am following someone on Youtube who has built a rocket shaped (4 proprllers) drone for the world speed record ... He was having problems with internal heat from electical control gear and battery inside the sealed rocket (about 1kw waste heat) Speed is 500km/hr , I suggested a 4mm hole in the tip of the nose and 8mm hole at rear which should alow sufficient air cooling .. I said this will increase thrust because the air exiting is hotter .. a bit similar to a ram jet ... was I correct...