How generalizable is simulation/model research?

  • Thread starter Simfish
  • Start date
  • Tags
    Research
In summary, the conversation delves into the topic of using models and simulations in research, specifically in the fields of astronomy and climate science. The speaker raises questions about the generalizability and trustworthiness of models in predicting future outcomes. They discuss the difference between math/analytical research and research based on testing hypotheses, and how models are a way to instantiate what math makes possible. However, models also have limitations due to our incomplete knowledge of the universe and the omission of unknown variables. The importance of running simulations and reconciling potential sources of error is emphasized. Overall, the conversation highlights the value and challenges of using models in research.
  • #1
Simfish
Gold Member
823
2
This is often something that gets on my mind. This, anyways, is generalizable to climate models and other models, but I've figured that I'll post this here since a lot of astronomy research is based on simulations/models these days.

By "generalizable", I usually have this question in mind: Will people still be using the model's results 50 years in the future?

With math/analytical research, there is usually only one true solution to the problem. So you know that what you're doing is real and generalizable to anything that needs it. At least you know that your solution is consistent with everything else. At the same time, though, math describes what's possible. What's realizable, of course, only forms a small subset of what's possible.

When you do research by testing hypotheses, you learn about the real world. And since it *is* the real world, it has to be consistent with everything else in the real world. Since everything in the real world is connected with *something*, it's thus generalizable almost by definition.

Models differ based on the assumptions you make and the parameters you set. In a sense, they're a way to instantiate what math makes possible. Yet, you still have so many unknowns. And the time evolution of the model is such that chaos eventually becomes inevitable. Here, most of your simulations will have outcomes that are far different from what will happen in the real world. You could publish papers on the outcomes of all sorts of random models - but in the end - will people trust the model's predictions? You can tweak the parameters in a way that it is consistent with things that have already happened. And if it matches prediction on many things, then people might be more inclined to trust it.

Of course, a robust simulation will give you many opportunities to tweak the parameters once you have more information about the real world. But is model-based research the type of research that's more likely (than other types of research) to be consigned to the trashbin after 50 years? Sure, you will predict some true things with models. But in the end, someone else will probably build a better model, and that model may be very different from your model. That being said, many models are based on physical formulas.
 
Last edited:
Astronomy news on Phys.org
  • #2
The problem with simulations is they omit unknown variables. This is a natural consequence of our incomplete knowledge of the universe. The value of simulations is they illuminate our ignorance. When simulations do not match observation, it speaks volumes. A simulation is a mathematical representation of theory. Observational divergence points either to a problem with theory, observational bias [error], or programming error in constructing the simulation. I can think of no way to ensure it is not a combination of all three potential sources of error. That is why we run them ad absurdium. Observational errors are, by nature, the most difficult to reconcile.
 
Last edited:

1. What is simulation/model research?

Simulation/model research is a scientific method that involves creating a simplified representation of a complex system or phenomenon in order to study it and make predictions about its behavior. This can be done using computer simulations or physical models.

2. How is simulation/model research used?

Simulation/model research is used in a variety of fields, including physics, engineering, biology, economics, and social sciences. It allows scientists to study systems that are too complex or difficult to observe directly, and to test hypotheses and make predictions about their behavior.

3. How generalizable is simulation/model research?

The generalizability of simulation/model research depends on the specific system being studied and the accuracy of the model or simulation. In some cases, the results may only be applicable to the specific conditions and parameters used in the study. However, in other cases, the results may be more broadly applicable and can inform our understanding of similar systems.

4. What are the limitations of simulation/model research?

One limitation of simulation/model research is that the accuracy of the results depends on the quality of the model or simulation. If the model does not accurately represent the real system, the results may not be reliable. Additionally, simulation/model research cannot account for all variables and factors that may affect the system, and therefore may not fully reflect real-world conditions.

5. How can simulation/model research be improved?

To improve the generalizability and reliability of simulation/model research, scientists can use multiple models or simulations to validate their results, and incorporate more real-world data and variables into their models. Additionally, ongoing testing and refinement of the models can help improve their accuracy and applicability.

Similar threads

  • Programming and Computer Science
Replies
4
Views
1K
Replies
34
Views
2K
Replies
85
Views
4K
Replies
1
Views
925
  • STEM Academic Advising
Replies
9
Views
2K
  • STEM Career Guidance
Replies
3
Views
1K
  • Mechanical Engineering
Replies
2
Views
1K
  • High Energy, Nuclear, Particle Physics
Replies
2
Views
1K
Replies
2
Views
73
Replies
4
Views
757
Back
Top