Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Overdetermined inversion

  1. Aug 3, 2006 #1
    i can perfom the same inversion in two ways:

    1. using N data and k model parameters

    2. using 3*N data and k+3 model parameters

    where N>>k.
    how can I choose the best result between the two?

  2. jcsd
  3. Aug 3, 2006 #2


    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    This is difficult to answer. There are some techniques which allow you to find out, statistically, whether adding another parameter does anything more than "fitting the noise" - I don't have any reference handy (~20 years ago, I did a master thesis on a very related subject but that's long ago...), sorry.

    However, you can also use your common sense. If you have way enough data, it should somehow be clear whether or not you get a big improvement in the fit when you add an extra parameter or not. Maybe some intuition about the model will tell you that too.
    It is only when you are a bit low on data, or with noisy data, and not sure about your model (like in black box techniques), that these issues come up.
    My former mechanics professor used to say: give me 12 parameters, and I give you an elephant. Give me one or two more, and I make his thrump sling about.
  4. Aug 3, 2006 #3
    thank you. I'm looking for some statistical parameter.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook