Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

What and why falsifiability?

  1. May 6, 2006 #1


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    This issue of falsifiability is interesting and should be discussed. But to discuss it calmly and peacefully we should separate it from the context of whether this or that scholarly paper succeeds in showing this or that theory to be falsifiable.

    We should have a general discussion of what makes a theory empirical, how and why theories are tested----questions like that: you define the issues and contribute your ideas on it.

    My take on it is this:

    The reason science has worked so well for the past 400 years is that there can be a coherent COMMUNITY of scientists who can hold different opinions but can eventually settle their differences by putting them to the test of experiment.

    Membership in any community involves MORAL OBLIGATIONS, the people in a community need to regulate behavior in such a way that the community can survive longterm and succeed in doing its thing.

    One primary moral obligation that theorists have is to ONLY PROPOSE THEORIES THAT ARE already in principle and within a reasonable time-frame in practice TESTABLE. This helps unite the science community because different factions can settle their differences peacefully by empirical trial in good faith.

    Except for math and tautologies, no statement in science can ever be proven CORRECT. There are no correct theories in empirical science. Because the next experiment could prove it wrong.

    All we have theories which have not been proven wrong YET---and we can be thankful we have those!

    If you disagree with any of this please post your alternative view.

    There is also a "good faith" assumption that scientists of good faith can agree on things like what is a reasonable waiting time and when the observations have refuted a theory.
    There may be stubborn ones who refuse to believe that their theory has been refuted or who interpret the data in totally eccentric ways, but hopefully that is a minority. the majority is assumed to be able to come to agreement on what is a valid test. The system is not utterly mechanical----it depends on human factors like trust, honesty, fairness, honor, respect for people with different opinions, willingness to change etc.----"good faith" factors.

    If theories proposed are not verifiable (and nothing is) then what is left for them to be be? Falsifiable. A theory can make a prediction that some definite thing will happen in an experiment that hasnt been done yet. If it is tried, and it doesn't, then the theory is dead.

    If theorists go around proposing unfalsifiable theories, then the community can get FRAGMENTED. differences of opinion arise that cannot be resolved empirically.

    things start to depend on RHETORIC, salesmanship, social pressure, brow-beating, economic pressure to conform, metaphysical prejudice, personality cults, semi-religious stuff, primate instinct. That's bad. It isn't science.

    So theorists have a moral obligation. They have a duty to the community to only make theories which have a built-in risk of self-destruction.
    A theory (to be good science) has to make some prediction about a future experiment which might, if it turns out wrong, cause the theory to be discarded.
    If a theory can accomodate any possible outcome of a not-yet-performed experiment, every outcome not already excluded theories we already have, then it doesnt predict anything new. It's too flexible and indescriminate---no predictive value. theorists have a duty to build a certain stiffness in so that there are some observations a theory balks at, and cannot accept. Then it's falsifiable

    the tricky thing here is that for this to work the theory must be falsifiable directly by observation


    This is OK:

    A is an observation
    F is that the theory is false
    A => F
    the observation proves the theory false

    This, I think, is not OK:

    A is an observation
    P is an unverifiable premise, some other statement
    F is that the theory is false
    A => (P => F)
    the observation does not prove the theory false.

    the observation proves the statement (P => F) that if the premise, which cannot be proven true, WERE true, then the theory would be shown to be false.

    ultimately this is about responsibility to the community so that it stays united and healthy
    so in practice we can fudge some and we can say that P is still OK if it is one of those comfortable Apple Pie Motherhood things that everybody accepts without even thinking about it.

    But suppose P besides being unverifiable is even something that half the people don't think is true anyway! Suppose P is something that a good scientist can reasonably be SKEPTICAL about?

    In that case it looks pretty obvious to me that falsifiability has not been shown.

    So anyone can put up a different scheme, and we can see how things sort out.

    I think what I am making a case for here is DIRECT FALSIFIABILITY FROM OBSERVATION

    not conditional on any doubtful and in principle unverifiable premise.

    in other words

    A => F

    And I am arguing that this is an obligation of the theorist, to make theories so they can be testable this way, and that this obligation has a PRAGMATIC REASON which is the health and success of the community.

    any comment?
    Last edited: May 7, 2006
  2. jcsd
  3. May 6, 2006 #2


    User Avatar
    Gold Member

    Hmm, what about the value of new theory that makes existing theory conceptually and computationally simpler?

    An example: QFT calculations invented by Schwinger were notoriously complicated, but essentially complete as a predictive model for QED. Feynman came along with his path integrals and made everything much easier. No new falsifiable predictions, but I'd call the theory very successful and valuable.
  4. May 6, 2006 #3
    Forget falsifiability. What about the capacity for a theory to evoke feelings of corny sentimentality - what one might call it's "schmaltzifiability"? Also, why do bad things happen to good people? Perhaps a bunny with a pancake on it's head might help. :surprised :surprised :surprised
  5. May 6, 2006 #4


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    falsifiability is far from the only criterion for judging theories.
    it is just a bad thing not to have.
  6. May 6, 2006 #5


    User Avatar
    Gold Member

    Ahh, I thought when you said

    you were arguing that falsifiability should be essential.

    Maybe here's a way of keeping this criteria: Does a theory qualify as falsifiable if its claim is that it nicely reproduces another falsifiable theory?
  7. May 7, 2006 #6


    User Avatar
    Science Advisor
    Gold Member

    Building a house on untitled ground is too risky for my taste.
  8. May 7, 2006 #7


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    It finally sinks in what you were saying, Garrett :smile:
    How about we say that if two theories predict the same numbers (like Schwing and Feyn) then they are just two versions of the SAME theory. One can have several formulations of the same thing----with the same predictive content.

    I DO think falsifiability is essential. But there are other good things to look for too, like elegance.
    But perhaps falsifiability is THE essential feature of a theory in empirical science.

    It is something you can't do without---testability.

    But what I meant to say, garrett, is that there is much more that theories give us besides that. I mean the creative unifications like connecting electricity to magnetism---the unification that revealed the possibility of radio waves

    Theories can make us see old phenomena in new ways and open our eyes to completely new phenomena that no one had thought to look for. A theory can EXPAND OUR IMAGINATION OF NATURE.

    Yes falsifiable is essential, if something isn't made to be tested then then it's trash. but once it can be tested we should still expect more than mere testability from a great theory.

    you can probably think of more and better illustrations of this, so I won't elaborate

    you mentioned elegance (illustrated by Feynman path integral as opposed to Schwinger less illuminating version). agreed
    Last edited: May 7, 2006
  9. May 7, 2006 #8

    George Jones

    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    I tend to look also at this from an equivalent, contrapositive point of view.

    ~F => ~A


    T => B

    where T = ~F = theory is true. and B = ~A. If the theory being true impliles B, and ew observe the logiical negation of B, then the theory is false, as you have written,

    John Baez and Martin Hardcastle had an http://groups.google.ca/group/sci.physics.research/msg/3a09db4f289e679a?hl=en&" on sci.physics.research a few years ago about the difference between universal "for all" quantifiers and existential "there exits" logical quantifiers in statements of theories.

    Last edited by a moderator: Apr 22, 2017
  10. May 7, 2006 #9


    User Avatar
    Staff Emeritus
    Gold Member
    Dearly Missed

    Feyerabend, who started out as a Popperian, wound up sharply criticising Popper's falsification criterion as an improper idealization. In the real world, Feyerabend emphasized, things are alwys more ambiguous, one sparrow doesn't make a Summer, and one false prediction can generally be "handled". On the other side, modern theories and their interactions with reality are so complex that it is impossible for one mind to comprehend them and derive simple boolean propositions like this.

    Jaques Distler certainly comes close to mastering string theory. I was able to reduce Distler et al's claims to a simple string of logical propositions, but look what happened; side issues immediately vitiated them. Feyerabend would be chuckling.
  11. May 7, 2006 #10


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    In this thread we don't have just one person's view of falsifiability or the criteria (essential and otherwise) for judging a scientific theory. You me and Popper may all have different notions, and anybody who isnt Popper (who passed away in 1994) is welcome to give their own interpretation of what it means and why we want theories to be falsifiable.

    My personal view is that life cannot be reduced to a mechanistic problem-solving model, the progress of science is not mechanical or reducible to simple rules. So I welcome your observation that it may take several Wrongies before you can drive a stake thru the heart of a tough theory.

    I also think that (as you know better than I) the ground of 20th Century physics is littered with the corpses of theories which were at one time somebody's pet brainchild and which were passionately believed in and promoted by leaders and followers alike.

    My personal view is not to adhere to a systematic philosophy of anybody including Popper, but to try to be pragmatic about it and see certain kinds of ethical behavior as important for the unity and survival of the community.

    there are a lot of different points to be made including about the economical use of time, and longterm credibility and availability of government funding---there is probably no one mechanism or recipe that by itself ensures scientific progress (if we could even define that exactly)

    but prediction of new results (not to indiscriminately "predict" everything that happens) is so valuable you can say it is essential, and valuable if not essential for some secondary reasons as well
    1. it lets the guys kill off theories so they don't waste so much time barking in wrong alleys
    2. it keeps the community more cohesive instead of breaking up into schools and factions that go their own way (which they still do to some extent but ultimately there is a way to resolve differences)
    3. predictiveness of theories makes them more INTERESTING
    4. predictiveness makes the discoveries of science have more practical value to mankind because it lets you sometimes design a bridge or a transistor that works (but be careful how you use it)
    5. predictiveness builds up prestige and credibility so that scientists can sometimes say things that politicians dont want to hear and still be listened to, like about ozone and greenhouse.

    I am not saying that practical value to mankind is essential to a good theory! A lot of these things are not essential to science. they are just BYPRODUCTS of the traditional predictivness of scientific theories.

    the essential one is #1 on the list----maybe we would all agree about that. It lets you kill off the wrong ones.

    And the other thing to mention, just for completness, is that you never can empirically demonstrate that a theory is a correct description of nature (correct descriptions do not exist as far as we know)

    empirically all you can do is prove a theory wrong. So predictiveness does not mean verifiable, it means falsifiable.

    And even then there is no absolute clear meaning of the terms, that is how it always is, discussion depends on good will and tolerance, words are not perfect. So one can get caught in quibbles. But that is the general idea as I see it of why one needs to hold theorists to the standard of making theories predictive of definite results---so they can be falsified directly by observation.
    Last edited: May 7, 2006
  12. May 7, 2006 #11
    This brings up the issue of what we all accept to start with before discussion can even begin. It seems we must start with the precepts of reasoning, the general principles of logical reasoning, before we can even begin to discuss the specifics of how this is applied to physics. We accept propositional calculus, predicate logic, and the rules of mathematics. And we accept that these logical principles are applicable to the physical world. Then we search for some fundamental precepts on which to base our physics.

    But what if someone comes up with a physical theory solely derived from these logical and mathematical rules of consistency. I wonder if category/topos theory might not be the underlying basis of background independent QFT, for example. Certainly in an effort to explain everything, we should expect that one day we will discover that physics can be derives solely from the first principles of logic and math.

    The question is: if no error in logic or math can be discovered in such a theory should we reject it because we are not able yet to test it? Or would the sheer logical consistency of it require that we accept it?
  13. May 7, 2006 #12


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    here's one possible answer (BTW you raise interesting issues)

    ultimately the content of a theory is in its predictions
    (not general vague predictions but specific definite ones)

    if two theories predict the same numbers (and would be falsified by the same set of experimental results) then they are in a certain sense the SAME theory-------like Schwing and Feyn's two versions of QED that turned out to be the same.

    if a theory does not make definite predictions then it has no content.

    in that case mere logical consistency is useless to us

    you ask "should we accept it?" One answer would be that we never accept theories. they are not to be believed in. what you do with theories is USE their predictions, and test them, and eventually replace them.

    there is no physical evidence that a single fundamental "right" theory can be formulated using human mathematics----any thinking that assumes such a thing exists is semi-religious---has made a metaphysical leap of faith somewhere along the line.

    what we can see in the history of science is a series of gradually improved models---with no implication of a limit or endpoint

    logical consistency should be a requirement but it's hardly a recommendation-----silly or superfluous stuff can also be consistent.

    other people may think differently about your suggestion

    you raise an interesting question about what are the UNSPOKEN UNQUESTIONED PREMISES of some given community of people.
    that one of the hardest things to determine, it is like what is inside the earth----the layers of rock and mantle and molten stuff and iron.

    there is no automatic recipe or routine for science. if we could IDENTIFY AND CODIFY what are people's unquestioned premises and reduce everthing to explicit principles (hah hah good luck!) then we could make a machine that would construct theories and test them. the whole process could be automated. just turn the crank

    then it wouldnt need to involve intangibles like the Sense of Beauty and the Limbic System.

    but so far we are all made of meat, the last time i checked. it is amazing that things have come along this well
  14. May 7, 2006 #13


    User Avatar
    Gold Member

    There is no way of pussy footing around this, make a prediction, propose an
    experiment to falsify it, if the establishment does not have the means to test your theory then it is the fault of the establishment, if goverments will not
    fund scientific theory what is the use of scientists.
  15. May 7, 2006 #14
    agreed. The only reason we study is to make better decisions, which can only affect the future.

    the evidence that we do indeed think that there is a TOE derivable from sheer logic is....... we keep trying. If we get stuck on some observation, we work at it until we have an explanation based on something more fundamental. This process of trying to understand and explaining things by more fundamental principles can stop ONLY when everything is explainable from sheer logic itself. Since we will always continually try to understand everything, there must be some innate expectation in us that everything is ultimately logical. So we persue it in the hope it will explain some reason for existence as well.

    The end point is where we have derived a TOE in terms of sheer logic itself and know for a certainty what will happen tommorrow without the need of any observations at all.
  16. May 7, 2006 #15


    User Avatar
    Gold Member

    Actually we do not see a series, we only see four or five points (different theories) for a given branch of science, and we havent any proof of infinite iteration, as a series has. Take astronomy. We have celestial spheres, then epicicles, then kepler theory, then newton theory, then poincare, then einstein. Six points do not constitute "a series".
    Last edited: May 7, 2006
  17. May 7, 2006 #16
    Look, if someone says to me they've got it all figured out except they can't predict anything, then I tell them they haven't gotten it all figured out. If they say they've got a theory that addresses various issues but which can't yet generate a testable prediction - so they know they haven't got it all figured out - but know of no reasons why the theory won't eventually be predictive, then I say fine. There really isn't anything else to say. So can we please put this issue to sleep. It's enough already.
    Last edited by a moderator: May 7, 2006
  18. May 7, 2006 #17


    User Avatar
    Gold Member

    I remember reading in Roger Penrose's book, The Road to Reality, where Penrose was trying to explain that falsifiability was not a realistic criterion. He brought up the example of a theory that predicts the existence of at least one magnetic monopole somewhere in the universe. Clearly this theory could never be falsified because you would never know for certain that you had searched the entire universe and that there was not more stuff elsewhere. From what I remember Penrose claims that this theory would be usefull in explaining why charge is quantized (or maybe it was spin), so it has scientific value.

    I think he raises a valid point in that falsifiability is not the ultimate criterion for judging the scientificness of a theory. However, in the example he uses, the theory is still testable because it is proovable to the extent that most other theories are falsifiable. It is true that you can't prove the whole universe is not a dream, so that you can't really prove the theory in this example, but it is also true that you can't disprove any theory because you could never prove that the experiment wasn't a dream. But, in a practicle sense, the statement that there is a magnetic monopole in the universe is proovable if true. Penrose fails to convince me that testability is not a necessary criterion for a scientific theory, but I do think "testable" would be a better criterion than "falsifiable".
  19. May 8, 2006 #18


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    Leonhard thanks for the comment! This is a smart comment and points to an interesting passage of Penrose's book starting on page 1020
    the section 34.4

    he argues skillfully that "observational falsifiability" may be too restrictive but does not say exactly how to open it up slightly so that it would be a better standard but not TOO open so as to let untestable stuff in.

    actually I think his argument is wrong----but it sounds good and it is challenging and I enjoyed re-reading it at your suggestion---and he could be right.

    I could be wrong but I think he confuses a STATEMENT made by a scientific theory with the THEORY ITSELF.

    It is not a theory that K>0, that the largescale curvature of the universe is positive. He gives this as an example of a theory, as he is making his argument. I think it is wrong because it is not a theory that K>0. He gives many many examples just like this. He also calls it a theory to say that K = 0.

    What is a theory is not that K > 0, the theory is some model of cosmology in which one of the conclusions could be K > 0. or could be K = 0. It is the whole theory which should be falsfiable (or it is not kosher).

    So if you have a theory which says, among other things, something about K and maybe that statement is not by itself falsifiable, the theory should still (if it is scientific) make SOME falsifiable statement about SOMETHING.

    there has to be some future experiment that could in some imaginable circumstance go against the theory.

    I think he failed to show that falsifiability is too stringent a requirement.
    there may be other things wrong with what he says around pages 1020-1021 and I will try to get back to this. thanks again for bringing it up!
  20. May 10, 2006 #19
    Some of my thoughts: how high you rate falsifiability depends on what you consider to be science, or what you consider to be important. That's a sociological issue that changes with time. For some the quest is to understand the mathematical structure of the universe, for some it's figuring out how many pions a black hole emits. Unfortunately, for most governments, science is when you can make a patent out of it. The questions humans wonder about change from decade to decade, they are influenced by politics and religion, and that's not something science is detached from. And it should not be. Though nowadays most people would do so, progress is not something you define in technological terms.

    The question is then where to draw the lines between engineering, physics, mathematics and philosophy. I personally tend to put a lot of philosophy into the physics, and I always found mathematicians to be the better philosophers, but that is a side issue. The point is that I find it very short sighted to cook up some static rules for what science is, and on that, build principles for what we have to do.

    However, a discussion what guidelines physicist should pursue in a given situation -- and, naturally, you are talking about the present situation -- is definitely necessary. It is necessary to stay in contact with the society we live in (and from) and the life that we lead. It is necessary to readjust the field, esp. if things seem to go wrong. In this regard, a demand for falsifiable theories is certainly good.

    But I should also mention that I already see the collective scream for PREDICTIONS and testable theories to go into extreme on the other side. It's just not my understanding of physics to come up with some more or less motivated model with some parameters that fit some data or not. A brilliant example for such a thing is MOND. Certainly, it's intriguing that it works, but what to we LEARN from it? Most people I have talked to say that even if it's right, then there has to be a REASON for it. Something to understand WHY it looks (as ugly) as it does. Or take the biggest part of the DSR-predictions. Where is the theory that they work with? Is is self-consistent? Does it reproduce the SM? (soccer ball?) Is it sufficient to have some more or less convincing equations that might (in some papers) shift the GZK bound towards the right direction (even though the data situation is far from clear). How come there are suddenly so many people basically jumping on these issues completely disregarding the basic problems?

    This ALSO is something that shouldn't happen!



    PS: marcus btw your intro about moral obligations, good faith, and the like in the scientific community sound kind of familiar. do you have a reference on that?
  21. May 10, 2006 #20


    User Avatar
    Science Advisor
    Gold Member
    Dearly Missed

    I agree MOND is a brilliant example.
    ...A brilliant example for such a thing is MOND. Certainly, it's intriguing that it works, but what do we LEARN from it? Most people I have talked to say that even if it's right, then there has to be a REASON for it. Something to understand WHY...

    I think it is an example of how science can proceed. first get an ad hoc theory like MOND that makes predictions different from GR, then test it to see if it is right, it it is right at a phenomena level then look for the deep reasons WHY.

    I have never been interested in MOND per se as some kind of final theory but only as a effective theory that would force people to look for possibly beautiful reasons, something in quantum gravity perhaps since it is a theory of space time and its interaction with matter.

    so I have always been interested to know if MOND checks out. if it is right there must be something fundamental hiding behind the phenomena. (just my guess)

    So I think it is a good way for science to proceed. Because if they never formulated and checked MOND they would have no clue of that divergence from straight GR.

    half the time the early theory is ugly----like you say---but it is OK

    I hope that the LISA pathfinder is used to check MOND in the Solar System the way Bekenstein and Magueijo have proposed, or a probe like LISA does this. And I hope that either MOND is KILLED or not killed. Either way it would be very helpful information for people developing quantum gravity.

    you ask. "what do we learn from it?" Obviously we learn a huge huge thing, if we can test and it passes the test. We learn that the theories of QG must be rebuilt in a fundamental way to give mond effects, it is a huge challenge.

    I try not to hope either way, but I almost can say I hope that MOND is falsified, and quickly. but frankly it would be very interesting to see how the QG people would cope if it would pass a test and were not falsified.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook