What is an intractable integral? How do you recognize one?

  • Context: Graduate 
  • Thread starter Thread starter sarikan
  • Start date Start date
  • Tags Tags
    Integral
Click For Summary

Discussion Overview

The discussion revolves around the concept of intractable integrals, particularly in the context of Bayesian methods and Gibbs sampling. Participants explore the definition of intractability, how to recognize such integrals, and the implications for Bayesian inference.

Discussion Character

  • Exploratory
  • Debate/contested
  • Technical explanation

Main Points Raised

  • One participant notes that the term "intractable" is often used in literature but lacks a clear definition, leading to confusion about its meaning in the context of Bayesian models.
  • Another participant expresses a misunderstanding of "intractable," initially interpreting it as "impossible to calculate," and questions whether the term is subjective.
  • A different viewpoint suggests that an integral is considered intractable when it cannot be expressed in terms of a primary set of functions, although the definition remains vague.
  • One participant argues that the presence of infinite bounds is not necessarily the main issue for intractability and suggests that if one cannot integrate an expression, it may be deemed intractable for that individual.
  • Sampling techniques are mentioned as alternatives when integrals are too complex to solve analytically, though they come with their own limitations.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the definition of intractable integrals or the criteria for recognizing them. Multiple competing views and interpretations remain throughout the discussion.

Contextual Notes

There are limitations in the definitions provided, and the discussion highlights the subjective nature of the term "intractable." The participants also acknowledge the challenges in integrating certain functions without resolving specific mathematical steps.

sarikan
Messages
7
Reaction score
0
Greetings,
I've been using Bayesian methods and especially Gibbs sampling to work on models of various complexity, and I've always accepted the pretty much standard textbook explanation as a sensible justification for using sampling methods: sometimes the posterior distributions of Bayesian models may be intractable.

It occurred to me at one point that none of the resources I have properly explain what they mean by that. Google scholar search made me even more confused, since many works seem to use intractable to refer to "resource intensive calculation". Analytically intractable seems to be a better term I guess, but what that means exactly is not still clear to me.

How do you know a (multiple) integral is analytically intractable? Other than the obvious situations where -∞ and ∞ bounds, I mean. (Would this be intractable by the way?)

I'm looking for a proper discussion of the topic, preferably in a Bayesian inference context. It is amazin how many textbooks simply say "this integral may be interactable etc etc.. so let's use sampling"

Any pointers would be much appreciated

Kind regards
Seref
 
Physics news on Phys.org
Ok, I have to confess that I've been bitten by my lack of proper understanding of the word intractable. My native language is not English, and I've taken intractable as impossible to calculate, which was wrong.

I would still appreciate your input though, is not this term a bit subjective?
 
sarikan said:
Ok, I have to confess that I've been bitten by my lack of proper understanding of the word intractable. My native language is not English, and I've taken intractable as impossible to calculate, which was wrong.

I would still appreciate your input though, is not this term a bit subjective?

Hi Sarikan,

I know this topic is over a year old, but just in case someone else is looking for this; I'm not a math expert at all, but I understand an integral being intractable when it is not possible to (more or less) track it down to the 'primary' set of functions. Primary in this case being the functions which you can derive to etc. (correct me if I'm wrong)

I'm not able to give an explanation on how you define a function to be intractable, but at least this might give some idea's. Here is an explanation

- frbl
 
Hi frbl,
Thanks a lot for taking the time to respond to this. It is never too late for useful responses :)
 
sarikan said:
Greetings,

How do you know a (multiple) integral is analytically intractable? Other than the obvious situations where -∞ and ∞ bounds, I mean. (Would this be intractable by the way?)

I don't think that ∞ bounds are the main problem. Some general examples can be found in http://www.stat.cmu.edu/~larry/=sml2008/lect2.pdf. But I think the general answer is this -- if you try to integrate it and cannot, then it is intractable (to you). Sampling techniques have their drawbacks, but they give you an alternative when the integral is too tough. And many integrals are too tough.
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 20 ·
Replies
20
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 19 ·
Replies
19
Views
4K
  • · Replies 18 ·
Replies
18
Views
5K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K