How to Prove a Verification Theorem for an Optimal Control Problem?

Click For Summary
SUMMARY

The discussion focuses on proving a verification theorem for an optimal control problem defined by the functional J_{M}(x;u), which involves expectations and integrals with specific parameters like λ and r. The control variable u can only take values 0 or 1, complicating the verification process. The primary challenge highlighted is the application of the Dynkin Formula due to the presence of a stopping time in the limit of integration. Participants are encouraged to ensure proper rendering of the equation across different browsers, particularly Internet Explorer.

PREREQUISITES
  • Understanding of optimal control theory
  • Familiarity with stochastic calculus and the Dynkin Formula
  • Knowledge of stopping times in probability theory
  • Experience with mathematical notation and rendering in web browsers
NEXT STEPS
  • Study the application of the Dynkin Formula in optimal control problems
  • Research the properties of stopping times in stochastic processes
  • Explore numerical methods for verifying control strategies
  • Learn about different mathematical rendering tools for web applications
USEFUL FOR

Researchers, mathematicians, and students in the fields of optimal control theory and stochastic processes, particularly those working on verification theorems and mathematical proofs.

psalgado
Messages
2
Reaction score
0
Hi guys, I could use some help on the proof of a verification theorem for the following optimal control problem


[itex] J_{M}(x;u)&\equiv&\mathbb{E}^{x}\left[\int_{0}^{\tau_{C}}\left(\int_{0}^{t}e^{-rs}\pi_{M}(x_{s})ds\right)\lambda u_{t}e^{-\lambda\int_{0}^{t}u_{z}dz}dt+\int_{0}^{\tau_{C}}\lambda u_{t}e^{-rt-\lambda\int_{0}^{t}u_{z}dz}\phi x_{t}dt\right][/itex]



where the control can only assume the values 0 or 1.

Having some trouble with the standard verficication argument that relies on Dynkin Formula, since the limit of integration is a stopping time.
 
Last edited:
Physics news on Phys.org
Your equation does not seem to be rendering correctly for me. Does it appear okay in your browser? (I'm using IE)
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
3K
Replies
6
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 7 ·
Replies
7
Views
6K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 0 ·
Replies
0
Views
4K
  • · Replies 18 ·
Replies
18
Views
4K
  • · Replies 21 ·
Replies
21
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K