How to Prove a Verification Theorem for an Optimal Control Problem?

psalgado
Messages
2
Reaction score
0
Hi guys, I could use some help on the proof of a verification theorem for the following optimal control problem


<br /> J_{M}(x;u)&amp;\equiv&amp;\mathbb{E}^{x}\left[\int_{0}^{\tau_{C}}\left(\int_{0}^{t}e^{-rs}\pi_{M}(x_{s})ds\right)\lambda u_{t}e^{-\lambda\int_{0}^{t}u_{z}dz}dt+\int_{0}^{\tau_{C}}\lambda u_{t}e^{-rt-\lambda\int_{0}^{t}u_{z}dz}\phi x_{t}dt\right]<br />



where the control can only assume the values 0 or 1.

Having some trouble with the standard verficication argument that relies on Dynkin Formula, since the limit of integration is a stopping time.
 
Last edited:
Physics news on Phys.org
Your equation does not seem to be rendering correctly for me. Does it appear okay in your browser? (I'm using IE)
 
Thread 'Direction Fields and Isoclines'
I sketched the isoclines for $$ m=-1,0,1,2 $$. Since both $$ \frac{dy}{dx} $$ and $$ D_{y} \frac{dy}{dx} $$ are continuous on the square region R defined by $$ -4\leq x \leq 4, -4 \leq y \leq 4 $$ the existence and uniqueness theorem guarantees that if we pick a point in the interior that lies on an isocline there will be a unique differentiable function (solution) passing through that point. I understand that a solution exists but I unsure how to actually sketch it. For example, consider a...
Back
Top