Control and stopping of a diffusion process on an interval
成果类型:
Article
署名作者:
Karatzas, I; Sudderth, WD
署名单位:
Columbia University; University of Minnesota System; University of Minnesota Twin Cities
刊物名称:
ANNALS OF APPLIED PROBABILITY
ISSN/ISSBN:
1050-5164
发表日期:
1999
页码:
188-196
关键词:
摘要:
Consider a process X(.) = {X(t), 0 less than or equal to t < infinity} which takes values in the interval I = (0, 1), satisfies a stochastic differential equation dX(t) = beta(t) dt + sigma(t) dW(t), X(0) = x is an element of I and, when it reaches an endpoint of the interval I, it is absorbed there. Suppose that the parameters beta and sigma are selected by a controller at each instant t is an element of [0, infinity) from a set depending on the current position. Assume also that the controller selects a stopping time tau for the process and seeks to maximize Eu(X(tau)), where u: [0, 1] --> R is a continuous reward function. If lambda := inf{x is an element of I: u(x) = max u} and rho := sup{x is an element of I: u(x) = max u}, then, to the left of lambda, it is best to maximize the mean-variance ratio (beta/sigma(2)) or to stop, and to the right of rho, it is best to minimize the ratio (beta/sigma(2)) or to stop. Between lambda and rho, it is optimal to follow any policy that will bring the process X(.) to a point of maximum for the function u(.) with probability 1, and then stop.