Strong average optimality criterion for continuous-time Markov decision processes

Title:

Strong average optimality criterion for continuous-time Markov decision processes

Creator:

Wei, Qingda and Chen, Xian

Identifier:

https://cdk.lib.cas.cz/client/handle/uuid:02e9dc97-85d9-4932-9962-070354b7d0b0
uuid:02e9dc97-85d9-4932-9962-070354b7d0b0

Subject:

continuous time Markov decision processes, strong average optimality criterion, finite-horizon expected total cost criterion, unbounded transition rates, optimal policy, and optimal value function

Type:

model:article and TEXT

Format:

bez média and svazek

Description:

This paper deals with continuous-time Markov decision processes with the unbounded transition rates under the strong average cost criterion. The state and action spaces are Borel spaces, and the costs are allowed to be unbounded from above and from below. Under mild conditions, we first prove that the finite-horizon optimal value function is a solution to the optimality equation for the case of uncountable state spaces and unbounded transition rates, and that there exists an optimal deterministic Markov policy. Then, using the two average optimality inequalities, we show that the set of all strong average optimal policies coincides with the set of all average optimal policies, and thus obtain the existence of strong average optimal policies. Furthermore, employing the technique of the skeleton chains of controlled continuous-time Markov chains and Chapman-Kolmogorov equation, we give a new set of sufficient conditions imposed on the primitive data of the model for the verification of the uniform exponential ergodicity of continuous-time Markov chains governed by stationary policies. Finally, we illustrate our main results with an example.

Language:

English

Rights:

http://creativecommons.org/publicdomain/mark/1.0/
policy:public

Coverage:

[950]-977

Source:

Kybernetika | 2014 Volume:50 | Number:6

Harvested from:

CDK

Metadata only:

false