Risk probability optimization problem for finite horizon continuous time Markov decision processes with loss rate

Title:

Risk probability optimization problem for finite horizon continuous time Markov decision processes with loss rate

Creator:

Huo, Haifeng and Wen, Xian

Identifier:

https://cdk.lib.cas.cz/client/handle/uuid:a2c7d847-6e2c-486c-b50c-05b8816bdd62
uuid:a2c7d847-6e2c-486c-b50c-05b8816bdd62
doi:10.14736/kyb-2021-2-0272

Subject:

optimal policy, continuous-time Markov decision processes, risk probability criterion, loss rate, finite horizon, and unbounded transition rate

Type:

model:article and TEXT

Format:

bez média and svazek

Description:

This paper presents a study the risk probability optimality for finite horizon continuous-time Markov decision process with loss rate and unbounded transition rates. Under drift condition, which is slightly weaker than the regular condition, as detailed in existing literature on the risk probability optimality Semi-Markov decision processes, we prove that the value function is the unique solution of the corresponding optimality equation, and demonstrate the existence of a risk probability optimization policy using an iteration technique. Furthermore, we provide verification of the imposed condition with two examples of controlled birth-and-death system and risk control, and further demonstrate that a value iteration algorithm can be used to calculate the value function and develop an optimal policy.

Language:

English

Rights:

http://creativecommons.org/licenses/by-nc-sa/4.0/
policy:public

Coverage:

272-294

Source:

Kybernetika | 2021 Volume:57 | Number:2

Harvested from:

CDK

Metadata only:

false