Markov decision problems with unbounded transition rates under discounted-cost performance criteria

摘要

We discuss the problems of discounted-cost performance optimization for a class of countable Markov control processes (CMCP) with (possibly) unbounded transition rates. The discounted Poisson equation is proposed for a CMCP, from which /spl alpha/-potential is defined. The optimality equation based on the /spl alpha/-potential is derived under the conditions weaker than those previously known.