On solving controlled Markov set-chains via multi-policy improvement

초록

We present formal methods of improving multiple policies for solving controlled Markov set-chains with infinite-horizon discounted reward criteria. The multi-policy improvement methods follow the spirit of parallel rollout for solving Markov decision processes (MDPs). In particular, these methods are useful for on-line control of Markov set-chains and for approximately solving MDPs via state aggregation. We further discuss issues on designing a policy-iteration type algorithm based on our policy improvement methods.

키워드