Controlled Markov set-chains and Bayesian Decision Analysis (Decision making theories under uncertainty and its applications : the extensions of mathematics for programming)

Abstract

In this note, we summarize briefly our series of studies on Markov dccision processes with unknown transition matrices and give an idea to show the rate of convergence of Bayesian updating of posterior distribution in a sampling problem.