Markov Decision Processes

Explore the comprehensive world of Markov Decision Processes with Martin L. Puterman's authoritative text, published by John Wiley & Sons Inc in 2005. This paperback edition spans 684 pages, providing an up-to-date and rigorous examination of both theoretical and computational aspects of Markov decision process models.

Delve into the intricate details of infinite-horizon discrete-time models while also gaining insights into arbitrary state spaces, finite-horizon, and continuous-time discrete-state models. Whether you are a student, researcher, or practitioner in the field, this book serves as an essential resource for understanding and applying Markov decision processes in various contexts.

Enhance your knowledge and skills in decision-making models with this indispensable guide by one of the leading experts in the field.