MDPtoolbox: Markov Decision Processes toolbox

The Markov Decision Processes (MDP) toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: finite horizon, value iteration, policy iteration, linear programming algorithms with some variants and also proposes some functions related to Reinforcement Learning.

Version: 4.0.2
Depends: Matrix, linprog
Published: 2014-07-22
Author: Iadine Chades, Guillaume Chapron, Marie-Josee Cros, Frederick Garcia, Regis Sabbadin
Maintainer: Guillaume Chapron <gchapron at>
License: BSD_3_clause + file LICENSE
NeedsCompilation: no
CRAN checks: MDPtoolbox results


Reference manual: MDPtoolbox.pdf
Package source: MDPtoolbox_4.0.2.tar.gz
Windows binaries: r-devel:, r-release:, r-oldrel:
OS X Snow Leopard binaries: r-release: MDPtoolbox_4.0.2.tgz, r-oldrel: MDPtoolbox_4.0.2.tgz
OS X Mavericks binaries: r-release: MDPtoolbox_4.0.2.tgz
Old sources: MDPtoolbox archive