Description:

The Multiagent decision process (MADP) Toolbox is a free C++ software toolbox for scientific research in decision-theoretic planning and learning in multiagent systems (MASs). We use the term MADP to refer to a collection of mathematical models for multiagent planning: multiagent Markov decision processes (MMDPs), decentralized MDPs (Dec-MDPs), decentralized partially observable MDPs (Dec-POMDPs), partially observable stochastic games (POSGs), etc.

The toolbox is designed to be rather general, potentially providing support for all these models, although so far most effort has been put in planning algorithms for discrete Dec-POMDPs. It provides classes modeling the basic data types of MADPs (e.g., action, observations, etc.) as well as derived types for planning (observation histories, policies, etc.). It also provides base classes for planning algorithms and includes several applications using the provided functionality. For instance, applications that use JESP or brute-force search to solve .dpomdp files for a particular planning horizon. In this way, Dec-POMDPs can be solved directly from the command line. Furthermore, several utility applications are provided, for instance one which empirically determines a joint policy's control quality by simulation.

Changes to previous version:

-Includes freshly written spirit parser for .pomdp files. -Includes new code for pruning POMDP vectors; obviates dependence on Cassandra's code and old LP solve version. -Includes new factor graph solution code -Generalized firefighting CGBG domain added -Simulation class for Factored Dec-POMDPs and TOI Dec-MDPs -Approximate BG clustering methods and kGMAA with clustering.

BibTeX Entry: Download

Corresponding Paper BibTeX Entry: Download

Supported Operating Systems: Linux, Mac

Data Formats: Ascii, Xml

Tags: Reinforcement Learning, Multiagent Systems, Planning

Archive: download here

Other available revisons

Version	Changelog	Date
0.4	-Includes freshly written spirit parser for .pomdp files. -Includes new code for pruning POMDP vectors; obviates dependence on Cassandra's code and old LP solve version. -Includes new factor graph solution code -Generalized firefighting CGBG domain added -Simulation class for Factored Dec-POMDPs and TOI Dec-MDPs -Approximate BG clustering methods and kGMAA with clustering.	June 2, 2016, 17:38:59
0.3.1	Initial Announcement on mloss.org.	June 4, 2015, 15:58:12

Comments

No one has posted any comments yet. Perhaps you'd like to be the first?

Leave a comment

You must be logged in to post comments.