Acceleration of association-rule based markov decision processes

In this paper, we present a new approach for the estimation of Markov decision processes based on efficient association rule mining techniques such as Apriori. For the fastest solution of the resulting association¿rule based Markov decision process, several accelerating procedures such as asynchrono...

Full description

Bibliographic Details
Authors: Ma. de G. García-Hernández, J. Ruiz-Pinales, A. Reyes-Ballesteros, E. Onaindía, J. Gabriel Aviña-Cervantes, S. Ledesma
Format: article
Status:Published version
Publication Date:2009
Country:México
Institution:Universidad de Guanajuato
Repository:Redalyc-UG
OAI Identifier:oai:redalyc.org:47413020008
Online Access:https://www.redalyc.org/articulo.oa?id=47413020008
Access Level:Open access
Keyword:Ingeniería
association rules
acceleration procedures
Markov decision processes
Description
Summary:In this paper, we present a new approach for the estimation of Markov decision processes based on efficient association rule mining techniques such as Apriori. For the fastest solution of the resulting association¿rule based Markov decision process, several accelerating procedures such as asynchronous updates and prioritization using a static ordering have been applied. A new criterion for state reordering in decreasing order of maximum reward is also compared with a modified topological reordering algorithm. Experimental results obtained on a finite state and action¿space stochastic shortest path problem demonstrate the feasibility of the new approach.