A new prospective for Learning Automata: A machine learning approach

• Published in: Neurocomputing (Amsterdam) 2016-05, Vol.188, p.319-325
• Main Authors: Jiang, Wen, Li, Bin, Li, Shenghong, Tang, Yuanyan, Chen, Chun Lung Philip
• Format: Article
• Language: English
• Subjects: Bayesian analysis; Bayesian estimator; Benchmarks; Conjugates; Equivalence; Estimators; Learning; Learning Automata; Maximum Likelihood Estimator; Maximum likelihood estimators; Stochasticity; ϵ-Optimal
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2015.04.125

In the field of Learning Automata (LA), how to design faster learning algorithms has always been a key issue. Among solutions reported in the literature, the stochastic estimator reward-inaction learning automaton (SERI), which belongs to the Maximum Likelihood estimator based LAs, has been recognized as the fastest ϵ-optimal LA. In this paper, we first point out the limitations of the traditional Maximum Likelihood Estimator (MLE) based LAs and then introduce Bayesian estimator based approach, which is demonstrated to be equivalent to Laplace smoothing of the traditional method, to overcome these limitations. The key idea is that the Bayesian estimator, which estimates the probability of selecting each action in the LA, aims to reconstruct Bernoulli distribution from sequential data, and is formalized based on exponential conjugate family so that the LA has a relatively simple format for easy implementation. In addition, we also indicate that this Bayesian estimator could be applied to update almost all existing MLE estimator based LAs. Based on the proposed Bayesian estimator, a new LA, known as Generalized Bayesian Stochastic Estimator (GBSE) LA, is presented and proved to be ϵ-optimal. Finally, extensive experimental results on benchmarks demonstrate that our proposed learning scheme is more efficient than the current best LA SERI.