DOI Number : 10.5614/itbj.eng.sci.2010.42.1.2
Hits : 5

Adaptive Control with Approximated Policy Search Approach

Agus Naba

Instrumentation and Measurement Laboratory, Faculty of Sciences,

Brawijaya University

Jl. Veteran Malang, Telp./Fax.: +62 (341) 575833/575834

e-mail: anaba@brawijaya.ac.id


Abstract.

Most of existing adaptive control schemes are designed to minimize error between plant state and goal state despite the fact that executing actions that are predicted to result in smaller errors only can mislead to non-goal states. We develop an adaptive control scheme that involves manipulating a controller of a general type to improve its performance as measured by an evaluation function. The developed method is closely related to a theory of Reinforcement Learning (RL) but imposes a practical assumption made for faster learning. We assume that a value function of RL can be approximated by a function of Euclidean distance from a goal state and an action executed at the state. And, we propose to use it for the gradient search as an evaluation function. Simulation results provided through application of the proposed scheme to a pole-balancing problem using a linear state feedback controller and fuzzy controller verify the scheme’s efficacy.



Keywords: adaptive control; evaluation function; policy search approach; reinforcement learning; value function.

Download Article
 
Bahasa Indonesia | English
 
 
 

Notification:

Begin on 10 October 2014 this website is no longer activated for article process in Journal of Mathematical and Fundamental Sciences, Journal of Engineering and Technological Sciences, Journal of ICT Research and Applications and Journal of Visual Art and Design. The next process will be proceeded under new website at http://journals.itb.ac.id.

For detail information please contact us to: journal@lppm.itb.ac.id.

 
       
       
       ITB Journal Visitor Number #26538238       
       Jl. Tamansari 64, Bandung 40116, Indonesia Visitor IP Address #       
       Tel : +62-22-250 1759 ext. 121 © 2011 Institut Teknologi Bandung       
       Fax : +62-22-250 4010, +62-22-251 1215 XHTML + CSS + RSS       
       E-mail : journal@lppm.itb.ac.id or proceedings@lppm.itb.ac.id Developed by AVE