Abstract:

A new algorithm for the automatic generation of the Option Hierarchical Reinforcement Learning is presented. The algorithm takes the state space detected by the agent as input in the initial learning phase,and clusters the states by employing fuzzy clustering. Based on the clustered state sets, the intrastrategies are learned by an experience replay procedure. As a result, the options are generated. The validity of the algorithm is demonstrated by simulation experiments.

Key words: reinforcement learning;hierarchical reinforcement learning;fuzzy clustering;Option