Simultaneous Learning to Acquire Competitive Behaviors in Multi-agent System Based on Modular Learning System

摘要

The existing reinforcement learning approaches have been suffering from the policy alternation of others in multiagent dynamic environments. A typical example is a case of RoboCup competitions since other agent behaviors may cause sudden changes in state transition probabilities of which constancy is needed for the learning to converge. The keys for simultaneous learning to acquire competitive behaviors in such an environment are- a modular learning system for adaptation to the policy alternation of others, and- an introduction of macro actions for simultaneous learning to reduce the search space.This paper presents a method of modular learning in a multiagent environment, by which the learning agents can simultaneously learn their behaviors and adapt themselves to the situations as consequences of the others' behaviors.