Evaluating Action Durations for Adaptive Traffic Signal Control Based On Deep Q‑Learning

摘要

Adaptive traffic signal control is the control technique that adjusts the signal times according to traffic conditions and managesthe traffic flow. Reinforcement learning is one of the best algorithms used for adaptive traffic signal controllers. Despite manysuccessful studies about Reinforcement Learning based traffic control, there remains uncertainty about what the best actionsto actualize adaptive traffic signal control. This paper seeks to understand the performance differences in different actiondurations for adaptive traffic management. Deep Q-Learning has been applied to a traffic environment for adaptive learning.This study evaluates five different action durations. Also, this study proposes a novel approach to the Deep Q-Learning basedadaptive traffic control system for determine the best action. Our approach does not just aim to minimize delay time by waitingtime during the red-light signal also aims to decrease delay time caused by vehicles slowing down when approaching theintersection and caused by the required time to accelerate after the green light signal. Thus the proposed strategy uses notjust information of intersection also uses the data of adjacent intersection as an input. The performances of these methods areevaluated in real-time through the Simulation of Urban Mobility traffic simulator. The output of this paper indicate that theshort action times increase the traffic control system performances despite more yellow signal duration. The results clearlyshows that proposed method decreases the delay time.