TRAFFIC LIGHT DISPERSION CONTROL BASED ON DEEP REINFORCEMENT LEARNING
Keywords:
Traffic Light Control, Deep Reinforcement Learning, Pulai Perdana, SUMOAbstract
The current traffic light controls are ineffective and causes a handful of problems such as congestion and pollution. This study investigates the application of deep reinforcement learning on traffic control systems to minimize congestion at traffic intersection. The traffic data from Pulai Perdana, Skudai, Johor Intersection was extracted, analysed and simulated based on the Poisson Distribution, using a simulator, Simulation of Urban Mobility (SUMO). In this research, we proposed a deep reinforcement learning model, which combines the capabilities of convolutional neural networks and reinforcement learning to control the traffic lights to increase the effectiveness of the traffic control system. The paper explains the method we used to quantify the traffic scenario into different matrices which fed to the model as states which reduces the load of computing as compared to images. After 2000 iterations of training, our deep reinforcement learning model was able to reduce the cumulative waiting time of all the vehicles at the Pulai Perdana intersection by 47.31% as compared to a fixed time algorithm and can perform even when the traffic is skewed in a different direction. When the traffic is scaled down to 50% and 20 %, the agent continues to improve the waiting time by 69.5% and 68.36 % respectively. It is proven in the experiment that a deep reinforcement learning model was able to reduce the cumulative waiting time at Pulai Perdana by 47.31%.References
Gao, J., Shen, Y., Liu, J., Ito, M., &Shiratori, N. (2017). Adaptive Traffic Signal Control: Deep Reinforcement Learning Algorithm with Experience Replay and Target Network. arXiv preprint arXiv:1705.02755.
Genders, W., &Razavi, S. (2016). Using a deep reinforcement learning agent for traffic signal control. arXiv preprint arXiv:1611.01142.
Li, L., Lv, Y., & Wang, F.-Y. (2016). Traffic signal timing via deep reinforcement learning. IEEE/CAA Journal of AutomaticaSinica, 3(3), 247-254.
Liang, X., Du, X., Wang, G., & Han, Z. (2018). Deep reinforcement learning for traffic light control in vehicular networks. arXiv preprint arXiv:1803.11115.
Mathew, D. T. V. (2014). Transportation Systems Engineering, Chapter 13: Vehicle Arrival Models: Count.
Özlü, A. (2017). Vehicle Detection, Tracking and Counting. https://github.com/ahmetozlu/vehicle_counting
Van der Pol, E., &Oliehoek, F. A. (2016). Coordinated deep reinforcement learners for traffic light control. Proceedings of Learning, Inference and Control of Multi-Agent Systems (at NIPS 2016).
Downloads
Published
How to Cite
Issue
Section
License
Copyright of articles that appear in Journal of Transpot System Engineering (JTSE) belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions or any other reproductions of similar nature.
Disclaimer: The views and opinions expressed in the articles are those of the authors and do not necessarily reflect the official policy or position of the JTSE. Examples of analysis performed within are only examples and they should not be utilized in real-world. Assumptions made within the analysis are not reflective of the position of any JTSE entities.
