A Multi-Agent DRL-Based Method for Cooperatively Determining Coordination and Lane-Change of Vehicles at Signal-Free Intersections With Free-Direction Lanes

Abstract

Owing to the growing population and rapid urbanization, intersections, where traffic converges from various directions, have become major bottlenecks for road capacity due to frequent congestion. Recent advances in Connected and Autonomous Vehicle (CAV) technology enable signal-free intersections, where CAVs collaborate to cross intersections without collisions. Most existing signal-free intersection control methods focus on accommodating conflicts among vehicles inside the intersection and fixed-direction lanes are commonly adopted. However, the use of fixed-direction lanes is a legacy from conventional signalized intersections, where turning lanes are predetermined and fixed, so as to direct vehicles with different turning intentions to different lanes and avoid collisions. In this paper, we aim to make full utilization of the capacity of signal-free intersections by making use of free-direction lanes, which allow vehicles to make right, straight or left turns from any lane. To this end, we propose a cooperative multi-agent Deep Reinforcement Learning (DRL)-based control method for signal-free intersections with free-direction lanes. Specifically, we first study the problem of cooperatively determining coordination of vehicles inside the intersection and lane changes of vehicles on the incoming arms. Then, a multi-agent DRL-based control method for cooperatively determining coordination and lane-change of vehicles for signal-free intersections with free-direction lanes, named CD-CLC, is proposed for maximizing non-conflicting vehicles crossing the intersection simultaneously while taking vehicle fairness into consideration, to minimize travel delays of vehicles and improve traffic efficiency. Extensive experiments have been conducted to compare CD-CLC with other state-of-the-art methods to demonstrate the effectiveness of the proposed approach. © 2014 IEEE.