Improving the Congestion Control Performance for Mobile Networks in High-Speed Railway via Deep Reinforcement Learning

摘要

Due to the poor Transmission Control Protocol (TCP) performance in high-speed mobile scenarios, passengers have bad network experiences on High-Speed Railway (HSR). As a result, improving network performance for HSR scenarios has become urgent and widespread concerns. Some previous works quantitatively analyzed the TCP performance on HSR and proposed relevant solutions. Other works focused on the handover problem (the leading cause of poor network performance on HSR), and proposed a series of handover algorithms for HSR scenarios. However, the existing works are either limited to only measurement studies without algorithm implementation or lack of integration with real-world scenarios. In this paper, with a large amount of field measurement data in real HSR networks, we study the main reasons why traditional TCP performs poorly in HSR scenarios. To improve the TCP performance, we propose Hd-TCP, a customized Congestion Control (CC) algorithm designed to deal with frequent handover on HSR from the transport layer perspective. For the transmission characteristic on HSR, Hd-TCP can accurately evaluate the link condition and apply a Deep Reinforcement Learning (DRL) method to make a fine control. The simulation results show that Hd-TCP outperforms traditional CC algorithms in both throughput and latency by fully utilizing the transmission gap between handovers.