Adaptive Video Streaming in Software-Defined Mobile Networks: A Deep Reinforcement Learning Approach

摘要

Both mobile edge cloud (MEC) and software-defined networking (SDN) are technologies for next generation mobile networks. In this paper, we simultaneously optimize energy consumption and quality of experience (QoE) in video streaming over software-defined mobile networks (SDMN) with MEC. Specifically, we propose to jointly consider buffer dynamics, video quality adaption, edge caching, video transcoding and transmission. We formulate two optimization problems which can be depicted as a constrained Markov decision process (CMDP) and a Markov decision process (MDP). Then we transform the CMDP problem into regular MDP by deploying Lyapunov technique. We utilize asynchronous advantage actor-critic (A3C) algorithm, one of the deep reinforcement learning (DRL) methods, to solve the corresponding MDP problems. Simulation results are presented to show that the proposed scheme can achieve the goal of energy saving and QoE enhancement with the corresponding constraints satisfied.