Effect of reinforcement learning on routing of cognitive radio ad-hoc networks

摘要

Today's network control systems have very limited ability to adapt the changes in network. The addition of reinforcement learning (RL) based network management agents can improve Quality of Service (QoS) by reconfiguring the network layer protocol parameters in response to observed network performance conditions. This paper presents a closed-loop approach to tuning the parameters of the protocol of network layer based on current and previous network state observation for user and channel interference, specifically by modifying some parameters of Ad-Hoc On-Demand Distance Vector (AODV) routing protocol for Cognitive Radio Ad-Hoc Network (CRAHN) environment. In this work, we provide a self-contained learning method based on machine-learning techniques that have been or can be used for developing cognitive routing protocols. Generally, the developed mathematical model based on the one RL technique to handle the route decision in channel switching and user mobility situation so that the overall end-to-end delay can be minimized and the overall throughput of the network can be maximized according to the application requirement in CRAHN environment. Here is the proposed self-configuration method based on RL technique can improve the performance of the original AODV protocol, reducing protocol overhead and end-to-end delay for CRAHN while increasing the packet delivery ratio depending upon the traffic model. Simulation results are shown using NS-2 which shows the proposed model performance is much better than the previous AODV protocol.