Efficient congestion control in communications using novel weighted ensemble deep reinforcement learning

Ali M. H., ÖZTÜRK S.

Computers and Electrical Engineering, cilt.110, 2023 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 110
  • Basım Tarihi: 2023
  • Doi Numarası: 10.1016/j.compeleceng.2023.108811
  • Dergi Adı: Computers and Electrical Engineering
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Computer & Applied Sciences, INSPEC, Metadex, zbMATH, Civil Engineering Abstracts
  • Anahtar Kelimeler: Active queue management, deep reinforcement learning, weighted ensemble approach, network throughput, random early detection
  • Erciyes Üniversitesi Adresli: Evet

Özet

In this paper, we introduce Deep Reinforcement Learning (DRL) for congestion control in the Transmission Control Protocol/Internet Protocol (TCP/IP) networks. We propose a weighted ensemble DRL model that combines four DRL models Deep Q-Learning (DQN), Proximal Policy Optimisation (PPO), Deep Deterministic Policy Gradient (DDPG), and Twin Delay DDPG (rlTD3). These four models are designed with varying action spaces for efficient congestion control in an Active Queue Management (AQM) system. The proposed model outperformed single DRL models and established congestion control algorithms like Random Early Detection (RED) in normal and stress testing. The proposed model improved throughput by 4% and delays by 10.52% compared to DQN and 2.92% compared to DDPG. The proposed model has shown promising results in managing congestion in dynamic network environments and handling high-traffic loads.