Digital Twin-Based Deep Q-Learning Strategy for Smart Handover Optimization in 5G/6G Networks

Handover management in 5G/6G networks presents significant challenges mainly due to ultradense deployments, high mobility and diversity of scenarios. This work presents a digital twin-based Deep Q-Learning (DQL) strategy to optimize handover processes and resource management in these networks. It is proposed to consider digital twins to support the implementation of real-time network conditions where DQL agents are trained to improve quality of service (QoS) parameters related to throughput. The suggested approach, deployed with the ns-3 mmWave module and ns3-ai framework, shows relevant benefits, including reduced handovers. Moreover, the consideration of digital twins allows adaptive learning and scalability, allowing networks to respond more effectively to dynamic user behavior and environmental modifications. These results underline the potential of combining DQL and digital twins as an efficient solution for smart handover management, and thus, for sustainable and efficient communication in 5G/6G networks.