Autonomous Resource Allocation for QoS Enhancement in Next-Generation Heterogeneous Wireless Systems
Keywords:
Mobile Wireless Networks, Heterogeneous Networks (HetNet), Deep Reinforcement Learning (DRL), Autonomous Resource Allocation, Decision Support System (DSS).Abstract
The network heterogeneity, high dynamism of traffic demands, channel conditions and diverse Quality-of-Service (QoS) requirements in Beyond Fifth-Generation (B5G) and Sixth-Generation (6G) heterogeneous wireless networks create new difficulties for autonomous resource allocation. Static and reactive methods are not adaptable enough, and current learning based methods typically do not have a built-in mechanism for predicting, multi-objective, and temporally stable resource decisions. To fill this, this paper introduces a hybrid Decision Support System (DSS) for autonomous multi-objective resource allocation with Multi-Objective Optimization (MOOP), Deep Reinforcement Learning (DRL), Predictive Environment Model (PEM) and Stability-Aware Optimization (SAO) under a single decision-making framework. The proposed DSS integrates available network observation data with prediction of environmental conditions and is able to automatically infer resource-allocation decisions based on multiple and possibly competing criteria. DRL enables adaptive policy learning, PEM enables proactively making decisions for the future network state, MOOP enables balancing throughput, latency, fairness and energy efficiency, and SAO enables temporal consistency between successive allocation decisions. The framework also considers Signal-to-Interference-plus-Noise Ratio (SINR) and data rate to determine the quality of communication-links. A large number of simulation experiments are performed to compare the proposed DSS with static, reactive and conventional DRL-based resource-allocation methods. It shows that the results are better in the following aspects: Communication efficiency, Resource utilization, Latency, Fairness, and Energy efficiency. Convergence and temporal analyses also show quicker and more regular decision behavior and the SINR and data-rate analyses confirm better communication-link quality under the assumed operational conditions. As a whole, the results indicated that adding AL, PEWA, multi-objective optimization, and stability-aware decision-making to a DSS is a good way to autonomously manage the use of resources in a dynamic B5G and 6G wireless heterogeneous network while maintaining a balance between the conflicting goals.
Downloads
References
[1] Alwarafy, A., Abdallah, M., Ciftler, B. S., Al-Fuqaha, A., & Hamdi, M. (2021). Deep reinforcement learning for radio resource allocation and management in next generation heterogeneous wireless networks: A survey. arXiv preprint arXiv:2106.00574. https://doi.org/10.48550/arXiv.2106.00574
[2] Ariffin, A., Afifi, F., Zaki, F., Hanif, H., & Anuar, N. B. (2025). Federated learning in network traffic classification: Taxonomy of implementation, application, and impact on sixth-generation wireless networks. Engineering Applications of Artificial Intelligence, 158, 111471. https://doi.org/10.1016/j.engappai.2025.111471
[3] Baek, Y., Yoon, G., Kim, S., Kang, B., Lee, S., Choi, M.-i., & Park, S. (2026). Prediction-guided deep reinforcement learning for energy-efficient HVAC control with PICVs in smart buildings. Energy Reports, 15, 109040. https://doi.org/10.1016/j.egyr.2026.109040
[4] Benatia, M. A., Ben Abdelaziz, F., & Sahnoun, M. h. (2025). Energy savings and coverage optimization in edge WiFi sensor deployment for buildings: A multi-objective evolutionary approach. Energy Economics, 141, 108096. https://doi.org/10.1016/j.eneco.2024.108096
[5] Chen, Z., Liu, Y., Meng, Q., & Wang, W. (2026). Resource allocation in software-defined networks: Current status, research challenges, and future prospects. Computer Science Review, 61, 100964. https://doi.org/10.1016/j.cosrev.2026.100964
[6] Diamanti, M., Kapsalis, G., Tsiropoulou, E. E., & Papavassiliou, S. (2023). Energy-efficient rate-splitting multiple access: A deep reinforcement learning-based framework. IEEE Open Journal of the Communications Society, 4, 2397-2409. https://doi.org/10.1109/OJCOMS.2023.3322047
[7] Dutta, A., Roy, A., Saxena, N., & Weber, S. (2024). Predictive Optimal Channel Allocation in Integrated Sensing, Communication and Computation Systems. https://doi.org/10.1109/ISNCC62547.2024.10758937
[8] Ejaz, M., Asim, M., Wani, M. A., & Shakil, K. A. (2026). FAIR-DQL: Fairness-Aware Deep Q-Learning for Enhanced Resource Allocation and RIS Optimization in High-Altitude Platform Networks. Computers, Materials & Continua, 86(3), 29. https://doi.org/10.32604/cmc.2025.072464
[9] Etheredge, M., Aznar Poveda, J., Pedratscher, S., Younesi, A., & Fahringer, T. (2026). Pulse: Multi-objective scheduling of service-based applications in multi-cluster cloud–edge–IoT infrastructures. Journal of Network and Computer Applications, 248, 104439. https://doi.org/10.1016/j.jnca.2026.104439
[10] Fotio Tiotsop, L., Servetti, A., Barkowsky, M., Pocta, P., Mizdos, T., Van Wallendael, G., & Masala, E. (2023). Predicting individual quality ratings of compressed images through deep CNNs-based artificial observers. Signal Processing: Image Communication, 112, 116917. https://doi.org/10.1016/j.image.2022.116917
[11] Gadouh, K. A., & Sellami, H. K. (2024). Enhancing Virtualized Network Functions through Advanced Machine Learning for Efficient Resource Allocation and Dynamic Placement. 2024 IEEE/ACS 21st International Conference on Computer Systems and Applications (AICCSA), https://doi.org/10.1109/AICCSA63423.2024.10912551
[12] Gülmez, B. (2026). Artificial intelligence-driven smart grid optimization: A comprehensive review of machine learning, renewable integration, and cybersecurity applications. Energy Conversion and Management, 101849. https://doi.org/10.1016/j.ecmx.2026.101849
[13] Haider, Z., Ullah, I., Adel, A., Nasimov, R., & Memon, S. (2025). Artificial Intelligence (AI)-Enabled Unmanned Aerial Vehicle (UAV) Systems for Optimizing User Connectivity in Sixth-Generation (6G) Ubiquitous Networks. Computers, Materials & Continua, 86, 1-16. https://doi.org/10.32604/cmc.2025.071042
[14] Hamdi, W., Dağdeviren, O., & Bulut, H. (2025). QoS-aware Network Slicing and Resource Management for Internet of Vehicles in 5G networks. Ad Hoc Networks, 178, 103976. https://doi.org/10.1016/j.adhoc.2025.103976
[15] Haroon, M. S., Abbas, Z. H., Muhammad, F., & Abbas, G. (2020). Analysis of coverage-oriented small base station deployment in heterogeneous cellular networks. Physical Communication, 38, 100908. https://doi.org/10.1016/j.phycom.2019.100908
[16] Heydari, M., Niknam, T., & Parsa, N. (2026). A hierarchical deep learning and distributionally robust framework for urban multi-energy systems. Results in Engineering, 29, 108533. https://doi.org/10.1016/j.rineng.2025.108533
[17] Islam, M. M., Hasan, K., & Jeong, S. H. (2026). Performance evaluation and optimization for 6G networks: A survey of KPIs, Tools, and AI models. ICT Express, 12(2), 390-416. https://doi.org/10.1016/j.icte.2025.12.012
[18] Islam, T., & Noh, H. (2026). Access-rate enhancement for underlay many-to-many vehicular communications: QoS-aware resource sharing and power control. Ad Hoc Networks, 186, 104180. https://doi.org/10.1016/j.adhoc.2026.104180
[19] Jiao, L., Shao, Y., Sun, L., Liu, F., Yang, S., Ma, W., Li, L., Liu, X., Hou, B., & Zhang, X. (2024). Advanced deep learning models for 6G: Overview, opportunities, and challenges. ieee access, 12, 133245-133314. https://doi.org/10.1109/ACCESS.2024.3418900
[20] Kha, H. H., & Quyet, P. V. (2025). Multi-objective optimization for active IRS-aided multi-group multicast systems with energy harvesting, integrated sensing and communication. Physical Communication, 69, 102549. https://doi.org/10.1016/j.phycom.2024.102549
[21] Khan, A., Mohsan, S. A. H., Elfikky, A., Boghdady, A. I., Ahmad, S., & Innab, N. (2025). A survey of intelligent reflecting surfaces: Performance analysis, extensions, potential challenges, and open research issues. Vehicular Communications, 51, 100859. https://doi.org/10.1016/j.vehcom.2024.100859
[22] Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022). Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications. IEEE Journal on Selected Areas in Communications, 40(1), 5-36. https://doi.org/10.1109/JSAC.2021.3126076
[23] Lu, J., Shi, Z., Wang, Y., Pan, C., & Zhang, S. (2023). Multi-index evaluation learning-based computation offloading optimization for power internet of things. Physical Communication, 56, 101949. https://doi.org/10.1016/j.phycom.2022.101949
[24] Naguib, K. M., Ibrahim, I. I., Elmessalawy, M. M., & Abdelhaleem, A. M. (2024). Optimizing data transmission in 6G software defined networks using deep reinforcement learning for next generation of virtual environments. Scientific Reports, 14(1), 25695. https://doi.org/10.1038/s41598-024-75575-y
[25] Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., Niyato, D., Dobre, O., & Poor, H. V. (2021). 6G Internet of Things: A comprehensive survey. IEEE Internet of Things Journal, 9(1), 359-383. https://doi.org/10.1109/JIOT.2021.3103320
[26] Noor, K., Imoize, A. L., Adedosu Adelabu, M., & Lee, C.-C. (2025). A Comprehensive Survey on AI-Assisted Multiple Access Enablers for 6G and beyond Wireless Networks. CMES - Computer Modeling in Engineering and Sciences, 145(2), 1575-1664. https://doi.org/10.32604/cmes.2025.073200
[27] Qian, L. (2022). Joint Multi-domain Resource Allocation and Trajectory Optimization in UAV-assisted M-IoT Networks. TechRxiv, 2022(0105). https://doi.org/10.36227/techrxiv.17704463.v1
[28] Richa, Tyagi, A. K., & Nair, M. M. (2026). Artificial intelligence-enabled security systems for 6g wireless networks: Algorithms, strategies, and application. In J. B. Awotunde, A. K. Bhoi, P. Barsocchi, & V. H. C. de Albuquerque (Eds.), Fundamentals of Fog Computing and the Internet of Things for Smart Healthcare (pp. 87-100). Elsevier. https://doi.org/10.1016/B978-0-443-33439-9.00018-0
[29] Shafin, R., Liu, L., Chandrasekhar, V., Chen, H., Reed, J., & Zhang, J. C. (2020). Artificial intelligence-enabled cellular networks: A critical path to beyond-5G and 6G. IEEE Wireless Communications, 27(2), 212-217. https://doi.org/10.1109/MWC.001.1900323
[30] She, H., Yan, L., & Guo, Y. (2024). Efficient end–edge–cloud task offloading in 6G networks based on multiagent deep reinforcement learning. IEEE Internet of Things Journal, 11(11), 20260-20270. https://doi.org/10.1109/JIOT.2024.3372614
[31] Shome, S., Das, S., Das, S., & Pal, D. (2025). An extensive review of THz communication in 6G: Facilitating technologies with edge computing and native AI. Franklin Open, 13, 100434. https://doi.org/10.1016/j.fraope.2025.100434
[32] Singh, J., Bagga, S., & Kaur, R. (2026). Resource-efficient federated edge-AI over wireless edge networks for intelligent systems. Physical Communication, 76, 103131. https://doi.org/10.1016/j.phycom.2026.103131
[33] Sittakul, V., Ioannou, I., Nagaradjane, P., & Vassiliou, V. (2025). Intelligent congestion control in 5G URLLC Software-Defined Networks using adaptive resource management via Reinforced Dueling Deep Q-Networks. Journal of Network and Computer Applications, 242, 104276. https://doi.org/10.1016/j.jnca.2025.104276
[34] Sundaramoorthy, P., Parikh, M., Keshireddy, S. R., Penumatcha, A. K., & Jayabalan, K. (2025). Adaptive resource management in cloud-native databases: A study of autonomous scaling and query optimization. 2025 10th International Conference on Communication and Electronics Systems (ICCES), https://doi.org/10.1109/ICCES67310.2025.11336962
[35] Wang, X., Wu, P., Hu, Y., Cai, X., Song, Q., & Chen, H. (2023). Joint Trajectories and Resource Allocation Design for Multi-UAV-Assisted Wireless Power Transfer with Nonlinear Energy Harvesting. Drones, 7(6), 354. https://doi.org/10.3390/drones7060354
[36] Xu, Y., Xu, H., Chen, X., Zhang, H., Chen, B., & Han, Z. (2025). Blockchain-based AR offloading in UAV-enabled MEC networks: A trade-off between energy consumption and rendering latency. IEEE Transactions on Vehicular Technology, 74(11), 18065-18080. https://doi.org/10.1109/TVT.2025.3581015
[37] Yamsani, N., & Chenna Reddy, P. (2026). EdgeSched-DQN: An intelligent deep reinforcement learning-based framework for optimized task scheduling in edge-cloud environments. Array, 29, 100645. https://doi.org/10.1016/j.array.2025.100645
[38] Zhang, J., Yu, L., Liu, S., Cai, Y., Zhang, Y., Xing, H., & Jiang, T. (2025). Wireless Environmental Information Theory: A New Paradigm Toward 6G Online and Proactive Environment Intelligence Communication. Engineering. https://doi.org/10.1016/j.eng.2025.07.028
[39] Zhang, W., Zhan, D., Yu, H., Zhang, L., Zhao, B., Du, X., & Tian, Z. (2026). Distributed machine learning for next-generation communication networks: A survey on privacy, fairness, efficiency, and trade-offs. Information Fusion, 126, 103657. https://doi.org/10.1016/j.inffus.2025.103657
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Decision Making: Applications in Management and Engineering
This work is licensed under a Creative Commons Attribution 4.0 International License.
