Preprint / Version 1

The Reinforcement Learning (RL) Based SFC Request Scheduling in Computer Networks

##article.authors##

  • Eesha Nagireddy Univ

DOI:

https://doi.org/10.58445/rars.409

Keywords:

RL Models, SFC chain, Deep-Q-Network, Dijkstra’s Algorithm

Abstract

This study investigates the use of Reinforcement Learning (RL) to minimize the latency between the source and destination of SFC requests in Neural Networks. This problem gains relevancy owing to Service Function Chaining (SFC) becoming a fundamental concept in modern computer networks to efficiently route and process network traffic through a sequence of specialized network functions. The approach utilizes Deep-Q-Network (DQN) reinforcement learning to determine the shortest path between two nodes using the Greedy-Simulated Annealing (GSA) Dijkstra's Algorithm. The containers within the SFC chain help train the model based on bandwidth restrictions (fiber networks) to optimize the different pathways in terms of action space. Through rigorous evaluation of varying action spaces in models, we assessed the predictive accuracy of each model based on reward-request relationships graphed. A scheduling agent can then manipulate this algorithm to handle maximum scheduling pathways. The findings offer practical implications for reinforcement learning (RL) that can be applied to request scheduling in computer networks to optimize resource allocation, improve the quality of service, and enhance network performance.

References

D. Rachmawati, L. Gustin. (2020). Analysis of Dijkstra's Algorithm and A* Algorithm in Shortest Path Problem. Journal of Physics: Conference Series, 1566, 26-27. doi: https://doi.org/10.1088/1742-6596/1566/1/012061

Y. Wu, J. Zhou. (2021). Dynamic Service Function Chaining Orchestration in a Multi-Domain: A Heuristic Approach Based on SRv6. National Library of Medicine, 21 (19), 26-27. doi: https://doi.org/10.3390/s21196563

T. O. Omotehinwa. (2022). Examining the developments in scheduling algorithms research: A bibliometric approach. Heliyon, 5 (8), 9510. doi: https://doi.org/10.1016/j.heliyon.2022.e09510

S. Zheng, C. Zheng and W. Li(2022). Research on Multi-objective Shortest Path Based on Genetic Algorithm. International Conference on Computer Science and Blockchain (CCSB), 2 , 127-130. doi: https://doi.org/10.1109/CCSB58128.2022.00030

Downloads

Posted

2023-09-12