Generative AI in Data Center Networking: Fundamentals, Perspectives, and Case Study

Abstract

Generative AI (GenAI), exemplified by Large Language Models (LLMs), such as OpenAI’s ChatGPT, is revolutionizing various fields. Central to this transformation is Data Center Networking (DCN), which not only provides the infrastructure support for GenAI operation, but also provisions GenAI services to users. Hence, this article explores the interplay between GenAI and DCNs, analyzing their symbiotic relationship and mutual advances. We begin by reviewing the current challenges of DCNs and GenAI-based solutions, such as data augmentation, process automation, and domain transfer. We then discuss the distinctive characteristics of GenAI workloads on DCNs, gaining insights that catalyze the evolution of DCNs to more effectively support GenAI. Moreover, to illustrate the seamless integration of GenAI with DCNs, we present a case study on GenAI-empowered DCN digital twins. Specifically, we employ an LLM equipped with retrieval augmented generation to formulate optimization problems for DCNs (e.g., resource allocation and routing) and adopt diffusion-deep reinforcement learning to solve optimization. The experimental results on a representative DCN optimization problem, i.e., knowledge placement, demonstrate the validity and efficiency of our proposals. We anticipate that this article can promote further research to enhance the virtuous interaction between GenAI and DCNs.