P/D-Serve: Serving Disaggregated Large Language Model at Scale by Jin, Yibo, Wang, Tao, Lin, Huimin, Song, Mingyang, Li, Peiyang, Ma, Yipeng, Shan, Yicheng, Yuan, Zhengfan, Li, Cailong, Sun, Yajing, Wu, Tiandeng, Chu, Xing, Ruizhi Huan, Li, Ma, You, Xiao, Zhou, Wenting, Ye, Yunpeng, Liu, Wen, Xu, Xiangkun, Zhang, Yongsheng, Dong, Tiantian, Zhu, Jiawei, Wang, Zhe, Ju, Xijian, Song, Jianxun, Cheng, Haoliang, Li, Xiaojing, Ding, Jiandong, Guo, Hefei, Zhang, Zhengyong

Get full text