Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment by Zhang, Shiwei, Yi, Xiaodong, Diao, Lansong, Wu, Chuan, Wang, Siyu, Lin, Wei

Get full text

Optimizing DNN Compilation for Distributed Training With Joint OP and Tensor Fusion by Yi, Xiaodong, Zhang, Shiwei, Diao, Lansong, Wu, Chuan, Zheng, Zhen, Fan, Shiqing, Wang, Siyu, Yang, Jun, Lin, Wei

Get full text

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis by Zhang, Shiwei, Diao, Lansong, Wu, Chuan, Cao, Zongyan, Wang, Siyu, Lin, Wei

Get full text

Optimizing DNN Compilation for Distributed Training with Joint OP and Tensor Fusion by Yi, Xiaodong, Zhang, Shiwei, Diao, Lansong, Wu, Chuan, Zheng, Zhen, Fan, Shiqing, Wang, Siyu, Yang, Jun, Lin, Wei

Get full text

PAI-FCNN: FPGA Based Inference System for Complex CNN Models by Xia, Lixue, Diao, Lansong, Jiang, Zhao, Liang, Hao, Chen, Kai, Ding, Li, Dou, Shunli, Su, Zibin, Sun, Meng, Zhang, Jiansong, Lin, Wei

Request full text

Ada-Grouper: Accelerating Pipeline Parallelism in Preempted Network by Adaptive Group-Scheduling for Micro-Batches by Wang, Siyu, Cao, Zongyan, Chang, Si, Diao, Lansong, Wang, Jiamang, Lin, Wei

Get full text

Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment by Zhang, Shiwei, Yi, Xiaodong, Diao, Lansong, Wu, Chuan, Wang, Siyu, Lin, Wei

Get full text

Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform by Zhang, Shiwei, Diao, Lansong, Wang, Siyu, Cao, Zongyan, Gu, Yiliang, Chang, Si, Shi, Ziji, Zheng, Zhen, Wu, Chuan, Lin, Wei

Get full text

FusionStitching: Boosting Memory Intensive Computations for Deep Learning Workloads by Zheng, Zhen, Zhao, Pengzhan, Long, Guoping, Zhu, Feiwen, Zhu, Kai, Zhao, Wenyi, Diao, Lansong, Yang, Jun, Lin, Wei

Get full text

DISC: A Dynamic Shape Compiler for Machine Learning Workloads by Zhu, Kai, Zhao, Wenyi, Zheng, Zhen, Guo, Tianyou, Zhao, Pengzhan, Zhu, Feiwen, Bai, Junjie, Yang, Jun, Liu, Xiaoyong, Diao, Lansong, Lin, Wei

Get full text

Auto-MAP: A DQN Framework for Exploring Distributed Execution Plans for DNN Workloads by Wang, Siyu, Yi, Rong, Fan, Shiqing, Zheng, Zhen, Diao, LanSong, Long, Guoping, Yang, Jun, Liu, Xiaoyong, Lin, Wei

Get full text

DAPPLE: A Pipelined Data Parallel Approach for Training Large Models by Fan, Shiqing, Yi, Rong, Chen, Meng, Cao, Zongyan, Wang, Siyu, Zheng, Zhen, Wu, Chuan, Long, Guoping, Yang, Jun, Xia, Lixue, Diao, Lansong, Liu, Xiaoyong, Lin, Wei

Get full text