Demystifying the Communication Characteristics for Distributed Transformer Models
2024 IEEE SYMPOSIUM ON HIGH-PERFORMANCE INTERCONNECTS, HOTI 2024（2024）
关键词
Neural Networks,DNN,MPI,GPU,Large Language Models,Interconnects,Communication Characterization
AI 理解论文
溯源树
样例
生成溯源树，研究论文发展脉络
Chat Paper
正在生成论文摘要