Chrome Extension
WeChat Mini Program
Use on ChatGLM

Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models Via Malleable Data and Model Parallelization

Haoyang Li,Fangcheng Fu,Hao Ge, Sheng Lin, Xuanyu Wang, Jiawen Niu, Yujie Wang,Hailin Zhang,Xiaonan Nie,Bin Cui

CoRR(2024)

Cited 0|Views4
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined