Chrome Extension
WeChat Mini Program
Use on ChatGLM

FastPTM: Fast Weights Loading of Pre-Trained Models for Parallel Inference Service Provisioning

Fenglong Cai,Dong Yuan, Zhe Yang,Yonghui Xu,Wei He,Wei Guo,Lizhen Cui

PARALLEL COMPUTING(2024)

Cited 0|Views5
Key words
Parallel inference,Pre-trained models,Service provisioning
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined