SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification
International Conference on Architectural Support for Programming Languages and Operating Systems（2024）
关键词
Statistical Language Modeling,Language Modeling,Sequence-to-Sequence Learning,Speaker Verification,Neural Machine Translation
AI 理解论文
溯源树
样例
生成溯源树，研究论文发展脉络
Chat Paper
正在生成论文摘要