Chrome Extension
WeChat Mini Program
Use on ChatGLM
VIPCreated with Sketch.

Accelerating Retrieval-Augmented Language Model Serving with Speculation

Zhihao Zhang,Alan Zhu,Lijie Yang,Yihua Xu,Lanting Li,Phitchaya Mangpo Phothilimthana,Zhihao Jia

ICLR 2024（2024）

Cited 15|Views17
Key words
Retrieval-augmented Language Models,Model Inference Acceleration,Speculative Execution
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined