Chrome Extension
WeChat Mini Program
Use on ChatGLM

EdgeLLM: Fast On-device LLM Inference with Speculative Decoding

Daliang Xu, Wangsong Yin, Hao Zhang,Xin Jin,Ying Zhang, Shiyun Wei,Mengwei Xu,Xuanzhe Liu

IEEE Trans Mob Comput(2025)

Cited 0|Views18
Key words
Mobile Computing,Large Language Models,Speculative Decoding
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined