Chrome Extension
WeChat Mini Program
Use on ChatGLM
VIPCreated with Sketch.

Enhancing On-Device LLM Inference with Historical Cloud-Based LLM Interactions

Yucheng Ding,Chaoyue Niu,Fan Wu,Shaojie Tang,Chengfei Lyu,Guihai Chen

KDD 2024（2024）

Cited 5|Views23
Key words
On-Device LLM Inference,Historical Interactions,Cloud-Based LLM,Datastore Subset Selection,Performance Efficiency
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined