Chrome Extension
WeChat Mini Program
Use on ChatGLM

Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

Ruoyu Qin, Zheming Li,Weiran He,Mingxing Zhang,Yongwei Wu,Weimin Zheng, Xinran Xu

CoRR(2024)

Cited 0|Views138
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined