Chrome Extension
WeChat Mini Program
Use on ChatGLM
AI Reads Science
Chat
编组 4Search
Chat
编组 3ChatPaper

57,299,488

Researchers

310,287,489

Publications

8,933,684

Concepts

2,217,086,385

Citations
Follow
Explore
Report
Trend
Topic
Hardware-Aligned and Natively Trainable Sparse Attention
The latest paper from DeepSeek introduces a new attention mechanism — NSA, a locally trainable sparse attention mechanism for ultra-fast long-context training and inference.
YiFan Zhang,Shanglin Lei,Runqi Qiao,Zhuoma GongQue,Xiaoshuai Song,Guanting Dong, Qiuna Tan, Zhe Wei, Peiqing Yang, Ye Tian, Yadong Xue, Xiaofei Wang,
CoRR (2024)
Cited0Views8485
Download
Bibtex
ChatPaper
4.5 Star
0
8485
Computing Research Repository (2024)
Cited6Views1445
Download
Bibtex
ChatPaper
Rate
6
1445
Expand all 5 New Papers
Topic
Mixture of Block Attention for Long-Context LLMs
Kimi proposed a new attention mechanism, MoBA, which combines the principles of MoE and improves the efficiency of LLMs in long-text scenarios without sacrificing performance.
Minghao Xu, Lichuan Xiang,Xu Cai,Hongkai Wen
CoRR (2024)
Cited2Views1524
Download
Bibtex
ChatPaper
Rate
2
1524
Benjamin Warner, Antoine Chaffin,Benjamin Clavié,Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas,Faisal Ladhak, Tom Aarsen,Nathan Cooper,Griffin Adams,
CoRR (2024)
Cited63Views1065
Download
Bibtex
ChatPaper
Rate
63
1065
Frank F. Xu, Yufan Song, Boxuan Li, Yuxuan Tang, Kritanjali Jain, Mengxue Bao, Zora Z. Wang,Xuhui Zhou, Zhitong Guo, Murong Cao, Mingyang Yang, Hao Yang Lu,
Computing Research Repository (2024)
Cited18Views903
Download
Bibtex
ChatPaper
Rate
18
903
Expand all 5 New Papers

Loading more RecommendationsGet more recommendations Load MoreAdd KeywordSet your interests to get accurate recommendation

gongan
期刊/会议
查看更多期刊/会议
京ICP备20011824号-11gongan京公网安备11010802035176号© 2005-2025 AMiner