Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
arxiv（2025）
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined