WeChat Mini Program
Old Version Features

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts

Qizhen Zhang,Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo,David Cairuz,Bharat Venkitesh,Jakob Nicolaus Foerster,Phil Blunsom,Sebastian Ruder,Ahmet Üstün,Acyr Locatelli

NeurIPS 2024（2024）

Cited 5|Views10
Key words
Mixture of Experts,Large Language Models
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined