谷歌浏览器插件
订阅小程序
在清言上使用
VIPCreated with Sketch.

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts.

Nan Du,Yanping Huang,Andrew M. Dai,Simon Tong,Dmitry Lepikhin,Yuanzhong Xu,Maxim Krikun,Yanqi Zhou,Adams Wei Yu,Orhan Firat,Barret Zoph,Liam Fedus,Maarten Bosma,Zongwei Zhou,Tao Wang,Yu Emma Wang,Kellie Webster,Marie Pellat,Kevin Robinson,Kathy Meier-Hellstern,Toju Duke,Lucas Dixon,Kun Zhang,Quoc V Le,Yonghui Wu,Zhifeng Chen,Claire Cui

International Conference on Machine Learning（2022）

引用 739|浏览686
关键词
language models,efficient scaling,mixture-of-experts
AI 理解论文
溯源树
样例
生成溯源树，研究论文发展脉络
Chat Paper
正在生成论文摘要