Chrome Extension

WeChat Mini Program

Use on ChatGLM

Log in

Academic Profile User Profile

My Following Paper Collections Browse History

Small-scale Proxies for Large-Scale Transformer Training Instabilities

Mitchell Wortsman,Peter J Liu,Lechao Xiao,Katie Everett,Alexander A Alemi,Ben Adlam,John D Co-Reyes,Izzeddin Gur,Abhishek Kumar,Roman Novak,Jeffrey Pennington,Jascha Sohl-Dickstein,Kelvin Xu,Jaehoon Lee,Justin Gilmer,Simon Kornblith

ICLR 2024（2024）

Cited 79|Views376

Key words

Small Transformers,Training,Stability

AI Read Science

Must-Reading Tree

Example

Generate MRT to find the research sequence of this paper

Chat Paper

Summary is being generated by the instructions you defined