Chrome Extension
WeChat Mini Program
Use on ChatGLM
VIPCreated with Sketch.

D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

Haoran Que,Jiaheng Liu,Ge Zhang,Chenchen Zhang,Xingwei Qu,Yinghao Ma,Feiyu Duan, ZhiqiBai, JiakaiWang,Yuanxing Zhang,Xu Tan,Jie Fu,Jiamang Wang,Lin Qu,Wenbo Su,Bo Zheng

NeurIPS 2024（2024）

Cited 16|Views37
Key words
Large Language Models,Scaling Law,Continual Pre-training
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined