AutoScale-Automatic Prediction of Compute-optimal Data Composition for Training LLMs
Automatic prediction of compute-optimal data composition for efficient LLM training.
Feiyang Kang
•
•
1 min readRead more
Automatic prediction of compute-optimal data composition for efficient LLM training.