>10x More Efficient Pretraining — Magic

Research update on compute-efficient pretraining and scaling to trillion-parameter models.

Read in full here: