Research update on compute-efficient pretraining and scaling to trillion-parameter models.
Read in full here: