Transcending Scaling Laws with 0.1% Extra Compute

Corresponding tweet for this thread:

Share link for this tweet.