You could have invented transformers from memory

Every layer is a memory store

Read in full here: