Doing More Thinking per Token: Recurrent looped Transformers

Recurrent transformers can reuse the same model layers multiple times, allowing the model to refine a latent hidden state before generating the next token. Instead of expressing every intermediate…