Recurrent Looped Transformer

Depth that grows with the sequence. Each token extends the recurrent path through the full decoder. After \(t\) tokens, that path traverses \(tL_D\) decoder blocks while the per-token block count stay...