AHA · LOOPED TRANSFORMERSubmit a paper ↗
← Back to the collection
Full-stack recurrence ·

Learning to Learn with Loops

Looped Transformers are Better at Learning Learning Algorithms

Liu Yang, Kangwook Lee, Robert Nowak, Dimitris Papailiopoulos

Studies how looping encourages Transformers to learn iterative learning algorithms in context.

Inside the method

[ Shared Transformer ] × R

Simplified conceptual schematic. Consult the paper for the complete architecture.

Recurrence family
Full-stack recurrence
Depth control
Iteration budget
KV / state strategy
Task-specific experimental setup

Reading note

A controlled algorithm-learning study, rather than a general-purpose chat model.

Sources checked 2026-09-15. This catalog does not imply independent reproduction.

Cite this work

@misc{learningalgorithms2023,
  title = {Looped Transformers are Better at Learning Learning Algorithms},
  author = {Liu Yang and Kangwook Lee and Robert Nowak and Dimitris Papailiopoulos},
  year = {2023},
  eprint = {2311.12424},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2311.12424}
}

Suggest a correction ↗