AHA · LOOPED TRANSFORMERSubmit a paper ↗
← Back to the collection
Adaptive depth ·

LoopFormer

LoopFormer: Elastic-Depth Looped Transformers for Latent Reasoning via Shortcut Modulation

Ahmadreza Jeddi, Marco Ciccone, Babak Taati

Conditions shared computation on time and step size to support elastic inference budgets.

Inside the method

h(t) → F(t, Δt) → h(t+Δt)

Simplified conceptual schematic. Consult the paper for the complete architecture.

Recurrence family
Adaptive depth
Depth control
Budget-conditioned depth
KV / state strategy
See implementation

Reading note

Adjustable budgets are distinct from automatically deciding when every token should stop.

Sources checked 2026-09-15. This catalog does not imply independent reproduction.

Cite this work

@misc{loopformer2026,
  title = {LoopFormer: Elastic-Depth Looped Transformers for Latent Reasoning via Shortcut Modulation},
  author = {Ahmadreza Jeddi and Marco Ciccone and Babak Taati},
  year = {2026},
  eprint = {2602.11451},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.11451}
}

Suggest a correction ↗