AHA · LOOPED TRANSFORMERSubmit a paper ↗
← Back to the collection
Adaptive depth ·

FPRM

Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformers

Sajad Movahedi, Vera Milovanović, Shlomo Libo Feigin, Alexander Theus, Thomas Hofmann, Valentina Boeva, T. Konstantin Rusch, Antonio Orvieto

Studies stable deep recurrence and fixed-point convergence as a stopping signal for structured reasoning.

Inside the method

[ State refinement ] → Fixed point

Simplified conceptual schematic. Consult the paper for the complete architecture.

Recurrence family
Adaptive depth
Depth control
Convergence-based halting
KV / state strategy
Task / variant dependent

Reading note

The public checkpoint collection includes convolutional variants. Check the specific architecture before equating it with the paper’s Transformer.

Sources checked 2026-09-15. This catalog does not imply independent reproduction.

Cite this work

@misc{fprm2026,
  title = {Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformers},
  author = {Sajad Movahedi and Vera Milovanović and Shlomo Libo Feigin and Alexander Theus and Thomas Hofmann and Valentina Boeva and T. Konstantin Rusch and Antonio Orvieto},
  year = {2026},
  eprint = {2606.18206},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.18206}
}

Suggest a correction ↗