IAAIRotate the Loop
Rotate the Loop: Blockwise Conformality for Looped Transformers
Treats whether a loop can track state as a geometric question about the linear map applied to the residual between steps. Blockwise conformal injections split the residual into groups and rotate within each, giving each group its own timescale while keeping exact geometry.
Inside the method
[ Block ] × R with residual → blockwise rotations between steps
Simplified conceptual schematic. Consult the paper for the complete architecture.
- Recurrence family
- Core recurrence
- Depth control
- Runtime-adjustable recurrent steps
- KV / state strategy
- See paper
Reading note
Improves last-token state-tracking accuracy and language modeling where an early signal must be retrieved at the end of the sequence.
Sources checked 2026-10-28. This catalog does not imply independent reproduction.
Related works
Cite this work
@misc{blockwiseconformalinjection2026,
title = {Rotate the Loop: Blockwise Conformality for Looped Transformers},
author = {Alexey Zemtsov and Albina Klepach and Vadim Lomshakov and Andrei Polubarov and Nikita Lyubaykin and Alexander Derevyagin and Vladislav Kurenkov and Alexander Nikulin},
year = {2026},
eprint = {2610.14030},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.14030}
}