← All works
Adaptive depth

Loop-ViT

LoopViT: Scaling Visual ARC with Looped Transformers

Wen-Jie Shu, Xuerui Qiu, Rui-Jie Zhu, Harold Haodong Chen, Yexin Liu, Harry Yang

A recursive vision architecture for ARC-AGI that iterates a weight-tied hybrid block of local convolutions and global attention as a latent chain of thought, with a parameter-free dynamic exit when predictive entropy shows the state has settled.

Inside the method

Grid → [ Weight-tied conv + attention block ] × r (entropy exit) → output grid

Simplified conceptual schematic. Consult the paper for the complete architecture.

Recurrence family
Adaptive depth
Depth control
Parameter-free entropy-based dynamic exit
KV / state strategy
Not applicable (vision model)

Reading note

An 18M model reaches 65.8% on ARC-AGI-1, outperforming 73M-parameter ensembles.

Sources checked 2026-10-28. This catalog does not imply independent reproduction.

Related works

Cite this work

@misc{loopvit2026,
  title = {LoopViT: Scaling Visual ARC with Looped Transformers},
  author = {Wen-Jie Shu and Xuerui Qiu and Rui-Jie Zhu and Harold Haodong Chen and Yexin Liu and Harry Yang},
  year = {2026},
  eprint = {2602.02156},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.02156}
}

Suggest a correction on GitHub ↗