IAAIDepth Control Protocol
Beyond Depth Truncation: Controlled Evaluation of Depth Utilization in Recursive Language Models
Argues that the standard depth-truncation curve conflates fewer block applications, less distinct computation and an out-of-distribution readout. The Depth Control Protocol adds positive and negative controls, including running the full budget while executing only one distinct iteration, to measure whether a recurrent model really uses its depth.
Inside the method
Simplified conceptual schematic. Consult the paper for the complete architecture.
- Recurrence family
- Core recurrence
- Depth control
- Evaluation methodology
- KV / state strategy
- See paper
Reading note
The key control is only realizable in weight-shared architectures. Includes dense-transformer negative controls and a training intervention to check causality.
Sources checked 2026-10-28. This catalog does not imply independent reproduction.
Related works
Cite this work
@misc{depthcontrolprotocol2026,
title = {Beyond Depth Truncation: Controlled Evaluation of Depth Utilization in Recursive Language Models},
author = {Ha Van Dau and Thanh Tung Khuat and Nguyen Thanh Dung},
year = {2026},
eprint = {2609.19934},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.19934}
}