Artificial Intelligence #reservoir attention network#cross-pass state
Reservoir Attention Network: Cross-Pass State in Pretrained Transformers via Content-Addressable Reservoir Injection
The Reservoir Attention Network (RAN) injects a fixed, randomly-initialized reservoir into mid-layer attention of pretrained transformers to carry state across forward passes. Experiments on GPT-2 and Qwen2.5 on a single consumer GPU show feasibility for cross-pass state, with broader always-alive agent vision as future work.
Jun 16, 2026 1 source