Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

Uncertainty Quality of VGGT: Analysis on DTU Benchmark Dataset Reveals Effective Confidence Threshold for 3D Reconstruction New Diffusion Model Learns Permutation Distributions with Softer, More Tractable Trajectories RidgeCut: Reinforcement Learning Framework Optimizes Logistics Network Partitioning with Rings and Wedges SDS-LoRA: New Low-Rank Adaptation Method Fixes Gradient Distortion in Large Model Fine-Tuning NeuronFabric Architecture Cuts Memory for On-Chip Transformer Training, Promises Efficient Edge AI Kharif Pulses Sowing Off to a Weak Start: Acreage Down 43% as of June 12 Self-Gated Clarification Method Boosts AI Accuracy in Complex Tariff Classification Tyler Framework Boosts LLM Reasoning by Up to 14 Points with Smarter Compute Allocation ResVLA Anchors Generative Policies with Residual Bridges to Reduce Noise and Speed Robot Learning MA-ProofBench: New Benchmark Tests LLMs on Formal Theorem Proving in Mathematical Analysis Uncertainty Quality of VGGT: Analysis on DTU Benchmark Dataset Reveals Effective Confidence Threshold for 3D Reconstruction New Diffusion Model Learns Permutation Distributions with Softer, More Tractable Trajectories RidgeCut: Reinforcement Learning Framework Optimizes Logistics Network Partitioning with Rings and Wedges SDS-LoRA: New Low-Rank Adaptation Method Fixes Gradient Distortion in Large Model Fine-Tuning NeuronFabric Architecture Cuts Memory for On-Chip Transformer Training, Promises Efficient Edge AI Kharif Pulses Sowing Off to a Weak Start: Acreage Down 43% as of June 12 Self-Gated Clarification Method Boosts AI Accuracy in Complex Tariff Classification Tyler Framework Boosts LLM Reasoning by Up to 14 Points with Smarter Compute Allocation ResVLA Anchors Generative Policies with Residual Bridges to Reduce Noise and Speed Robot Learning MA-ProofBench: New Benchmark Tests LLMs on Formal Theorem Proving in Mathematical Analysis

Home ›› Topics ›› attention mechanism

Topic

attention mechanism

2 stories

Reservoir Attention Network: Cross-Pass State in Pretrained Transformers via Content-Addressable Reservoir Injection

Artificial Intelligence #reservoir attention network#cross-pass state

Reservoir Attention Network: Cross-Pass State in Pretrained Transformers via Content-Addressable Reservoir Injection

The Reservoir Attention Network (RAN) injects a fixed, randomly-initialized reservoir into mid-layer attention of pretrained transformers to carry state across forward passes. Experiments on GPT-2 and Qwen2.5 on a single consumer GPU show feasibility for cross-pass state, with broader always-alive agent vision as future work.

Jun 16, 2026 1 source

FreeSonic: Training-Free Audio Editing Framework Balances Background Preservation with Temporal Consistency

Artificial Intelligence #freesonic#audio editing

FreeSonic: Training-Free Audio Editing Framework Balances Background Preservation with Temporal Consistency

Researchers propose FreeSonic, a training-free framework leveraging the Rectified Flow-based TangoFlux model for precise audio editing. It uses an optimized inversion-reverse process and joint text-audio attention maps for target segment extraction, with scheduled attention decoupling to preserve background context. The method demonstrates high-fidelity, efficient audio editing including removal and non-rigid replacement.

Jun 16, 2026 1 source