Topic
attention mechanism
Interpretable Sperm Morphology Classification via Attention-Guided Deep Learning
A study proposes an interpretable deep learning framework combining EfficientNet-B0 with a Convolutional Block Attention Module for sperm morphology classification, achieving 90.2% and 93.9% accuracy on SMIDS and HuSHem datasets respectively.
Lightweight Attention Mechanism Boosts Robust Multimodal Integration in Global Workspace Architecture
A new arXiv paper introduces a lightweight attention mechanism for multimodal integration in a global workspace architecture. The method improves robustness against corrupted modalities while using far fewer trainable parameters than end-to-end attention baselines. Tests on Simple Shapes and MM-IMDb 1.0 show transferable selection strategies across tasks and unseen modalities.
Reservoir Attention Network: Cross-Pass State in Pretrained Transformers via Content-Addressable Reservoir Injection
The Reservoir Attention Network (RAN) injects a fixed, randomly-initialized reservoir into mid-layer attention of pretrained transformers to carry state across forward passes. Experiments on GPT-2 and Qwen2.5 on a single consumer GPU show feasibility for cross-pass state, with broader always-alive agent vision as future work.
FreeSonic: Training-Free Audio Editing Framework Balances Background Preservation with Temporal Consistency
Researchers propose FreeSonic, a training-free framework leveraging the Rectified Flow-based TangoFlux model for precise audio editing. It uses an optimized inversion-reverse process and joint text-audio attention maps for target segment extraction, with scheduled attention decoupling to preserve background context. The method demonstrates high-fidelity, efficient audio editing including removal and non-rigid replacement.