iGEN
Visit IGEN World Explore IGEN Expo
EXPLORE UPGRADE PLANS
BREAKING
Explainable deep learning improves human mental models of self-driving cars, study finds SkillsBench Benchmark Measures How Agent Skills Boost LLM Performance Across Diverse Tasks PATCH Monitor Enables Robots to Handle Unexpected Disturbances During Manipulation Tasks Z-Plane Neural Networks Replace ReLU and LayerNorm with Bounded Geometric Activation APEC Climate Center Upgrades El Niño to Strong; Indian Monsoon Faces Elevated Risk New Architecture GRIL Enables Gradient Descent-Like Learning in Linear Recurrent Networks ToolSelf AI Agents Achieve 28.8 Point Gain Through Runtime Self-Reconfiguration ArtNet: JEPA-Like Articulatory Framework Achieves 20.56% Error Reduction in Zero-Shot Phoneme Recognition LLM-Assisted Stance Detection in Scientific Discourse Reaches 0.76 Combined Reliability Score New Drift-RAE Method Distills Transformers Efficiently Using Representation Autoencoders Explainable deep learning improves human mental models of self-driving cars, study finds SkillsBench Benchmark Measures How Agent Skills Boost LLM Performance Across Diverse Tasks PATCH Monitor Enables Robots to Handle Unexpected Disturbances During Manipulation Tasks Z-Plane Neural Networks Replace ReLU and LayerNorm with Bounded Geometric Activation APEC Climate Center Upgrades El Niño to Strong; Indian Monsoon Faces Elevated Risk New Architecture GRIL Enables Gradient Descent-Like Learning in Linear Recurrent Networks ToolSelf AI Agents Achieve 28.8 Point Gain Through Runtime Self-Reconfiguration ArtNet: JEPA-Like Articulatory Framework Achieves 20.56% Error Reduction in Zero-Shot Phoneme Recognition LLM-Assisted Stance Detection in Scientific Discourse Reaches 0.76 Combined Reliability Score New Drift-RAE Method Distills Transformers Efficiently Using Representation Autoencoders
Home ›› Topics ›› vision transformers

Topic

vision transformers

2 stories
Sub-Quadratic Vision Transformers Cut Self-Attention Cost for Faster Image Captioning Technology
Artificial Intelligence #vision transformers#image captioning

Sub-Quadratic Vision Transformers Cut Self-Attention Cost for Faster Image Captioning

A new arXiv preprint from Ghosh et al. proposes a sub-quadratic vision transformer architecture for image captioning. By replacing standard self-attention with a Gaussian Mixture Model (GMM) clustering mechanism, the model reduces computational complexity from quadratic O(n²) to linear O(nK). The approach uses an autoregressive GPT-based decoder and achieves competitive results on the Flickr30K dataset.

Jun 16, 2026 1 source
New Automated Quantization Framework AQ4SViT Compresses Spiking Vision Transformers for Embedded AI Technology
Artificial Intelligence #ai#quantization

New Automated Quantization Framework AQ4SViT Compresses Spiking Vision Transformers for Embedded AI

Researchers propose AQ4SViT, an automated quantization framework for Spiking Vision Transformers that uses a search gating policy to find optimal compression settings. It offers two variants: Greedy search for speed and Beam search for deeper compression. Experimental results on ImageNet show up to 6.6x faster search time and up to 90% memory savings while maintaining accuracy within 1.5% of the original model.

Jun 16, 2026 1 source