Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

ControlMap: Controllable HD Map Generation Using Latent Diffusion for Traffic Simulation Akasha 2 Achieves 4x Faster Visual Synthesis with Hamiltonian-Inspired AI Architecture PURe Module Enhances Vision Networks by Adding Multiplicative Local Interactions New Unified Definition of AI Hallucination Pins It on Inaccurate World Modeling Attention, Not Model Scale, Drives Human-AI Alignment in Multimodal Language Prediction, Research Finds LLM Manuscript Scoring System Validated Against Peer-Review Outcomes at Major AI Conference Semantic Pyramid Indexing: Adaptive Query Depth for Streaming RAG in Vector Databases Deep Neural Networks Formulated via Non-Archimedean Analysis Offer New Universal Approximation Capabilities TuneJury: Open Metric Improves Music Generation Preference Alignment SACE Framework Introduces First Scale-Aware Concept Erasure for Visual Autoregressive Models to Prevent Catastrophic Semantic Collapse ControlMap: Controllable HD Map Generation Using Latent Diffusion for Traffic Simulation Akasha 2 Achieves 4x Faster Visual Synthesis with Hamiltonian-Inspired AI Architecture PURe Module Enhances Vision Networks by Adding Multiplicative Local Interactions New Unified Definition of AI Hallucination Pins It on Inaccurate World Modeling Attention, Not Model Scale, Drives Human-AI Alignment in Multimodal Language Prediction, Research Finds LLM Manuscript Scoring System Validated Against Peer-Review Outcomes at Major AI Conference Semantic Pyramid Indexing: Adaptive Query Depth for Streaming RAG in Vector Databases Deep Neural Networks Formulated via Non-Archimedean Analysis Offer New Universal Approximation Capabilities TuneJury: Open Metric Improves Music Generation Preference Alignment SACE Framework Introduces First Scale-Aware Concept Erasure for Visual Autoregressive Models to Prevent Catastrophic Semantic Collapse

Home ›› Topics ›› transformers

Topic

transformers

2 stories

New Drift-RAE Method Distills Transformers Efficiently Using Representation Autoencoders

Artificial Intelligence #transformers#representation autoencoders

New Drift-RAE Method Distills Transformers Efficiently Using Representation Autoencoders

A new research paper proposes Drift-RAE, a method for distilling pretrained flow models in representation autoencoder latent spaces. It overcomes anisotropy and large curvature challenges, achieving 1.77 FID on ImageNet 256 with only 10,000 distillation steps, outperforming existing RAE distillation methods.

Jun 16, 2026 1 source

New Theory Explains How Deep Transformers Achieve Adaptive Inference Using Function Vectors

Artificial Intelligence #artificial intelligence#deep learning

New Theory Explains How Deep Transformers Achieve Adaptive Inference Using Function Vectors

A new research paper introduces a theory of deep transformers as mean-field interacting systems that implement distributed inference using 'function vectors' to adaptively infer latent context variables at finer scales over layers. The theory predicts a relationship between non-Gaussian hierarchical structure and transformer depth, tested with constrained linear attention models.

Jun 16, 2026 1 source