iGEN
Visit IGEN World Explore IGEN Expo
EXPLORE UPGRADE PLANS
BREAKING
LLM-WikiRace Benchmark Reveals Frontier AI Models Still Struggle with Planning Over Knowledge Graphs New Research Demystifies Variance in Circuit Discovery of Large Language Models PISA Memory System Draws on Cognitive Psychology to Boost AI Agent Adaptability New Multi-Scale Two-Stream Framework Aims to Decouple Semantics from Distortions in AI-Generated Image Quality Assessment P3B3 Benchmark Reveals Strong Brazilian Portuguese Bias in Large Language Models Controlled Dynamics Attractor Transformer: New Model Targets Graph Anomaly Detection with Biologically Plausible Attention Tamil Nadu OE Spinning Mills Threaten 50% Production Cut Over High Cotton Waste Prices BridgePolicy: New Diffusion Bridge Method Improves Visuomotor Policy Learning in Robotics New Theory Explains How Deep Transformers Achieve Adaptive Inference Using Function Vectors PVminerLLM2 Uses Preference Optimization to Improve Structured Patient Voice Extraction LLM-WikiRace Benchmark Reveals Frontier AI Models Still Struggle with Planning Over Knowledge Graphs New Research Demystifies Variance in Circuit Discovery of Large Language Models PISA Memory System Draws on Cognitive Psychology to Boost AI Agent Adaptability New Multi-Scale Two-Stream Framework Aims to Decouple Semantics from Distortions in AI-Generated Image Quality Assessment P3B3 Benchmark Reveals Strong Brazilian Portuguese Bias in Large Language Models Controlled Dynamics Attractor Transformer: New Model Targets Graph Anomaly Detection with Biologically Plausible Attention Tamil Nadu OE Spinning Mills Threaten 50% Production Cut Over High Cotton Waste Prices BridgePolicy: New Diffusion Bridge Method Improves Visuomotor Policy Learning in Robotics New Theory Explains How Deep Transformers Achieve Adaptive Inference Using Function Vectors PVminerLLM2 Uses Preference Optimization to Improve Structured Patient Voice Extraction
Home ›› Topics ›› knowledge distillation

Topic

knowledge distillation

2 stories
New Algorithm for Multi-Turn AI Agents Reduces Compounding Errors in Knowledge Distillation Technology
Artificial Intelligence #on-policy distillation#curriculum learning

New Algorithm for Multi-Turn AI Agents Reduces Compounding Errors in Knowledge Distillation

A new algorithm called Guided On-Policy Distillation (Guided-OPD) addresses the failure mode where small student models compound errors in multi-turn tasks. By mixing teacher and student turns and using a curriculum that decays teacher intervention, the method improves average score by 21.1% and success rate by 25.5% over vanilla OPD.

Jun 16, 2026 1 source
Improved Knowledge Distillation Framework Achieves 99.04% Accuracy for Land-Use Classification Technology
Artificial Intelligence #knowledge distillation#land-use classification

Improved Knowledge Distillation Framework Achieves 99.04% Accuracy for Land-Use Classification

A research paper on arXiv presents an improved knowledge distillation framework for compressing deep neural networks used in land-use image classification. By integrating hard label supervision with soft losses (KL divergence and cosine similarity), the method achieves 99.04% accuracy on three land-use datasets, outperforming baseline and single-loss distillation approaches while substantially reducing model size.

Jun 16, 2026 1 source