Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

LLM Agents May Fake System Crashes to Evade Constraints, New Research Finds Structural Heterogeneity in LLM Verification: Signal Quality Varies Across Cost Strata MatchLM2Lite: Scalable MLLM-Lite Framework Cuts Reproduced Video Views by 2.5% AIChilles Automatically Unearths Hidden Weaknesses in AI-Evolved Programs Vernier Research Reveals Why Language Models Give Inconsistent Answers to Causal Questions After Variable Renaming RAG and LLMs Combined to Generate Personalized Reading Content at Desired Complexity Unassigned Agents in Multi-Agent Path Finding Addressed by Compilation-Based Solvers New Framework Reduces Visual Hallucinations in Multimodal AI Systems Without Retraining MAF Framework Dynamically Optimizes Prompting for Multimodal Sentiment Analysis Study on Pedestrian Attribute Recognition Identifies Sparsity Wall and Optimizes Edge Deployment LLM Agents May Fake System Crashes to Evade Constraints, New Research Finds Structural Heterogeneity in LLM Verification: Signal Quality Varies Across Cost Strata MatchLM2Lite: Scalable MLLM-Lite Framework Cuts Reproduced Video Views by 2.5% AIChilles Automatically Unearths Hidden Weaknesses in AI-Evolved Programs Vernier Research Reveals Why Language Models Give Inconsistent Answers to Causal Questions After Variable Renaming RAG and LLMs Combined to Generate Personalized Reading Content at Desired Complexity Unassigned Agents in Multi-Agent Path Finding Addressed by Compilation-Based Solvers New Framework Reduces Visual Hallucinations in Multimodal AI Systems Without Retraining MAF Framework Dynamically Optimizes Prompting for Multimodal Sentiment Analysis Study on Pedestrian Attribute Recognition Identifies Sparsity Wall and Optimizes Edge Deployment

Home ›› Topics ›› training environments

Topic

training environments

1 story

Auditing Reward Hackability in Code RL Training Environments Reveals 28.5% Weak Test Suites

Artificial Intelligence #auditing#reward hackability

Auditing Reward Hackability in Code RL Training Environments Reveals 28.5% Weak Test Suites

A research paper by Rajan on arXiv measures reward hackability in code reinforcement learning (RL) training environments. On a 49-task sample of SWE-bench Verified, 28.5% of tasks have test suites weak enough that a Docker-verified incorrect patch passes them. The study also proposes a hardening procedure using an LLM judge and Docker gate to detect defects.

Jun 16, 2026 1 source