Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

MatchLM2Lite: Scalable MLLM-Lite Framework Cuts Reproduced Video Views by 2.5% AIChilles Automatically Unearths Hidden Weaknesses in AI-Evolved Programs Vernier Research Reveals Why Language Models Give Inconsistent Answers to Causal Questions After Variable Renaming RAG and LLMs Combined to Generate Personalized Reading Content at Desired Complexity Unassigned Agents in Multi-Agent Path Finding Addressed by Compilation-Based Solvers New Framework Reduces Visual Hallucinations in Multimodal AI Systems Without Retraining MAF Framework Dynamically Optimizes Prompting for Multimodal Sentiment Analysis Study on Pedestrian Attribute Recognition Identifies Sparsity Wall and Optimizes Edge Deployment AI Framework Targets 50% Water Loss in Jordan with LLM and Digital Twin Integration AnonShield: Scalable On-Premise Pseudonymization Cuts Vulnerability Data Processing from 92 Hours to Under 10 Minutes MatchLM2Lite: Scalable MLLM-Lite Framework Cuts Reproduced Video Views by 2.5% AIChilles Automatically Unearths Hidden Weaknesses in AI-Evolved Programs Vernier Research Reveals Why Language Models Give Inconsistent Answers to Causal Questions After Variable Renaming RAG and LLMs Combined to Generate Personalized Reading Content at Desired Complexity Unassigned Agents in Multi-Agent Path Finding Addressed by Compilation-Based Solvers New Framework Reduces Visual Hallucinations in Multimodal AI Systems Without Retraining MAF Framework Dynamically Optimizes Prompting for Multimodal Sentiment Analysis Study on Pedestrian Attribute Recognition Identifies Sparsity Wall and Optimizes Edge Deployment AI Framework Targets 50% Water Loss in Jordan with LLM and Digital Twin Integration AnonShield: Scalable On-Premise Pseudonymization Cuts Vulnerability Data Processing from 92 Hours to Under 10 Minutes

Home ›› Topics ›› code generation

Topic

code generation

1 story

Auditing Reward Hackability in Code RL Training Environments Reveals 28.5% Weak Test Suites

Artificial Intelligence #auditing#reward hackability

Auditing Reward Hackability in Code RL Training Environments Reveals 28.5% Weak Test Suites

A research paper by Rajan on arXiv measures reward hackability in code reinforcement learning (RL) training environments. On a 49-task sample of SWE-bench Verified, 28.5% of tasks have test suites weak enough that a Docker-verified incorrect patch passes them. The study also proposes a hardening procedure using an LLM judge and Docker gate to detect defects.

Jun 16, 2026 1 source