Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

New Framework Reduces Visual Hallucinations in Multimodal AI Systems Without Retraining MAF Framework Dynamically Optimizes Prompting for Multimodal Sentiment Analysis Study on Pedestrian Attribute Recognition Identifies Sparsity Wall and Optimizes Edge Deployment AI Framework Targets 50% Water Loss in Jordan with LLM and Digital Twin Integration AnonShield: Scalable On-Premise Pseudonymization Cuts Vulnerability Data Processing from 92 Hours to Under 10 Minutes MoFore: A New Self-Supervised Framework Learns Video Representations by Forecasting Future Latent Embeddings Do LLMs Reliably Identify Correct Information Units in Aphasic Discourse? A New Study Evaluates Four Models AI Video Generation Method for Cardiac MRI Addresses Data Scarcity with Latent Motion Modeling SCAN Framework Helps CTOs Decide When to Use Generative AI for Task Allocation LLM-Encoded Knowledge Guides Federated Graph Recommendation to Improve Accuracy New Framework Reduces Visual Hallucinations in Multimodal AI Systems Without Retraining MAF Framework Dynamically Optimizes Prompting for Multimodal Sentiment Analysis Study on Pedestrian Attribute Recognition Identifies Sparsity Wall and Optimizes Edge Deployment AI Framework Targets 50% Water Loss in Jordan with LLM and Digital Twin Integration AnonShield: Scalable On-Premise Pseudonymization Cuts Vulnerability Data Processing from 92 Hours to Under 10 Minutes MoFore: A New Self-Supervised Framework Learns Video Representations by Forecasting Future Latent Embeddings Do LLMs Reliably Identify Correct Information Units in Aphasic Discourse? A New Study Evaluates Four Models AI Video Generation Method for Cardiac MRI Addresses Data Scarcity with Latent Motion Modeling SCAN Framework Helps CTOs Decide When to Use Generative AI for Task Allocation LLM-Encoded Knowledge Guides Federated Graph Recommendation to Improve Accuracy

Home ›› Topics ›› benchmarking

Topic

benchmarking

2 stories

RetailBench Benchmark Tests LLM Agents on Long-Horizon Retail Decisions

Artificial Intelligence #retailbench#llm

RetailBench Benchmark Tests LLM Agents on Long-Horizon Retail Decisions

Researchers introduced RetailBench, a simulation benchmark for evaluating LLM agents in single-store supermarket management over 180 days. Tests on seven models showed only a subset completed the full horizon, and even the best fell far behind an oracle policy due to incomplete evidence acquisition and lack of consistent strategy.

Jun 16, 2026 2 sources

ToolMenuBench: New Benchmark Evaluates Tool-Menu Filtering for Reliable and Efficient LLM Agents

Artificial Intelligence #toolmenubench#benchmarking

ToolMenuBench: New Benchmark Evaluates Tool-Menu Filtering for Reliable and Efficient LLM Agents

ToolMenuBench, a new benchmark from researchers, evaluates how tool-menu filtering strategies affect LLM agent reliability and efficiency. In tests across seven model backends, causal minimal tool filtering improved task success from 32.1% to 85.7% while reducing token usage by roughly 98%.

Jun 16, 2026 2 sources