Artificial Intelligence #large language models#combinatorial counting
CombEval: A Framework for Evaluating Combinatorial Counting in Large Language Models
CombEval is a dynamic benchmark for evaluating combinatorial counting in large language models. It uses typed Cofola specifications to generate problems with verified answers. Tests on 11 LLMs reveal persistent failures on ordered objects, indistinguishable elements, and nested dependencies.
Jun 20, 2026 1 source