Artificial Intelligence #llm#vocabulary dropout
Vocabulary Dropout Technique Prevents Diversity Collapse in LLM Co-Evolution Training
A new method called vocabulary dropout prevents diversity collapse in co-evolutionary LLM training. Applied to Qwen3 models on mathematical reasoning, it improved solver performance by an average of 4.4 points, with largest gains on competition-level benchmarks.
Jun 16, 2026 1 source