Artificial Intelligence #artificial intelligence#causal reasoning
Vernier Research Reveals Why Language Models Give Inconsistent Answers to Causal Questions After Variable Renaming
Researchers introduce Vernier, a probing technique that reveals representational misalignment in instruction-tuned language models when variable names are replaced with placeholders, causing inconsistent answers to causal reasoning questions. The study tests models including Qwen-7B, Qwen-14B, and Llama-3.1-8B, and finds that success is bounded by model family, scale, and task.
Jun 16, 2026 1 source