ai calibration

ACUTE Protocol Improves LLM Calibration and Trustworthiness with Activation-Based Confidence Estimates

A new research protocol, ACUTE, leverages model activations to produce better-calibrated confidence estimates for large language models. Combined with a novel metric called EURO that balances calibration and informativeness, ACUTE outperforms baselines across multiple tasks and model families, offering enterprises a path to more trustworthy AI outputs.