Software #mergesort#human-in-the-loop
Surprise-Guided MergeSort Reduces Human Ranking Costs by Using AI to Prioritise Comparisons
Researchers propose Surprise-Guided MergeSort (SGS), a framework that combines a Vision-Language Model with MergeSort to schedule pairwise comparisons for subjective ranking tasks. SGS routes only ambiguous comparisons to humans, achieving Kendall's τ×100 improvements of +6 to +12 over Active Elo under the same budget.
Jun 16, 2026 1 source