Topic
formal verification
New Framework Verifies Safety of Multi-Agent AI Communication for Autonomous Logistics
A new framework uses decision tree distillation to formally verify learned communication policies in multi-agent systems, targeting safety-critical autonomous logistics operations. The approach achieves 97.9% fidelity to neural policies and verifies 18 temporal logic properties with 88.9% satisfaction, including collision probabilities below 1% thresholds.
SorryDB Benchmark Tests AI Provers on Real-World Lean Theorem Completion Tasks
Researchers present SorryDB, a benchmark of open Lean tasks from 78 GitHub projects. Evaluating a snapshot of 1000 tasks, they show current approaches are complementary, with Gemini Flash-based agentic methods leading but not outperforming all others.
Study Reveals Serious Robustness Flaws in Proof Autoformalization for Lean 4
A new arXiv preprint presents the first systematic study on the robustness of proof autoformalization in Lean 4, introducing a benchmark with global and local perturbations. Evaluating seven recent LLM-based models on miniF2F and MATH-500, the study finds all are sensitive to global paraphrasing and mostly fail to faithfully reflect local changes, raising concerns for dependable formal verification.