Software #web services#api
ToolPro: Executable Tool Programs Cut Web Service Latency by 53% for LLM Agents
A new system called ToolPro replaces static API endpoints with executable tool programs for LLM-based agents, achieving up to 53.4% lower latency and 96.1% less traffic on multi-step workflows. It uses effect-aware replay for exactly-once execution and a profile-driven policy to decide when program execution outperforms stepwise calling.
Jun 23, 2026 1 source