ALTK-Evolve uses learned memory to top τ²-bench retail results with GPT-4.1
IBM Research reports that ALTK-Evolve extracts behavioral guidelines from agents’ training attempts and appends them to prompts, improving customer service performance without weight updates or human annotation. On held-out τ²-bench retail tasks, GPT-4.1’s Pass^4 increased from 57.5% to 67.5%; airline reliability benefited most from a smaller guideline set. Its full-base-split retail result also exceeded every entry in the October 12, 2026 leaderboard snapshot. Guidelines increased input token costs while slightly reducing conversation turns on matched successful runs.

Why it matters
The experiments offer a transferable method for improving agent reliability through learned prompt guidelines, while showing that guideline quantity and input token costs require domain-specific tradeoffs.










