Google Research proposes Retrieve-for-Train: compile diffusion models with RL to bypass inference bottlenecks in complex AI search

What happened

Google Research proposes Retrieve-for-Train, a framework that uses offline RL to discover reward-aligned query fan-outs and compile them into supervision, then distills them into a 53.9M-parameter diffusion retriever. At inference, it generates a complete result set in one non-autoregressive pass without chain-of-thought tokens. The method fine-tunes fan-out language models based on Gemma3-4B and Qwen3-4B, using set-level attribute rewards to address paraphrase collapse in zero-shot LLMs and autoregressive latency.

Keep reading

Trending now

1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights