Google Research proposes Retrieve-for-Train: compile diffusion models with RL to bypass inference bottlenecks in complex AI search
Google Research proposes Retrieve-for-Train, a framework that uses offline RL to discover reward-aligned query fan-outs and compile them into supervision, then distills them into a 53.9M-parameter diffusion retriever. At inference, it generates a complete result set in one non-autoregressive pass without chain-of-thought tokens. The method fine-tunes fan-out language models based on Gemma3-4B and Qwen3-4B, using set-level attribute rewards to address paraphrase collapse in zero-shot LLMs and autoregressive latency.