Google DeepMind pilots the first global double-blind AI evaluation
Google DeepMind says it has launched the first double-blind evaluation of proprietary frontier AI models, restricting external evaluators to an encrypted environment so models cannot encounter test questions in advance. The pilot, conducted with Singapore's AI Safety Institute, OpenMined, AVERI, and MLCommons, uses confidential benchmarks to test a Gemini Flash Lite model in a privacy-preserving environment and improve evaluation credibility.

