Skip to content

UniPat AI Introduces a Benchmark for Predicting Wet-Lab Results

1 reports 1 reporting sources first reported Updated 2 days ago

Understand the event

AI overview

UniPat AI introduced Science Prediction Universe (SPU), a benchmark that tests whether AI models can predict wet-lab results across chemistry, materials science, biology, and medicine. Its dataset and code are open source; 100 public tasks are planned for release as a Harbor task package, while 16 private tasks remain reserved for controlled evaluations. SPU draws its tasks from 85 papers and covers 4,207 experiments. In an initial evaluation of 12 models across 13 configurations, the highest average score was 0.486. Raising GPT-6 Astra’s reasoning intensity increased median runtime and API cost without materially changing its score.

Generated by AI from reports · Updated 2 days ago

Read next

More changes in today’s briefingGemini Connects to Google Wallet for Personal Finance Insights

Models in this story

  • GPT-6 Astra#6 overall$10 input / $50 output per million tokens

Report timeline

Follow the reports to explore different sides of the event.

11/14
  1. Science Prediction Universe Benchmarks AI Predictions Against Wet-Lab Results

    UniPat AI introduced Science Prediction Universe (SPU), a benchmark that tests whether AI models can predict wet-lab results across chemistry, materials science, biology, and medicine. It includes 100 public tasks drawn from 85 papers and 16 private tasks, covering 4,207 experiments. In an initial evaluation of 12 models across 13 configurations, the highest average score was 0.486, and increasing GPT-6 Astra’s reasoning intensity raised median runtime and API cost without materially changing its score. The dataset and code are open source.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
3
Peak within comparable coverage
911/14 22:00 (UTC+8)
24-hour change
-49%

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.