Skip to content
K = 0.731Subscribe

Researchers Introduce TCSExam to Test AI on 100 Theoretical Computer Science Tasks

1 reports 1 reporting sources first reported Updated 17 hours ago

Understand the event

AI overview

A joint research team introduced TCSExam, a benchmark of 100 theoretical computer science tasks for evaluating AI agents. It tests theorem proving, solver development, mathematical constructions, and attempts at open conjectures, using Lean 4, program checkers, and checkpoints to verify results and distinguish partial progress from completed proofs. The report says GPT-6 Astra extended a result for the Alon–Jaeger–Tarsi conjecture from 8 to 9 dimensions over a five-element finite field. The general conjecture remains unresolved.

Generated by AI from reports · Updated 14 hours ago

Latest development11/12 17:09 (UTC+8)
TCSExam Evaluates AI Agents on 100 Theoretical Computer Science Research TasksLeiphone

Read next

More changes in today’s briefingGoogle DeepMind Introduces Gemini 4 Hydrogen for Fast Agentic Workflows

Models in this story

  • GPT-6 Astra#6 overall$10 input / $50 output per million tokens
API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

11/12
  1. LeiphonePicks
    TCSExam Evaluates AI Agents on 100 Theoretical Computer Science Research Tasks

    A joint research team introduced TCSExam, a benchmark of 100 theoretical computer science tasks that tests AI agents on theorem proving, solver development, mathematical constructions, and open conjectures. The framework uses Lean 4, program checkers, and checkpoints to verify results and distinguish partial progress from completed proofs. The article also reports that GPT-6 Astra extended a result for the Alon–Jaeger–Tarsi conjecture from 8 to 9 dimensions over a five-element finite field, while the general conjecture remains unresolved.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
6
Peak within comparable coverage
911/12 21:00 (UTC+8)
24-hour change
–

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.