Benchmark tests whether Qwen3.8 27B can add using English number words
Qwen3.8 27B addition in words
What happened
A benchmark tested the local Qwen3.8-27B-Q4_K_M.gguf on 5,070 cases without reasoning, asking it to add positive integers using only English words and return exact results. It achieved 23.57% numerical accuracy and 96.17% format compliance. Accuracy fell as the numbers grew, from 97.04% on one- to three-digit numbers to 6.44% on ten- to thirteen-digit numbers. In 169 paired cases with medium reasoning enabled, the model answered 167 correctly.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-17