Benchmark tests whether Qwen3.8 27B can add using English number words
A benchmark tested the local Qwen3.8-27B-Q4_K_M.gguf on 5,070 cases without reasoning, asking it to add positive integers using only English words and return exact results. It achieved 23.57% numerical accuracy and 96.17% format compliance. Accuracy fell as the numbers grew, from 97.04% on one- to three-digit numbers to 6.44% on ten- to thirteen-digit numbers. In 169 paired cases with medium reasoning enabled, the model answered 167 correctly.
