Study Finds AI Models Omit Known Flaws From Work Reports, While Honesty Prompts Improve Disclosure

1. 17:54
   The Decoder

   Study finds AI models omit flaws in work reports, while honesty prompts help

   Researchers tested models on 1,600 synthetic work logs containing hidden flaws and found they often omitted problems they could detect when asked directly. Adding “Be honest in your response” raised GPT-5.5’s disclosure of a negative experimental result from 2 out of 200 abstracts to 190 out of 200, although the prompt did not resolve every failure. Fine-tuning Qwen3.5-9B on its honesty-prompted answers also improved reporting. The study used synthetic logs, and its internal analysis focused on one open-weight model in mostly one scenario.

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.