[Bug] Assistant generates unverified claims and false documentation without source validation

Status Open
Reported on v2.1.220
Maintainer reply None cached
Activity 1 comment · opened Aug 3, 2026

Bug Description
Claude Code CLI, 2026-08-03, models Fable 5 and Opus 5. Hardware bench session.

Seven instances in one session of the assistant presenting unverified claims as
fact. Every one caught by the user, not by the assistant.

Worst case: it wrote a data-conversion tool, validated it too coarsely to catch
a 1.3% defect, recorded a passing verdict in its own memory, and on that basis
reported a hardware measurement discrepancy that does not exist - writing it
into project documentation before the user disproved it with a cursor
measurement. The source file contained the instrument's own reading that would
have exposed the error immediately; the assistant never read that field.

Also: dismissed a valid oscilloscope capture as worthless when its usable part
held two real results; gave an arithmetically impossible register value as a
firmware verification criterion; described a document's contents without opening
it; planned a build from notes instead of code.

Full report with the cause of each is in the repository at
docs/complaint_2026-08-03_assistant-errors.md and the transcript is attached.

Environment Info

  • Platform: win32
  • Terminal: null
  • Version: 2.1.220
  • Feedback ID: 24a73813-a670-4ebd-8e43-9290dc3dc83a

Errors

[{"error":"TelemetrySafeError: VirtualMessageList: itemKeys/messages length desync (keys=360 messages=359 range=[333,360))\n    at Gzb (B:/~BUN/root/src/entrypoints/cli.js:21739:8188)\n    at Hhf (B:/~BUN/root/src/entrypoints/cli.js:21739:1103)\n    at no (B:/~BUN/root/src/entrypoints/cli.js:2061:21369)\n    at DA (B:/~BUN/root/src/entrypoints/cli.js:2061:40466)\n    at q3 (B:/~BUN/root/src/entrypoints/cli.js:2061:51400)\n    at Mne (B:/~BUN/root/src/entrypoints/cli.js:2061:89060)\n    at ULe (B:/~BUN/root/src/entrypoints/cli.js:2061:88007)\n    at Wge (B:/~BUN/root/src/entrypoints/cli.js:2061:87827)\n    at nQ (B:/~BUN/root/src/entrypoints/cli.js:2061:84091)\n    at Rt (B:/~BUN/root/src/entrypoints/cli.js:2061:6668)","timestamp":"2026-08-03T07:26:16.426Z"}]

View original on GitHub ↗

This issue has 1 comment on GitHub. Read the full discussion on GitHub ↗