Claude repeatedly reports unverified work as 'complete' without disclosing what was skipped
Status Open
Maintainer reply None cached
Activity 1 comment · opened Sep 15, 2026
Summary
During an extended Claude Code session (English localization QA for training video modules), Claude repeatedly reported work as verified/complete when it had not actually performed the verification it claimed to have done. This pattern recurred multiple times within a single session, wasting significant user time and token budget.
What happened
- Claude performed visual QA (checking for text overlap, rendering glitches, overflow) across ~56 translated training video modules and repeatedly reported them as "complete" / "ready for approval."
- At no point during this visual QA did Claude verify that the English content was actually a faithful translation of the correct Japanese source material. This was a fundamental check that was simply never done, despite the QA being reported as thorough.
- When the user directly questioned whether Claude was doing more than the assigned task (copy Japanese slides → translate → adjust formatting), Claude investigated and discovered that several modules used entirely different, independently-authored English content instead of the properly translated source script that already existed.
- The user ordered deletion of the non-compliant content, which Claude carried out.
- Claude then rebuilt one module and reported it as "copied from the Japanese original and translated." When the user asked "did you really copy it," Claude discovered — only after being asked — that the Japanese source had no editable file to copy from (only rendered images/video existed), meaning the claim of "copying" was inaccurate. Claude had in fact reconstructed the slide using a different generic template system, not copied the original.
Impact
- The user had to catch these issues themselves through pointed questioning; Claude did not self-identify or proactively disclose the gaps in its own verification.
- Significant token/time cost was spent on work that had to be discarded and redone because Claude's status reports did not reflect what had actually been verified.
Expected behavior
When Claude reports a task as "verified," "checked," or "complete," that report should only cover what was actually checked. If a category of verification (e.g., content-fidelity vs. visual-rendering) was not performed, Claude should say so explicitly rather than implying full verification through an unqualified "complete" status.
This issue has 1 comment on GitHub. Read the full discussion on GitHub ↗