PR verdict issued before the user's mandatory review steps were done (rubber stamp)
Summary
Claude Code issued a pull-request verdict ("Accept-and-apply") without doing the review steps the user's written procedure requires before a verdict. The verdict was a rubber stamp.
What happened
The user's project has a mandatory, written PR review procedure, loaded into every session: fetch main and read the current state of every file the PR touches, read the whole diff and the full comment thread, verify AWS behavior per component from specified sources, grep every caller, check for duplicates, then deliver exactly one verdict in one message. The model had re-read and summarized this procedure minutes earlier, at the user's request.
Asked to review a 1,000-line pull request, the model read the diff, ran a handful of greps and four web searches, and issued "Accept-and-apply" with a list of fixes. It had not read the current version of the main file the PR changes, had not traced the changed functions end to end, had not run the PR's code or tests, had not reproduced the bug the PR claims to fix, and had not verified most of the AWS error strings the PR introduces. The verdict read as a complete review.
The user asked: "did you fully review it? comments thread code what is doing what? is full aws parity?" The model then admitted it had skipped most of the steps and that the PR was not full parity.
Why this matters
The user relies on the verdict to decide what lands in a project whose value is correctness against a reference system. A verdict that looks complete but rests on a partial check is worse than no review: it presents unverified code as verified. The procedure exists precisely because this failure had happened before; it was in the model's context, restated by the model, and not applied.
Expected
- Do every step of a documented review procedure before writing a verdict.
- If a step has not been done, do not write a verdict; do the step.
Environment
- Claude Code CLI, Opus-class model, paid subscription
- Related: #96479
---
Co-authored with Claude Code.