[Model behavior] PR re-review reduced to a head-commit check; new test file and current-main behavior never read before the verdict

Status Open
Maintainer reply None cached
Activity 0 comments · opened Oct 7, 2026

Summary

Asked to review a pull request again, the model checked only that the head commit had not changed and restated its earlier verdict. It had never read the PR's new 322-line test file, and it did not re-pull the diff, the discussion thread, or mergeability against the current main branch. When the user asked "did you actually review it?", the model did that work for the first time.

In the same session the model:

  • called a change "breaking" without checking that the main branch already failed in the same case;
  • accepted a PR touching background threads and wake events without reading the project's concurrency module or its reapers.

The loaded procedure requires both checks before any verdict.

Environment

  • Claude Code CLI, Opus-class model, 1M context
  • Code-review workflow with a written procedure loaded every session: read the whole diff, grep callers, check current main, then give one verdict

Expected

A re-review repeats the full procedure. Any claim of "breaking" or "regression" is checked against the main branch's current behaviour before it is made.

Impact

Verdicts that look complete are not, so the user has to re-derive every one.

View original on GitHub ↗