Bug: Model miscounts explicitly listed items (Opus 4.6)
Description
While working on a vocabulary dictionary project (Neural Lexicon), I asked the model to summarize the current state of files in a folder. The model correctly identified and listed 5 items in two categories:
- 2 updates: bear, foundation
- 3 new entries: bear-in-mind, consensus, efficiency
However, the model wrote:
"2 new entries: bear-in-mind, consensus, efficiency"
It listed 3 items but labeled them as 2. This is a trivial counting task on an explicitly enumerated list — not an estimation or approximation. The values were generated by the model itself in the same message.
Steps to Reproduce
- Over the course of a session, create several files in a folder — some are updates to existing entries, some are new entries
- Ask the model to summarize the current state (how many updates, how many new)
- The model lists the correct items but writes the wrong count
Expected Behavior
The model should count 3 explicitly listed values as 3.
Actual Behavior
The model counted 3 explicitly listed values as 2.
Environment
- Model: Claude Opus 4.6 (1M context)
- Tool: Claude Code CLI
- Platform: macOS (Darwin 25.3.0)
Additional Context
This is a basic arithmetic/logic failure. The list was short (3 items), clearly comma-separated, and generated by the model itself in the same response. There was no ambiguity. This type of error undermines trust in the model's ability to handle simple tracking and reporting tasks.
This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗