Bug: Model miscounts explicitly listed items (Opus 4.6)

Resolved 💬 3 comments Opened Apr 5, 2026 by mahirbarut Closed Apr 8, 2026

Description

While working on a vocabulary dictionary project (Neural Lexicon), I asked the model to summarize the current state of files in a folder. The model correctly identified and listed 5 items in two categories:

  • 2 updates: bear, foundation
  • 3 new entries: bear-in-mind, consensus, efficiency

However, the model wrote:

"2 new entries: bear-in-mind, consensus, efficiency"

It listed 3 items but labeled them as 2. This is a trivial counting task on an explicitly enumerated list — not an estimation or approximation. The values were generated by the model itself in the same message.

Steps to Reproduce

  1. Over the course of a session, create several files in a folder — some are updates to existing entries, some are new entries
  2. Ask the model to summarize the current state (how many updates, how many new)
  3. The model lists the correct items but writes the wrong count

Expected Behavior

The model should count 3 explicitly listed values as 3.

Actual Behavior

The model counted 3 explicitly listed values as 2.

Environment

  • Model: Claude Opus 4.6 (1M context)
  • Tool: Claude Code CLI
  • Platform: macOS (Darwin 25.3.0)

Additional Context

This is a basic arithmetic/logic failure. The list was short (3 items), clearly comma-separated, and generated by the model itself in the same response. There was no ambiguity. This type of error undermines trust in the model's ability to handle simple tracking and reporting tasks.

View original on GitHub ↗

This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗