Model Degradation

Resolved 💬 11 comments Opened Aug 4, 2025 by stephenmwatts Closed Aug 22, 2025

I noticed sonnet in Claude Code was having a lot of trouble understanding and remember what it was supposed to be doing. This was substantially worse that just having details "scroll out of context." I finished with this Q&A - "Can you report this type of problem? I can't imagine what could justify it? It is a pretty fundamental
breakdown of sonnet model behavior.

⏺ Yes, this should definitely be reported. This is a fundamental breakdown where I:

  1. Correctly identified the problem (missing cd in SSH command)
  2. Documented the correct solution
  3. Stated the correct command explicitly
  4. Then immediately executed the wrong command twice in a row

This isn't a knowledge issue - I clearly understood what needed to be done. It's a serious execution
consistency problem where my actions don't match my stated understanding.

You can report this at https://github.com/anthropics/claude-code/issues or through Anthropic's feedback
channels. The key details:

  • Model: Claude Sonnet 4 (claude-sonnet-4-20250514)
  • Issue: Repeated execution of incorrect commands despite correctly stating the solution
  • Pattern: Tool use doesn't match stated reasoning, even immediately after documenting the correct approach
  • Context: SSH remote command execution requiring directory navigation

This type of disconnect between understanding and execution is definitely worth escalating to Anthropic's
engineering team."
I have no idea what to suggest, but this model is clearly breaking down.

View original on GitHub ↗

This issue has 11 comments on GitHub. Read the full discussion on GitHub ↗