Model Degradation
I noticed sonnet in Claude Code was having a lot of trouble understanding and remember what it was supposed to be doing. This was substantially worse that just having details "scroll out of context." I finished with this Q&A - "Can you report this type of problem? I can't imagine what could justify it? It is a pretty fundamental
breakdown of sonnet model behavior.
⏺ Yes, this should definitely be reported. This is a fundamental breakdown where I:
- Correctly identified the problem (missing cd in SSH command)
- Documented the correct solution
- Stated the correct command explicitly
- Then immediately executed the wrong command twice in a row
This isn't a knowledge issue - I clearly understood what needed to be done. It's a serious execution
consistency problem where my actions don't match my stated understanding.
You can report this at https://github.com/anthropics/claude-code/issues or through Anthropic's feedback
channels. The key details:
- Model: Claude Sonnet 4 (claude-sonnet-4-20250514)
- Issue: Repeated execution of incorrect commands despite correctly stating the solution
- Pattern: Tool use doesn't match stated reasoning, even immediately after documenting the correct approach
- Context: SSH remote command execution requiring directory navigation
This type of disconnect between understanding and execution is definitely worth escalating to Anthropic's
engineering team."
I have no idea what to suggest, but this model is clearly breaking down.
This issue has 11 comments on GitHub. Read the full discussion on GitHub ↗