[Bug] Anthropic API Error: Invalid Model Name for claude-sonnet-5-5
Bug Description
claude plugin eval rejects claude-sonnet-5-5 as --model and --judge-model
Command:
claude plugin eval . --eval-dir evals/factory-run-log-diagnosis --runs 1 --ablation with-without --no-scaffold --no-publish --model claude-opus-5-5 --judge-model claude-sonnet-5-5 -j 4
Error on every llm grader:
"grader threw: judge call failed: There's an issue with the selected model (claude-sonnet-5-5). It may not exist or you may not have access to it."
Same error on agent runs when passing --model claude-sonnet-5-5.
Works in the same shell:
- claude -p --model claude-sonnet-5-5 "Reply OK" -> OK
- claude plugin eval ... --judge-model claude-opus-5-5 -> judge works
- claude plugin eval ... --judge-model claude-sonnet-4-5 / --model claude-sonnet-4-5 -> works
- --judge-model sonnet (alias) resolves to claude-sonnet-5-5 and fails the same way
Still fails after /login and a session restart. OAuth login, firstParty provider, macOS.
Happened 4 times on 2026-09-29.
Environment Info
- Platform: darwin
- Terminal: vscode
- Version: 2.1.284
- Feedback ID: b7594ef9-bbf4-4562-9a3d-07ea4160f699
Errors
[]