[Bug] Anthropic API Error: Invalid Model Name for claude-sonnet-5-5

Status Open
Reported on v2.1.284
Maintainer reply None cached
Activity 0 comments · opened Sep 29, 2026

Bug Description
claude plugin eval rejects claude-sonnet-5-5 as --model and --judge-model Command: claude plugin eval . --eval-dir evals/factory-run-log-diagnosis --runs 1 --ablation with-without --no-scaffold --no-publish --model claude-opus-5-5 --judge-model claude-sonnet-5-5 -j 4 Error on every llm grader: "grader threw: judge call failed: There's an issue with the selected model (claude-sonnet-5-5). It may not exist or you may not have access to it." Same error on agent runs when passing --model claude-sonnet-5-5. Works in the same shell: - claude -p --model claude-sonnet-5-5 "Reply OK" -> OK - claude plugin eval ... --judge-model claude-opus-5-5 -> judge works - claude plugin eval ... --judge-model claude-sonnet-4-5 / --model claude-sonnet-4-5 -> works - --judge-model sonnet (alias) resolves to claude-sonnet-5-5 and fails the same way Still fails after /login and a session restart. OAuth login, firstParty provider, macOS. Happened 4 times on 2026-09-29.

Environment Info

  • Platform: darwin
  • Terminal: vscode
  • Version: 2.1.284
  • Feedback ID: b7594ef9-bbf4-4562-9a3d-07ea4160f699

Errors

[]

View original on GitHub ↗