Opus 4.6 quality regression: production automations broken by apparent model downgrade

Open 💬 14 comments Opened Mar 6, 2026 by ilanoh

Summary

A production automation pipeline that has been running reliably for 2+ weeks with claude-opus-4-6 suddenly started producing incoherent results today (March 6, 2026). The output quality is consistent with Sonnet 3.5, not Opus 4.6.

What happened

We run a daily automation that invokes Claude Code programmatically (@anthropic-ai/claude-code SDK, model: "claude-opus-4-6") to generate structured content following a detailed skill specification. The skill contains:

  • Critical rules clearly marked at the top of the prompt (e.g., "NEVER do X in field Y")
  • Style references pointing to a file the agent must read and apply
  • Schema constraints the output must follow

For the past 2 weeks, the automation consistently:

  • Followed all critical rules
  • Read and applied the referenced style library
  • Produced output matching the expected schema and quality bar

Today, without any change to our code, prompts, or configuration, the agent:

  • Ignored critical rules that were clearly stated (produced output with values explicitly forbidden by "NEVER" rules)
  • Skipped reading a referenced style file entirely, generating output in a completely wrong format
  • The overall reasoning depth and instruction adherence dropped dramatically

This is not a subtle regression. The output went from "follows 15+ layered rules correctly" to "ignores top-level NEVER rules."

Broader pattern

This is not isolated to the automation. Across all sessions today (interactive and programmatic), the model feels like Sonnet 3.5 quality at best:

  • Shallow instruction following
  • Misses rules that require holding multiple constraints simultaneously
  • Reduced reasoning depth on multi-step tasks
  • When we ask the model to self-evaluate conversation quality, it consistently benchmarks at Sonnet 4 level maximum, not Opus 4.6

What we need from Anthropic

1. Transparency

If there has been an inference-time reduction, A/B test, model routing change, or any modification to what claude-opus-4-6 actually serves, this needs to be communicated. Paying for Opus and silently receiving a lower-capability model breaks trust.

2. Model version pinning

Production automations need continuity guarantees. We need the ability to pin to a specific model version (e.g., claude-opus-4-6-20260301) so that:

  • Upgrades don't silently break working pipelines
  • We can test new versions before adopting them
  • Rollbacks are possible when regressions occur

This is standard practice for any API serving production workloads (OpenAI offers dated model snapshots, for example).

3. Immediate resolution

If this is a routing bug (requests for Opus being served by a smaller model), it needs to be fixed immediately. Users paying for Max/Opus tier cannot have their production workloads silently degraded.

Environment

  • @anthropic-ai/claude-code SDK (latest)
  • model: "claude-opus-4-6"
  • permissionMode: "bypassPermissions"
  • Running on Linux VPS via cron
  • Same code, same prompts, same config as previous successful runs

Impact

Production content pipeline is effectively broken. Output requires full manual redo. The automation's entire value proposition depends on the model reliably following complex multi-layered instructions, which it did perfectly until today.

View original on GitHub ↗

This issue has 14 comments on GitHub. Read the full discussion on GitHub ↗