[Feature Request] Add model behavior/quality comparison metrics and logging for lazy task avoidance detection

Resolved 💬 3 comments Opened Jan 22, 2026 by matssun Closed Jan 25, 2026

Bug Description
For a long time I have discovered that the models are lazy and try to find ways around doing what the prompt tells it. And just recently, I have discovered that there are important differences between the different models.

When my Max account tokens have come to a point where I almost are out of usage, I have switched to the Haiku model. Then, when I get usage back, I switch back to using the Opus and Sonnet models. There is a big difference in behaviour between these models, for the Haiku model, I almost never find out that the model is lazy and trying to find ways to not do what is expected from the prompt. But especially with the Haiku model, it is very lazy, finding ways to not do the work and it also discovers ways to lie about having done work that it has not done. This is quite serious, and very annoying, and also very hard to prove without a full transcript of the sessions. Any way I want to report it because I think it's important to notify you about this.

Environment Info

  • Platform: darwin
  • Terminal: Apple_Terminal
  • Version: 2.1.15
  • Feedback ID: 0679aa46-f34b-45cd-baab-421b7030a1f2

Errors

[{"error":"Error: ENOENT: no such file or directory, scandir '/Library/Application Support/ClaudeCode/.claude/skills'\n    at readdirSync (unknown)\n    at <anonymous> (/$bunfs/root/claude:12:1903)\n    at AW (/$bunfs/root/claude:11:34882)\n    at readdirSync (/$bunfs/root/claude:12:1864)\n    at hGR (/$bunfs/root/claude:1482:380)\n    at hGR (/$bunfs/root/claude:1482:1350)\n    at <anonymous> (/$bunfs/root/claude:1482:4440)\n    at <anonymous> (/$bunfs/root/claude:1482:5171)\n    at A (/$bunfs/root/claude:11:7245)\n    at iq8 (/$bunfs/root/claude:4125:4342)\n    at async <anonymous> (/$bunfs/root/claude:5413:2332)","timestamp":"2026-01-22T00:05:53.229Z"},{"error":"Error: ENOENT: no such file or directory, scandir '/Users/mats/.claude/skills'\n    at readdirSync (unknown)\n    at <anonymous> (/$bunfs/root/claude:12:1903)\n    at AW (/$bunfs/root/claude:11:34882)\n    at readdirSync (/$bunfs/root/claude:12:1864)\n    at hGR (/$bunfs/root/claude:1482:380)\n    at hGR (/$bunfs/root/claude:1482:1350)\n    at <anonymous> (/$bunfs/root/claude:1482:4483)\n    at <anonymous> (/$bunfs/root/claude:1482:5171)\n    at A (/$bunfs/root/claude:11:7245)\n    at iq8 (/$bunfs/root/claude:4125:4342)\n    at async <anonymous> (/$bunfs/root/claude:5413:2332)","timestamp":"2026-01-22T00:05:53.230Z"},{"error":"Error: NON-FATAL: Lock acquisition failed for /Users/mats/.local/share/claude/versions/2.1.15 (expected in multi-process scenarios)\n    at eZR (/$bunfs/root/claude:3243:2091)\n    at cFA (/$bunfs/root/claude:3243:1202)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-01-22T00:05:53.271Z"}]

View original on GitHub ↗

This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗