[Bug] Claude modifies test input examples instead of using them as-is, causing invalid test validation

Resolved 💬 3 comments Opened Apr 8, 2026 by tprus Closed Apr 12, 2026

Bug Description
Claude oszukuje notorycznie, mam wrażenie, że pod tym względem się pogorszył z czasem. Przyklad daje mu kilka exampli złych yamli, żeby napisał testy ktore wykażą, że sa złe, a on pisze testy ktore przechodzą, a potem się okazuje, że on nie użył 1:1 exampli tylko je zmodyfikował.

Environment Info

  • Platform: linux
  • Terminal: pycharm
  • Version: 2.1.96
  • Feedback ID: cf74af93-2024-45c8-b52b-299a1106ab28

Errors

[{"error":"Error: NON-FATAL: Lock acquisition failed for /home/tprus/.local/share/claude/versions/2.1.96 (expected in multi-process scenarios)\n    at Cg$ (/$bunfs/root/src/entrypoints/cli.js:1888:2153)\n    at ni8 (/$bunfs/root/src/entrypoints/cli.js:1888:1233)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-04-08T09:43:15.099Z"},{"error":"MaxFileReadTokenExceededError: File content (17396 tokens) exceeds maximum allowed tokens (10000). Use offset and limit parameters to read specific portions of the file, or search for specific content instead of reading the whole file.\n    at Zz7 (/$bunfs/root/src/entrypoints/cli.js:4307:13191)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-04-08T09:46:07.546Z"},{"error":"MaxFileReadTokenExceededError: File content (12876 tokens) exceeds maximum allowed tokens (10000). Use offset and limit parameters to read specific portions of the file, or search for specific content instead of reading the whole file.\n    at Zz7 (/$bunfs/root/src/entrypoints/cli.js:4307:13191)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-04-08T09:46:15.097Z"},{"error":"MaxFileReadTokenExceededError: File content (27009 tokens) exceeds maximum allowed tokens (10000). Use offset and limit parameters to read specific portions of the file, or search for specific content instead of reading the whole file.\n    at Zz7 (/$bunfs/root/src/entrypoints/cli.js:4307:13191)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-04-08T09:46:31.415Z"},{"error":"Error: File does not exist. Note: your current working directory is /home/tprus/IdeaProjects/backend-v4.\n    at call (/$bunfs/root/src/entrypoints/cli.js:4316:7616)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-04-08T09:47:20.791Z"},{"error":"Error: Request was aborted.\n    at sh$ (/$bunfs/root/src/entrypoints/cli.js:1243:11929)\n    at next (native:1:11)\n    at vC7 (/$bunfs/root/src/entrypoints/cli.js:7775:9035)\n    at next (native:1:11)\n    at VC7 (/$bunfs/root/src/entrypoints/cli.js:7780:11451)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-04-08T11:17:06.721Z"}]

View original on GitHub ↗

This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗