[Bug] Model makes confident false architectural claims from incomplete code search results
Bug Description
Claude Code / Opus 4.7 appears to be making confident architecture claims from incomplete searches.
In a Ghost UI audit session, the model claimed the Reports tab was fake / hardcoded because it did not find reports.html or a plugin YAML registration. That was wrong. Runtime screenshots showed Reports is real, populated with files, and used by Ghost. The model had converted “grep did not find my expected shape” into a false architecture conclusion.
Failure pattern:
- shallow grep
- confident negative claim
- did not trace runtime UI back to source
- defended the claim after correction
- wasted significant time and tokens
- created risk of removing real product functionality
This matches public Opus 4.7 complaints around hallucination, thin-evidence assumptions, and worse file/context discipline than 4.6. Please investigate or provide a way to pin 4.6 reliably for Claude Code workflows.
Environment Info
- Platform: darwin
- Terminal: Apple_Terminal
- Version: 2.1.140
- Feedback ID: 0199cb00-35cb-4bf8-8061-1557c04e257c
Errors
[{"error":"Error: Plugin MCP server error - mcp-config-invalid: MCP server greptile invalid: Missing environment variables: GREPTILE_API_KEY\n at e7H (/$bunfs/root/src/entrypoints/cli.js:2673:36785)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T01:58:27.181Z"},{"error":"Error: Plugin MCP server error - mcp-config-invalid: MCP server greptile invalid: Missing environment variables: GREPTILE_API_KEY\n at e7H (/$bunfs/root/src/entrypoints/cli.js:2673:36785)\n at async k (/$bunfs/root/src/entrypoints/cli.js:6431:11729)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T01:58:27.863Z"},{"error":"Error: Plugin MCP server error - mcp-config-invalid: MCP server greptile invalid: Missing environment variables: GREPTILE_API_KEY\n at e7H (/$bunfs/root/src/entrypoints/cli.js:2673:36785)\n at async N (/$bunfs/root/src/entrypoints/cli.js:6431:12615)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T01:58:27.863Z"},{"error":"Error: Request was aborted.\n at makeRequest (/$bunfs/root/src/entrypoints/cli.js:51:6192)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T02:02:25.251Z"},{"error":"Error: The socket connection was closed unexpectedly. For more information, pass `verbose: true` in the second argument to fetch()\n at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n at emitError (node:events:43:23)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n at emitError (node:events:43:23)\n at <anonymous> (node:_http_client:251:22)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T02:50:13.673Z"},{"error":"Error: The socket connection was closed unexpectedly. For more information, pass `verbose: true` in the second argument to fetch()\n at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n at emitError (node:events:43:23)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n at emitError (node:events:43:23)\n at <anonymous> (node:_http_client:251:22)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T02:58:56.432Z"},{"error":"Error: The socket connection was closed unexpectedly. For more information, pass `verbose: true` in the second argument to fetch()\n at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n at emitError (node:events:43:23)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n at emitError (node:events:43:23)\n at <anonymous> (node:_http_client:251:22)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T04:02:13.881Z"},{"error":"Error: The socket connection was closed unexpectedly. For more information, pass `verbose: true` in the second argument to fetch()\n at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n at emitError (node:events:43:23)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n at emitError (node:events:43:23)\n at <anonymous> (node:_http_client:251:22)\n at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T04:25:48.196Z"},{"error":"Error: The socket connection was closed unexpectedly. For more information, pass `verbose: true` in the second argument to fetch()\n at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n at emitError (node:events:43:23)\n at <anonymous> (/$bunfs/root/src/entrypoints/cli.js…
Note: Content was truncated.
This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗