[Bug] Model generates confident but inaccurate responses on unfamiliar domains without uncertainty signaling

Resolved 💬 1 comment Opened May 17, 2026 by pmoolchand Closed Jun 16, 2026

Bug Description
The model burned a week of tokens confabulating on a domain it has no reliable knowledge of, and that's a billing-relevant defect. topic was vaastu. claude acted as if it were an expert in the field. I asked for feedback from a practising expert: claude was totally off-reality!

Environment Info

  • Platform: linux
  • Terminal: gnome-terminal
  • Version: 2.1.139
  • Feedback ID: 8c8f0777-cd84-4044-86cf-69541aab7d5d

Errors

[{"error":"Error: Request was aborted.\n    at makeRequest (/$bunfs/root/src/entrypoints/cli.js:51:6192)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-12T18:43:43.399Z"},{"error":"AxiosError: timeout of 5000ms exceeded\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:13313)\n    at emit (node:events:92:22)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:3321)\n    at request (/$bunfs/root/src/entrypoints/cli.js:123:2467)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-12T19:17:45.328Z"},{"error":"Error: ECONNREFUSED\n    at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n    at emitError (node:events:43:23)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n    at emitError (node:events:43:23)\n    at <anonymous> (node:_http_client:243:22)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-12T19:19:40.735Z"},{"error":"Error: ECONNREFUSED\n    at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n    at emitError (node:events:43:23)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n    at emitError (node:events:43:23)\n    at <anonymous> (node:_http_client:243:22)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-12T19:21:37.319Z"},{"error":"Error: ECONNREFUSED\n    at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n    at emitError (node:events:43:23)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n    at emitError (node:events:43:23)\n    at <anonymous> (node:_http_client:243:22)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T05:00:01.138Z"},{"error":"Error: Failed to fetch version from https://downloads.claude.ai/claude-code-releases/latest: ECONNREFUSED\n    at ky_ (/$bunfs/root/src/entrypoints/cli.js:2662:17357)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T05:00:01.141Z"},{"error":"Error: Failed to fetch version from https://downloads.claude.ai/claude-code-releases/latest: ECONNREFUSED\n    at ky_ (/$bunfs/root/src/entrypoints/cli.js:2662:17357)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T05:00:01.141Z"},{"error":"Error: ECONNREFUSED\n    at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n    at emitError (node:events:43:23)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n    at emitError (node:events:43:23)\n    at <anonymous> (node:_http_client:243:22)\n    at processTicksAndRejections (native:7:39)\n    at request (/$bunfs/root/src/entrypoints/cli.js:123:2467)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T05:00:01.167Z"},{"error":"Error: Was there a typo in the url or port?\n    at from (/$bunfs/root/src/entrypoints/cli.js:113:7862)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:121:12898)\n    at emitError (node:events:43:23)\n    at <anonymous> (/$bunfs/root/src/entrypoints/cli.js:120:1149)\n    at emitError (node:events:43:23)\n    at <anonymous> (node:_http_client:243:22)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T05:00:16.144Z"},{"error":"Error: Request was aborted.\n    at makeRequest (/$bunfs/root/src/entrypoints/cli.js:51:6192)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T10:46:45.858Z"},{"error":"MaxFileReadTokenExceededError: [REDACTED] content (32415 tokens) exceeds maximum allowed tokens (25000). Use offset and limit parameters to read specific portions of the file, or search for specific content instead of reading the whole file.\n    at Fr7 (/$bunfs/root/src/entrypoints/cli.js:4902:13009)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T12:27:33.834Z"},{"error":"Error: Request was aborted.\n    at makeRequest (/$bunfs/root/src/entrypoints/cli.js:51:6192)\n    at processTicksAndRejections (native:7:39)","timestamp":"2026-05-13T12:27:34.751Z"},{"error":"Error: ensureToolResultPairing: repaired missing tool_result blocks (69 -> 69 messa…

Note: Content was truncated.

View original on GitHub ↗

This issue has 1 comment on GitHub. Read the full discussion on GitHub ↗