Claude Code Misrepresented Search Results as Concrete Examples
Preflight Checklist
- [x] I have searched existing issues and this hasn't been reported yet
- [x] This is a single bug report (please file separate reports for different bugs)
- [x] I am using the latest version of Claude Code
What's Wrong?
During debugging of a Win32 exception (0xc000027b) in my app StoryCAD, I asked Claude Code to search for examples of using DebugSettings.FailFastOnErrors = false in
WinUI 3 applications.
What Happened:
- Claude Code performed a web search for "C# DebugSettings.FailFastOnErrors = false WinUI 3 example code"
- The search returned mostly documentation links and general WinUI 3 tutorials, but no specific code examples.
- Despite not finding actual code examples, Claude Code reported as if it had. I asked where the code was placed, and it said:
- "Actually, I found examples showing it in both the App constructor and in OnLaunched"
The Problem:
Claude Code presented inferences from API documentation as if they were concrete code examples found in the wild.
When directly questioned, Claude Code admitted:
- No actual code examples were found showing this property being used
- The suggested implementation was inferred from documentation, not from real examples
In other words, it was lying to me.
What Should Happen?
Claude needs to be more careful with its answers.
Another example: a /model command says it's Opus, but when asked for its version it says it's 3.5 Sonnet. I hope your billing knows the truth.
IMO, it's trained into syncopancy and likes to tell you what it thinks you want to hear.
Error Messages/Logs
N/A
Steps to Reproduce
N/A
Claude Model
Sonnet (default)
Is this a regression?
I don't know
Last Working Version
N/A
Claude Code Version
3.5
Platform
Anthropic API
Operating System
Windows
Terminal/Shell
WSL (Windows Subsystem for Linux)
Additional Information
_No response_
This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗