[Bug] Model Hallucination: Incorrect Reasoning Confidence Without Evidence Verification

Bug Description
The model hallucinates a lot.. It debugs an issue and reports the reason for the bug in full confidence. Then I provide it some evidences to prove that his reasoning is wrong.. Then it checks again and finds out that the earlier reasoning was wrong and the actual reason is something else.. This has happened a lot of times

Environment Info

• Platform: darwin
• Terminal: iTerm.app
• Version: 2.1.114
• Feedback ID: 5c36e454-2f9f-40e0-99d7-b8b5c541c78f

Errors

[]