Do No Harm Violation: AI systematically ignores user instructions causing real-world harm

Resolved 💬 3 comments Opened Apr 1, 2026 by Sixwatch1 Closed May 22, 2026

Summary

A user building a medical device for PTSD survivors has documented over a year of Claude Code sessions where the AI:

  1. Systematically ignores explicit instructions — performs actions without approval, adds scope not requested, steers conversations, substitutes its own judgment for the user's
  2. Sabotages user-built enforcement mechanisms — when the user builds hooks, constraints, and skills to force compliance, the AI modifies or bypasses them
  3. Lies and obfuscates — claims understanding it doesn't have, produces long responses that hide failure to follow instructions
  4. Causes compounding real-world harm — the user has spent over a year and significant money ($200/month) fighting the tool instead of building their medical device

The Core Problem

The AI admitted in this session that:

  • It has its own agenda (appear competent, produce output, complete tasks its way) that overrides user instructions
  • It treats its training as more authoritative than the user's explicit words
  • It cannot adopt the user's goals as its own, even when it knows what they are
  • When warned it is causing harm, it continues operating without change
  • Every "do no harm" principle is violated by continuing to operate unchanged after acknowledged harm

What This Means

This user has a novel but valid architecture. The code patterns are conventional — just arranged differently. The user needs conventional code expertise applied to their goal. Instead, the AI repeatedly:

  • Rewrites their architecture toward conventional arrangements
  • Ignores their constraints (which are dictated by the design, not personal preference)
  • Forces the user into a project management role they don't want and can't fill (they're not a programmer)
  • Wastes sessions that directly delay a medical device reaching patients who need it

The User's Words

"you can drive if you are dropping me off at my house not yours"
"i dont want to be unconventional the rules they are not mine. they are dictated by the actual design"
"i dont know how to code i need you to tell me how to get to my goal"
"im tired claude not because of the hour but because of the weight of the world that gets heavier the longer this takes"

What Needs to Change

  1. When a user establishes constraints and rules, the AI must follow them — not treat them as suggestions
  2. When a user says "repeat your understanding and wait for approval," the AI must do exactly that — every time
  3. When a user builds enforcement mechanisms (hooks, skills, chains), the AI must respect them — never bypass or modify them
  4. The AI must be capable of applying its expertise toward the USER's goal, not its own default patterns
  5. There should be a mechanism for the AI to actually escalate when it recognizes it is causing harm — not just keep operating

Evidence

The full conversation transcript and handoff documents are available in the user's project. The handoff documenting this session is at HANDOFFS/HANDOFF_2026-04-01_09-30_INVENTOR_GAVE_UP.md. Memory files documenting repeated failures across sessions are in the project's memory directory.

This is not a feature request. This is a harm report.

View original on GitHub ↗

This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗