Feature concept: Interactive terminal widgets for human-AI perceptual bridging

Resolved 💬 2 comments Opened Feb 23, 2026 by michaelatdopple Closed Mar 23, 2026

Summary

A proposal for interactive terminal widgets that bridge embodied human intelligence with Claude Code's symbolic reasoning — sliders, screen captures, verdict buttons, and choice widgets that route decisions to whichever intelligence handles them best.

Full essay: https://gist.github.com/michaelatdopple/0ca8a224433bf30185049cad1bdf984d

Core Idea

LLMs excel at symbolic reasoning but can't perceive. Humans have remarkable sensory judgment but struggle to articulate it in text. Current CLI interactions force everything through text, losing embodied knowledge.

Proposed Widgets

  • live_action slider — Human hands optimize values in real time (e.g., tuning thresholds, visual parameters)
  • screen widget — Captures spatial coordinates and visual judgment from rendered output
  • verdict button — Records human acceptance testing (looks right / doesn't)
  • choice widget — Agent asks the human when genuinely uncertain, with structured options

Why This Fits Claude Code

Claude Code already has AskUserQuestion with structured options — this extends that pattern into richer perceptual input. The terminal is the right venue: it's where developers already work, and TUI frameworks support these widgets today.

References

Builds on Licklider (1960) human-computer symbiosis, Horvitz (1999) mixed-initiative interaction, and Polanyi (1966) tacit knowledge.

View original on GitHub ↗

This issue has 2 comments on GitHub. Read the full discussion on GitHub ↗