[FEATURE] Accessibility/productivity focused Claude assistant with eye & voice support

Preflight Checklist

• [x] I have searched existing requests and this feature hasn't been requested yet
• [x] This is a single feature request (not multiple features)

Problem Statement

I often use Claude for coding-related tasks, but mostly as a way to gather insights and explanations. For example, I might ask “what does codeWithALotOfLayers do?” just to get a general understanding of the code.

I’m not doing a lot of "vibecoding," so most of the time I just want to ask a question and quickly get an explanation, ideally even as a short, direct (possibly vocal) response.

Proposed Solution

I’d like to have an API that connects Claude to an eye-tracker program, a voice reader, and a background listener.

In the ideal workflow, Claude would act like a paired "Jarvis":

• Watching the code alongside me and surfacing insights when relevant.
• Letting me ask questions naturally (by voice or text) and receiving quick, clear responses - potentially spoken back to me.
• Providing context-aware explanations of the code I’m currently looking at, without me needing to constantly switch, copy/paste or write interrupting my workflow.

Also this would also be a huge win for accessibility, making it easier to work and understand complex codebases hands free.

Alternative Solutions

_No response_

Priority

High - Significant impact on productivity

Feature Category

CLI commands and flags

Use Case Example

Example scenario

1. I’m reviewing a large codebase with several layers of abstraction.
2. My eye tracker notices I’m looking at a function processUserInput().
3. I ask about it and Claude automatically provides a short spoken summary: “This function validates input and passes it to the parser.”
4. I have a follow-up question: I ask out loud, “Where is the parser defined?”
5. Claude listens in the background, finds the parser code, and responds with a quick explanation, either in voice or in a side panel.
6. As I continue reading, Claude highlights or explains related code pieces, almost like a second set of eyes following me.

This would make it much easier to stay in flow, reduce context switching, and help me understand complex systems faster.

Additional Context

Feature: Coding assistant with eye tracking and voice

  Scenario: Code context explanation via eye tracker
    Given I am reviewing a code file with the eye tracker active
    When my gaze focuses on the function "processUserInput"
    Then Claude should provide a short spoken explanation of what the function does

  Scenario: Follow-up question by voice
    Given I am reviewing the function "processUserInput"
    And Claude has already explained its purpose
    When I ask by voice "Where is the parser defined?"
    Then Claude should respond with the file and line number where the parser is located
    And provide a spoken summary of its purpose

  Scenario: Accessibility hands-free workflow
    Given the assistant is running with eye tracker and background listener enabled
    When I navigate code by sight and voice
    Then I should be able to understand code structure without needing mouse or keyboard input