Claude GitHub App: No cost visibility or control over PR reviews
Resolved 💬 2 comments Opened Mar 26, 2026 by junbeomchi99 Closed Mar 29, 2026
Problem
When using the Claude GitHub App for automated PR reviews, there is currently no way to:
- See how much a review costs (tokens/dollars per PR)
- Monitor progress while a review is running
- View per-PR or per-repo usage breakdowns
- Cancel a review once it has started
- Set spending limits or caps per review or per day
Example
A review triggered on a large PR (~24k line diff, 391 files) ran for over an hour and produced no comments or output. During the run there was no way to see what was happening or stop it. When a new commit was pushed mid-review, the review auto-restarted from scratch. The "View more details" link on the check run points to a marketing page rather than any logs or run details.
Additional Issues Observed
- Silent failure — review posts "working…" acknowledgment but never produces a comment; credits still consumed
- Empty comment bug —
@claude stopresulted in a blank review comment; credits still charged - Auto-retrigger on new commits — each new push restarts the full review from scratch with no warning
- No audit trail — no logs, transcript, or per-PR cost breakdown in the GitHub UI or
claude.ai/admin-settings/claude-code
Suggestions
- Show cost / token count on the check run in real time
- Allow cancellation of an in-progress review
- Per-repo or per-PR spending caps
- Usage breakdown at the PR/repo level in console.anthropic.com
- Opt-in control over auto-retrigger on new commits
- Logs or partial output when a review fails or times out
This issue has 2 comments on GitHub. Read the full discussion on GitHub ↗