/ultrareview: task-notification surfaces only a subset of verified findings (2 of 8); dashboard text not selectable
Hi — wanted to flag two issues with the /ultrareview integration discovered during a code-review session today.
Environment
- Claude Code 2.1.129
- macOS (Darwin 25.4.0)
/ultrareviewfree tier (Free ultrareview 2 of 3in the launch banner)
Setup
- Repository:
mlehmhk-create/legal-document-anonymizer - PR #8 (draft, base=main, head=feature branch, ~13 commits diff)
- Invoked from the CLI:
/ultrareview 8 - Cloud session URL:
https://claude.ai/code/session_01FB4ePvSqiyTp3gMuhvFHGj
Issue 1 — task-notification surfaces only a subset of findings
The cloud dashboard reported:
Setup ✓
Find: 23 candidates
Verify: 8 confirmed · 15 refuted
Dedupe: 8 issues
So 8 verified, corroborated, deduped findings. However, the task-notification Claude Code received on completion contained only 2 of those 8 (bug_007 and bug_008 in the internal numbering). The structured JSON delivered to the in-IDE channel had corroborated_by: null on both, suggesting a corroboration- or confidence-based filter is applied between "verified by the dashboard" and "delivered to Claude Code." Whatever the filter is, it's not visible to the user and not documented in the launch banner.
Impact: a user who triages findings via Claude Code (the recommended workflow) silently misses 75% of the review's output unless they remember to manually open the cloud dashboard and cross-check the count. For non-developer users this is especially easy to miss — the in-IDE response looks complete.
Suggested fix options:
- (a) Send all verified findings to the
task-notification, not just the highest-confidence subset. - (b) If the filter is intentional, include a count (
"2 of 8 surfaced; see dashboard for the rest") in the notification so users know to follow up. - (c) Post the full set to the GitHub PR as inline review comments. In my case the PR had 0 comments / 0 reviews after
/ultrareviewcompleted — confirmed viagh api repos/.../pulls/8/commentsandgh pr view 8 --json reviews.
Issue 2 — Cloud dashboard text isn't selectable / copyable
After noticing the gap above, I tried to copy the missing 6 findings out of the cloud dashboard to paste back into Claude Code for triage. Cmd+C / select-text didn't work — the findings list appears to be in a component that blocks text selection. Opening the dashboard URL in a fresh browser tab went to the claude.ai login wall rather than the session view.
Workaround that did work: screenshot the dashboard, drag the PNG into Claude Code, let it read the text via vision. Fine for one-off; not great for systematic triage at scale.
Suggested fix options:
- (a) Make the findings list copyable as text, or
- (b) Provide a "Copy all" / "Export as JSON" button, or
- (c) Make the dashboard URL shareable so a session can be reopened in a separate browser tab without re-auth friction.
Why this matters
The integration's value proposition is "AI reviewer findings flow back to Claude Code so the user can triage and fix in-place." Issue 1 breaks the flow-back; Issue 2 blocks the manual workaround. Together they meaningfully reduce the free-tier /ultrareview value.
Both issues are reproducible — happy to re-run or share more details (session IDs, raw task-notification JSON) if helpful.
Thanks for the great tool overall.
This issue has 3 comments on GitHub. Read the full discussion on GitHub ↗