[DOCS]

Documentation Type

Broken links

Documentation Location

https://code.claude.com/docs/en/claude_code_docs_map.md

Section/Topic

Access to documentation

Current Documentation

_No response_

What's Wrong or Missing?

The code.claude.com domain has a robots.txt configuration that blocks Claude's own web_fetch tool from accessing any pages, including the LLM-friendly markdown documentation (e.g. https://code.claude.com/docs/en/claude_code_docs_map.md). This means Claude cannot read its own Claude Code documentation when users ask it to fetch or reference those docs. The error returned is ROBOTS_DISALLOWED - Failed to fetch or parse robots.txt. Could the robots.txt on code.claude.com be updated to allow Claude's web_fetch user agent? These are docs specifically designed for LLM consumption, so blocking LLM access seems unintentional.

Suggested Improvement

Edit ROBOTS.TXT to make the file accessible

Impact

High - Prevents users from using a feature

Additional Context

_No response_