# Crawl Readiness

Audit any site for 50\+ AI crawlers, generate llms\.txt, robots\.txt and schema, track AI mentions\.

Canonical: https://claudelist.com/listings/mcp-reg-io-github-grubbomatic-crawl-readiness-69516bf58d

Category: MCP Servers

Source: community · Grubbomatic

Source checked: 2026-10-14

Website: https://www.claudemcp.org/mcp/registry/io-github-grubbomatic-crawl-readiness-69516bf58dc7.html

Publisher description: Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

## Install or set up

1. Review the publisher repository and npm package `crawl-readiness-mcp@0.2.5` before running it. The MCP Registry declares this package as a stdio server.
2. Install Node.js, then run the command below in your Claude Code project. Check the publisher README for any account or configuration requirements.
3. Restart Claude Code and use `/mcp` to confirm the connection and review its tools and permissions.

```sh
claude mcp add mcp-io-github-grubbomatic-crawl-readiness-69516b -- npx -y crawl-readiness-mcp@0.2.5
```

Installation guide: https://github.com/Grubbomatic/crawl-readiness-mcp