Crawl Readiness — AI Crawler Check for Any Site
Overview
See which of 60 AI crawlers a site lets in, its access policy, and whether the server enforces it. Free, no signup.
Is your site set up for AI the way you intend? Crawl Readiness answers in one click, on any site you visit: which AI crawlers it lets in, the access policy it states, and whether the server actually enforces it. Free, no signup. WHAT THE CHECK SHOWS (FREE, NO ACCOUNT) • A 0–100 readiness score and a plain verdict: AI Ready, Partial Access, Needs Work or Not AI Ready, with neutral labels for a site that restricts AI on purpose, a site whose content needs JavaScript, and a site whose server turned the check away • Which of 60 AI crawlers the site's robots.txt lets in, the ones behind ChatGPT, Claude, Perplexity, Google's AI and the rest, each with what it is for • The access policy the site states (open to AI, AI search without AI training, closed, or mixed) and whether the server does what it says when a crawler asks • Blocking AI training costs no points: the score counts the crawlers that fetch pages for AI search and answers, and training-only crawlers are shown apart • A link to the full report, a page you can share • 10 free checks a day WITH A FREE KEY (50 CHECKS A MONTH, NO CARD) Get a key at crawlreadiness.com/dashboard and paste it into Settings to see every signal in the popup: • robots.txt and sitemap • Structured data (JSON-LD), meta robots and Open Graph • llms.txt and agents.json, shown as optional extras that never count against the score ON CRAWLREADINESS.COM • Generators for llms.txt, an AI-crawler robots.txt (with an "AI search, no AI training" preset) and JSON-LD structured data, free with an account • Validators for robots.txt and structured data, and a comparison of what AI crawlers receive with what people see, no account needed • The Machine Readiness Audit ($49, once): the whole site measured, with the files that fix it • Monitor ($29 a month): 1,000 checks, 5 sites re-checked weekly or daily with an alert when the verdict or the access policy changes, a monthly Answer Analysis per site on live AI search, bulk checks, and the fixes plus every crawler inside this extension • Agency ($99 a month): 5,000 checks, 20 client sites, white-label client reports, bulk checks of 100 sites and client workspaces PRIVACY The extension reads the address of the tab you are on when you open it, and sends that address (and your API key, if you saved one) to crawlreadiness.com only when you press "Check This Site". It collects nothing else. Privacy policy: https://www.crawlreadiness.com/privacy Questions: support@crawlreadiness.com
0 out of 5No ratings
Details
- Version1.1.0
- UpdatedOctober 31, 2026
- Size24.76KiB
- LanguagesEnglish
- DeveloperWebsite
Email
crawlreadiness@gmail.com - Non-traderThis developer has not identified itself as a trader. For consumers in the European Union, please note that consumer rights do not apply to contracts between you and this developer.
Privacy
This developer declares that your data is
- Not being sold to third parties, outside of the approved use cases
- Not being used or transferred for purposes that are unrelated to the item's core functionality
- Not being used or transferred to determine creditworthiness or for lending purposes
Support
For help with questions, suggestions, or problems, visit the developer's support site