CrawlCheck – AI Crawler & SEO Checker

AI crawler & SEO checker: what GPTBot, ClaudeBot, Perplexity and Googlebot get from your site. robots.txt, llms.txt, schema, vitals.

CrawlCheck is a free AI crawler checker and SEO checker for Chrome. It shows what GPTBot (ChatGPT), ClaudeBot (Claude), PerplexityBot, Google-Extended and Googlebot actually receive from your website, and what they miss, from your own browser. A server-side SEO tool can only tell you what a crawler is served from a data centre. CrawlCheck also measures what is served to your address, in your browser, after your JavaScript runs: the half other tools are blind to. WHAT IT CHECKS - AI crawler access: requests the page as each named AI crawler and as your browser, and shows where the answers differ. A block or a challenge page that only crawlers get is the finding. - robots.txt checker: which AI and search crawlers your robots.txt allows or blocks, including rules a named user-agent group silently overrides. - llms.txt validator: whether llms.txt, agents.md, robots.txt and your XML sitemap resolve, and whether a 200 actually contains the file rather than a verification page. - JavaScript rendering check: headings, prices, schema and links that are on your screen but missing from the delivered HTML, which is what most AI crawlers read. - Schema and structured data: JSON-LD found on the page and what an answer engine can quote from it. - Core Web Vitals from real page loads: LCP, CLS, TTFB and long tasks on this connection. No API key; works on sites too small for public field data. - Consent and session walls: the cookie wall or login page an anonymous crawler gets that you never see. - Data Axle listing check (new): Data Axle is the one US business-data supplier named in Google's Maps provider list, and it blocks cloud servers. The extension checks whether the business on the current page is listed, from your browser. WHO IT IS FOR SEO specialists, agencies, developers and local business owners who want to know whether ChatGPT, Claude, Perplexity and Google AI Overviews can reach, read and cite their site: AI SEO, GEO (generative engine optimization) and AEO (answer engine optimization), measured instead of guessed. PRIVACY Page checks run in your browser, and requests to the site you check are made without your cookies. The extension sends to crawlcheck.io only: anonymous usage counts (never a URL, domain or page content; switch off in the popup footer), the domain you check when you use Two vantages, your licence key to validate it, and, if you save a licence key, the Data Axle result for the site you are on. It identifies itself honestly and does not use a crawler identity to get access it would not otherwise have. Free. A CrawlCheck licence adds the full scored report, history and weekly monitoring at crawlcheck.io; the extension works without one.