What crawlers see: SEO and AI crawler checker
Overview
Check any page for JavaScript SEO: words crawlers miss, noindex, canonical, robots.txt, and AI bots like GPTBot that are blocked.
Click the icon, or press Alt+Shift+C, to see what a search or AI crawler gets from the page you are on. Most AI crawlers do not run JavaScript. Googlebot runs it later, on a queue. If a site builds its text in the browser, crawlers can get an empty page while you see a full one. This extension fetches the page again as Googlebot Smartphone, without cookies and without running scripts, and puts the two side by side. For the page in the open tab it shows: 1. Words Googlebot reads without JavaScript, next to the words a visitor sees 2. 16 checks, from noindex, robots.txt and canonical to structured data and Open Graph 3. Title, canonical and robots tags that JavaScript changes after load, with the HTML value next to the final one 4. Which of 21 AI crawlers the site's robots.txt blocks, split into AI search and training 5. What GPTBot, ClaudeBot and PerplexityBot get when they fetch the page, including firewalls that block them by name 6. The page as it would appear in search results, and the raw text a crawler reads It also lets you: 1. Right-click any link to check it without leaving the page 2. Check 7 linked pages at once, with response times, and copy the results as CSV 3. Check a page again and see what changed since last time: words, issues and verdict 4. Switch to Googlebot Desktop or set how long to wait for rendering, in Settings Copy the whole report as Markdown to paste into a ticket or a client audit. Everything runs in your browser. The extension sends nothing to Pagerender or anyone else, needs no account, and only reads a page when you open it or right-click a link. Saved checks stay on your computer. To check every page in a sitemap, the panel gives you one command for the free Pagerender CLI. Built by Pagerender, which serves crawlable HTML to 47 search and AI crawlers. https://pagerender.io
5 out of 53 ratings
Details
- Version1.8.1
- UpdatedNovember 18, 2026
- Size99.27KiB
- LanguagesEnglish
- DeveloperWebsite
Email
siradze@nikusha.me - Non-traderThis developer has not identified itself as a trader. For consumers in the European Union, please note that consumer rights do not apply to contracts between you and this developer.
Privacy
This developer declares that your data is
- Not being sold to third parties, outside of the approved use cases
- Not being used or transferred for purposes that are unrelated to the item's core functionality
- Not being used or transferred to determine creditworthiness or for lending purposes
Support
For help with questions, suggestions, or problems, visit the developer's support site