Overview
Instantly see which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and more) are allowed or blocked on any website.
AI Crawler Check helps website owners quickly see how their site handles automated AI crawlers. With one click, it inspects your site's robots.txt and related settings so you can understand which AI crawlers are permitted and which are blocked — no manual file digging required. Key features: Instantly checks whether your site allows or blocks major AI crawlers. Clear, readable results so you can confirm your settings match your intentions. Simple one-click operation directly from your browser toolbar. Helpful for site owners, SEO specialists, and developers who want visibility into their crawler policy. Whether you want to allow AI crawlers for greater reach or block them to protect your content, AI Crawler Check gives you a fast, clear picture of your current setup
Details
- Version1.0.0
- UpdatedAugust 27, 2026
- Size12.78KiB
- LanguagesEnglish
- DeveloperWebsite
Email
joshmarwords@gmail.com - Non-traderThis developer has not identified itself as a trader. For consumers in the European Union, please note that consumer rights do not apply to contracts between you and this developer.
Privacy
This developer declares that your data is
- Not being sold to third parties, outside of the approved use cases
- Not being used or transferred for purposes that are unrelated to the item's core functionality
- Not being used or transferred to determine creditworthiness or for lending purposes
