Overview
Audits robots.txt to verify if AI, LLM, and Search Engine bots are whitelisted or blocked.
# AI Bot Inspector 🤖 A premium Chrome Extension designed for web developers, SEO specialists, and site operators to audit `robots.txt` compliance against 40+ top AI bots, LLM training scrapers, search engines, and RAG agents. Ensure your content-crawling policies match your intent with a single click. --- ## 🚀 Key Features * **⚡ Automatic Single-Click Audits**: Grabs the active tab's domain, retrieves `/robots.txt`, and parses it instantly without console copy-pasting. * **🔬 Multi-Agent Compliance Engine**: Vets rules for 40+ crawlers, including OpenAI , Google , , Meta, Apple, and Common Crawl. * **📊 Traffic Light Classification**: Categorizes compliance levels into **Errors** (explicitly blocked 🔴), **Warnings** (implicit fallback allowed 🟡), and **Passes** (explicitly whitelisted 🟢). * **🏗️ Interactive Sandbox Mode**: Paste, test, and live-debug custom `robots.txt` text blocks before deploying them to production. * **🔍 Search & Group Filters**: Instantly find specific bots or filter listings by severity category and purpose. * **📥 CSV Audit Exporter**: Download standard audit spreadsheets for reporting and compliance tracking. --- ## 🛠️ Installation & Setup 1. Clone this directory or extract the zip archive. 2. Open Google Chrome and navigate to `chrome://extensions/`. 3. Toggle **Developer mode** (top-right corner) to **ON**. 4. Click **Load unpacked** (top-left corner). 5. Select this project directory (`ai-bot-inspector`). --- ## 📜 Supported Crawlers We audit classifications across: * **Search Engines** * **AI Model Training** * **AI User Fetches / RAG**
Details
- Version1.1.0
- UpdatedJuly 15, 2026
- Size1.2MiB
- LanguagesEnglish
- Developer
Email
me@irakli.life - Non-traderThis developer has not identified itself as a trader. For consumers in the European Union, please note that consumer rights do not apply to contracts between you and this developer.
Privacy
AI Bot Inspector has disclosed the following information regarding the collection and usage of your data. More detailed information can be found in the developer's privacy policy.
AI Bot Inspector handles the following:
This developer declares that your data is
- Not being sold to third parties, outside of the approved use cases
- Not being used or transferred for purposes that are unrelated to the item's core functionality
- Not being used or transferred to determine creditworthiness or for lending purposes
