Overview
Live robots.txt analyser — toolbar icon plus per-cluster status for 120+ AI, search and commercial crawlers.
Robots.TXT Radar analyses the current site's /robots.txt in real time and shows an animated color-coded icon in your Chrome toolbar — automatically on every page load, no clicking required. 🟢 GREEN ✓ — path is allowed for crawling 🔴 RED ✗ — path is disallowed 🟢 TEAL ✓ — no robots.txt found, all paths open 📡 SCANNING — animated radar sweep while fetching HOW IT WORKS On every navigation Robots Radar fetches /robots.txt for that domain (cached for 1 hour per domain), parses it using Google's exact specification, and evaluates the current URL path against the correct user-agent group. BOT PRIORITY Rules are evaluated in this order, falling back to the next if no explicit group is found: Googlebot → Bingbot → CCBot → Google-Extended → * wildcard SPECIFICATION-COMPLIANT PARSING • Longest-path specificity rule (Google/RFC 9309 standard) • Allow beats Disallow on equal path length • Multiple groups for the same agent are merged • Agent normalisation: Googlebot/2.1 and googlebot* match correctly • Relaxed blank-line handling (Googlebot's documented behaviour) • Correct * and $ wildcard path matching FEATURES • Animated radar sweep while scanning — satisfying to watch • Dark mode / Light mode toggle, preference remembered • Per-domain caching — no redundant fetches • Click the toolbar icon for full details: – Which bot group was matched – The single winning rule with Allow/Disallow badge – Specificity bar showing match precision – Syntax-highlighted robots.txt source viewer PRIVACY Robots Radar only contacts the domain you are currently visiting to fetch its public /robots.txt file. No data is collected, stored, or shared. No analytics, no tracking, no third-party requests.
Details
- Version2.6.3
- UpdatedMay 17, 2026
- Size78.93KiB
- LanguagesEnglish
- DeveloperDHEMANT Consulting GmbHWebsite
Horbeller Str. 31 Köln 50858 DEEmail
rene@dhemant.consultingPhone
+49 1579 2338601 - TraderThis developer has identified itself as a trader per the definition from the European Union and committed to only offer products or services that comply with EU laws.
- D-U-N-S344893985
Privacy
This developer declares that your data is
- Not being sold to third parties, outside of the approved use cases
- Not being used or transferred for purposes that are unrelated to the item's core functionality
- Not being used or transferred to determine creditworthiness or for lending purposes
