RoboX - Robots & Sitemap Validator

A professional SEO tool by Wingmen: Validate Meta Robots, X-Robots, Robots.txt & Sitemaps directly in your browser.

Simplify your technical SEO analysis with RoboX by Wingmen. RoboX is the ultimate technical SEO companion for developers and SEO professionals. Validate the crawlability and indexability (Meta Robots, X-Robots, Robots.txt & Sitemaps) of any website in real-time directly in your browser – fast, secure, and privacy-focused. 🚀 Key Features: 1️⃣ Live Robots.txt Audit • Instant Status: See immediately if the current URL is allowed or disallowed via the dynamic icon badge. Choose between live background checks or on-demand analysis. • Deep Inspection: Pinpoints the exact rule and line number blocking or allowing the page. • RFC 9309 Validation: Automatically checks syntax against official standards. Detects critical errors, typos, and deprecated directives (e.g., "Noindex" in robots.txt). • Deviating Bots: Smartly detects if specific bots (like GPTBot, Bingbot, or CCBot) are treated differently than the standard wildcard (*). 2️⃣ Meta Robots & X-Robots-Tag Checker • Dual Analysis: Checks both HTML <meta> tags and HTTP X-Robots-Tag headers simultaneously. • Smart Conflict Detection: Warns you if tags conflict or if JavaScript injects/modifies meta tags after the initial page load (DOM vs. Raw HTML). • Clear Status: Instantly see Index/Noindex and Follow/Nofollow status based on the strict Google logic. 3️⃣ XML Sitemap Validator • One-Click Check: Auto-detects sitemaps linked in robots.txt. • Deep Validation: Audits file size, XML structure, HTTP status codes, logic errors (e.g., missing <loc> tags or invalid W3C date formats), and natively unzips GZIP (.gz) sitemaps. • Performance Aware: Warns about high RAM usage for massive sitemaps (>10,000 URLs) to keep your browser fast. • Type Detection: Identifies Sitemap Indices, Image, Video, and News sitemaps automatically. 4️⃣ URL Path Simulator • Scenario Testing: Simulate how different bots (Googlebot, Bingbot, ChatGPT, etc.) perceive the current page. • Path Input: Test specific subdirectories or files against the cached robots.txt instantly without having to navigate to them. 5️⃣ Workflow & Usability Tools • Snapshot Overlay: Detach the analysis into a floating window. Perfect for screen sharing, presentations, or keeping data visible while navigating the site. • Performance Control: Customize background check behavior in the extension settings and use the force-refresh button to clear the cache instantly. • Multi-Language Support: Fully localized interface available in both English and German. 🔒 Privacy First: Your data stays yours. • Client-Side Only: RoboX operates 100% locally in your browser. • No Tracking: We do not track your browsing history, analyze your traffic, or send data to external servers. • Transparent: The extension only connects strictly to the website you are visiting to fetch necessary technical files (like robots.txt). Made with ❤️ by Wingmen -- Bug Reports & Feedback: Found an issue? Please reach out via our contact form linked in the 'Support' section. -- Legal: Imprint: https://wngmn.com/en/imprint/ Privacy Policy: https://wngmn.com/en/privacy/