Item logo image for RoboView

RoboView

estevecastells.com
5.0(

1 rating

)
ExtensionDeveloper Tools36 users
Item media 1 (screenshot) for RoboView

Overview

View websites according to robots.txt rules

RoboView: Visualize & Debug robots.txt Files RoboView lets you experience websites exactly as search engine crawlers and AI bots do, by enforcing robots.txt rules in real-time. Perfect for SEO professionals, web developers, and content creators who need to verify crawler accessibility. Key Features - Multiple Bot Simulation - Switch between popular crawler user-agents: * Search engines (Google, Bing, Baidu, Yandex) * AI crawlers (GPTBot, Claude, Perplexity) * Social media bots (Twitter/X, Facebook, LinkedIn) - Visual Indicators - Instantly see which content is allowed or blocked: * Blocked images appear grayed out with clear visual overlays * Blocked scripts and resources are highlighted * Full-page overlay for completely disallowed pages - Two Enforcement Modes: * Visual Mode: Show what's blocked without affecting functionality * Strict Mode: Actually block resources like a real crawler would - Cross-Domain Analysis - Examines robots.txt files from all resource domains, including CDNs and external hosts - Detailed Statistics - Track blocked resources and robots.txt status across sites - Developer Tools: * Robust robots.txt parser with accurate pattern matching * Comprehensive debug logs for troubleshooting * Copy button for sharing logs with your team Perfect For - SEO specialists validating crawler access - Web developers debugging robots.txt files - Content creators ensuring AI training data access - Security professionals verifying protection of sensitive content RoboView makes robots.txt testing quick and visual - no more guesswork about what crawlers can access on your site!

Details

  • Version
    1.1
  • Updated
    March 20, 2025
  • Size
    23.87KiB
  • Languages
    English
  • Developer
    Esteve Castells
    Carrer de Sant Joan, 49, 2n 1er Arenys de Mar, Barcelona 08350 ES
    Website
    Email
    esteve@estevecastells.com
    Phone
    +34 627 27 74 54
  • Trader
    This developer has identified itself as a trader per the definition from the European Union and committed to only offer products or services that comply with EU laws.
  • D-U-N-S
    472033643

Privacy

The developer has disclosed that it will not collect or use your data. To learn more, see the developer’s privacy policy.

This developer declares that your data is

  • Not being sold to third parties, outside of the approved use cases
  • Not being used or transferred for purposes that are unrelated to the item's core functionality
  • Not being used or transferred to determine creditworthiness or for lending purposes
Google apps