Robots.txt Disallowed
Item media 1 screenshot

Overview

This extension will report if a page is disallowed in robots.txt

See if a URL is allowed or disallowed in robots.txt for a specific user-agent token. If the URL is disallowed, it will not be crawled by the crawler with the matching user-agent token.

0 out of 5No ratings

Google doesn't verify reviews. Learn more about results and reviews.

Details

  • Version
    1.1
  • Updated
    June 5, 2020
  • Offered by
    XYZing
  • Size
    43.69KiB
  • Languages
    English
  • Developer
    Email
    chris@chris24.co.uk
  • Non-trader
    This developer has not identified itself as a trader. For consumers in the European Union, please note that consumer rights do not apply to contracts between you and this developer.

Privacy

The developer has not provided any information about the collection or usage of your data.

Related

AI Content Detector for ChatGPT - Sapling.ai

5.0(4)

Quickly check if any content was AI generated, and make sure your writing isn't!

IPRoyal Proxy Manager

4.4(32)

IPRoyal Proxy Manager

Allow Copy/Paste

5.0(2)

An extension to permit copy and paste on sites that block this feature.

X-Forwarded-For Header

4.6(18)

This extension allows you quickly to set the X-Forwarded-For HTTP Header

Ears: Bass Boost, EQ Any Audio!

4.5(3.5K)

EQ any audio you find on the web, live! Crank the bass, dim the highs, up the vocals: all with Ears!

Document GPS

5.0(26)

Track, modify and delete already sent attachments using blockchain-based security.

VK Styles - Themes for vk.com

4.9(19.2K)

Install themes for Vkontakte in one click, or adjust colors, backgrounds, fonts and more as you prefer in the settings menu.

Yandex Music Downloader

4.2(331)

Загружай любимые треки без ограничений, с новым расширением для Yandex Music!

Remove Ads from Photopea

4.7(43)

Hides the ads on Photopea

1ClickVPN Proxy for Chrome

4.6(109)

Get the best VPN access to any website, and unblock the content you want with 1ClickVPN

Censor Tracker – Proxy for Privacy & Security

4.0(255)

A censorship circumvention extension. Stay safe online with our proxy extension.

Privacy Tweaks

3.7(11)

Improve your online privacy with few tweaks via toolbar popup!

AI Content Detector for ChatGPT - Sapling.ai

5.0(4)

Quickly check if any content was AI generated, and make sure your writing isn't!

IPRoyal Proxy Manager

4.4(32)

IPRoyal Proxy Manager

Allow Copy/Paste

5.0(2)

An extension to permit copy and paste on sites that block this feature.

X-Forwarded-For Header

4.6(18)

This extension allows you quickly to set the X-Forwarded-For HTTP Header

Ears: Bass Boost, EQ Any Audio!

4.5(3.5K)

EQ any audio you find on the web, live! Crank the bass, dim the highs, up the vocals: all with Ears!

Document GPS

5.0(26)

Track, modify and delete already sent attachments using blockchain-based security.

VK Styles - Themes for vk.com

4.9(19.2K)

Install themes for Vkontakte in one click, or adjust colors, backgrounds, fonts and more as you prefer in the settings menu.

Yandex Music Downloader

4.2(331)

Загружай любимые треки без ограничений, с новым расширением для Yandex Music!

Google apps