Overview
Bypass WAFs to securely crawl websites, check broken links (404, 301), and analyze meta data natively.
SEO Crawler & Broken Link Checker A powerful, browser-native SEO spider designed to bypass WAFs and anti-bot protections (like Cloudflare, Shopify, Haravan, Sapo) by utilizing actual browser network stacks. Core Features: 🕷️ Native Crawling: Never get blocked by fake 404s or bot detection again. 🔗 Broken Link Checker: Instantly find 404 dead links and 301/302 redirects. 📄 Metadata Extraction: Scrape Title and Meta Descriptions of all internal pages. 🗺️ Sitemap Orphans: Discover pages in your sitemap that have no internal links pointing to them. 🛡️ Smart Anti-bot Backoff: Automatically scales request delay if 429 Too Many Requests or 403 blocks are encountered. 📊 Instant CSV Export: Export your crawler data directly to CSV.
Details
- Version1.0.1
- UpdatedJune 19, 2026
- Size392KiB
- LanguagesEnglish
- DeveloperWebsite
Email
trieuvu@bigpen.vn - Non-traderThis developer has not identified itself as a trader. For consumers in the European Union, please note that consumer rights do not apply to contracts between you and this developer.
Privacy
This developer declares that your data is
- Not being sold to third parties, outside of the approved use cases
- Not being used or transferred for purposes that are unrelated to the item's core functionality
- Not being used or transferred to determine creditworthiness or for lending purposes
