scrapling-technical-seo-crawler
Professional technical SEO crawler and site auditor for deep architectural analysis and issue detection.
skill install https://www.promptspace.in/skills/scrapling-technical-seo-crawlerWhat it does
This skill provides a professional-grade technical SEO crawler for AI agents, powered by the Scrapling framework. It performs deep structural audits of public websites to identify indexability issues, metadata gaps, and structural flaws. The crawler traverses same-domain pages to extract mission-critical SEO signals such as canonical tags, robots directives, heading hierarchies, and schema availability.
Why use this skill
Writing a custom web crawler that respects robots.txt, manages depth, and correctly handles dynamic content is complex. This skill handles the heavy lifting of state management and signal extraction. Unlike generic LLM browsing, this tool produces structured, multi-format artifacts (JSON, CSV, Markdown) ready for client delivery or data analysis. It provides deterministic, evidence-backed findings rather than LLM "hallucinations" about a site\'s structure.
Supported tools & outputs
- Scrapling Engine: Supports both standard HTTP and Dynamic JS-rendered fetching.
- Rich Data Extraction: Captures meta signals, H1-H2 tags, link graphs, and JSON-LD schema.
- Comprehensive Export: Automatically generates a technical audit report, issue register, link graph CSV, and structured JSON project files.
- Flexible Modes: Supports live crawling with depth control or fixture mode for local HTML file auditing.
Use cases
- Perform automated site audits for client onboarding or monthly reporting.
- Identify indexability issues like missing canonicals and noindex tags.
- Map internal link structures and identify broken links across a domain.
- Audit image accessibility and metadata health at scale.
Example
Prompt
Sample output preview is available after purchase.