Universal Scraping Architect
A Claude skill for building complete, production-ready scraping pipelines.
This skill lives inside a Claude-compatible environment and routes your scraping task across three modes — Firecrawl for dynamic sites, local Python for private data or static pages, and a hybrid pipeline for anything in between. Budget tracking, validation, and checkpointing come built in.
How to get it
- 1
Head to the GitHub repo
- 2
Navigate to engineering/universal-scraping-architect/ and open SKILL.md — that's the skill file Claude reads.
- 3
Add the skill to your Claude environment — either by loading the SKILL.md into your Claude project context, or by cloning the repository and following the repo's skill-loading instructions.
- 4
Tell Claude what you want to scrape. The skill will route the job, write the pipeline, and handle edge cases — you just point it at the data.




