scraper-builder

SKILL.md

Scraper Builder

Generate complete, runnable web scraper projects using the PageObject pattern with Playwright and TypeScript. This skill produces site-specific scrapers with typed data extraction, Docker deployment, and optional agent-browser integration for automated site analysis.

When to Use This Skill

Use this skill when:

Building a site-specific web scraper for data extraction

Generating PageObject classes for a target website

Scaffolding a complete scraper project with Docker support

Using agent-browser to analyze a site and auto-generate selectors

Creating reusable scraping components (pagination, data tables)

Do NOT use this skill when:

Building API clients (use HTTP client libraries directly)

Writing QA/E2E test suites (use Playwright test runner with test-focused patterns)

Mass crawling or spidering entire domains (use Crawlee or Scrapy)

Scraping sites that require authentication bypass or CAPTCHA solving