firecrawl-build-scrape

SKILL.md

Firecrawl Build Scrape

Use this when the application already has the URL and needs content from one page.

Use This When

the feature starts from a known URL

you need page content for retrieval, summarization, enrichment, or monitoring

you want the default extraction primitive before considering /interact

Default Recommendations

Return markdown unless the feature truly needs another format.

Use onlyMainContent for article-like pages where nav and chrome add noise.

Add waits or other rendering options only when the page needs them.

Freshness and Liveness

Firecrawl reuses recently indexed content, which is what makes repeat reads of the same URL fast. Set maxAge (milliseconds) to bound how old a reused copy may be, or maxAge: 0 to skip index reuse for a freshness-critical read.

Read metadata.cacheState and metadata.cachedAt to see what you actually got.

A successful scrape reports what the page returned. Whether the thing the page describes is still active is a source-specific judgment your code makes.

See references/freshness-and-liveness.md for the tradeoff, the metadata, and the decision rule.

Common Product Patterns

knowledge ingestion from known URLs

enrichment from a company, product, or docs page

pricing, changelog, and documentation extraction

page-level quality checks or monitoring

Escalation Rules

If you do not have the URL yet, start with firecrawl-build-search.

If content requires clicks, typing, or multi-step navigation, escalate to firecrawl-build-interact.

Implementation Notes

Keep the integration narrow: one feature, one URL, one extraction contract.

Treat /scrape as the default primitive for downstream LLM or indexing pipelines.

Request richer formats only when the consumer needs them, such as links, screenshots, or branding data.

Docs (Source of Truth)

Read the source-of-truth page for your project language before writing integration code:

Node / TypeScript: docs.firecrawl.dev/agent-source-of-truth/node

Python: docs.firecrawl.dev/agent-source-of-truth/python

Rust: docs.firecrawl.dev/agent-source-of-truth/rust

Java: docs.firecrawl.dev/agent-source-of-truth/java

Elixir: docs.firecrawl.dev/agent-source-of-truth/elixir

cURL / REST: docs.firecrawl.dev/agent-source-of-truth/curl

See Also

firecrawl-build

firecrawl-build-search

firecrawl-build-interact