web-crawler

SKILL.md

Web crawler

All-in-one scraping skill. Routes requests to the best backend automatically — the user does not need to know which API is used.

Use this when:

Normal web_fetch fails, returns boilerplate, or a site blocks basic fetching

The user asks for YouTube video content/transcript

The user wants to scrape, fetch, or extract data from any social media platform

The user mentions social media profiles, posts, comments, transcripts, ads, trending content, or engagement metrics

Prefer native web_fetch first for simple pages; paid fallback calls should be deliberate and scoped.

What each service is for

ScrapeCreators — Social media data extraction (27+ platforms)

Use for any request involving social media profiles, posts, videos, comments, transcripts, search, ads, trending content, or engagement metrics. Covers TikTok, Instagram, YouTube, LinkedIn, Facebook, Twitter/X, Reddit, Threads, Bluesky, Pinterest, Snapchat, Twitch, Kick, Truth Social, TikTok Shop, Google search, and link-in-bio services (Linktree, Komi, Pillar, Linkbio, Linkme, Amazon Shop).