back
loading skill details...
|
Web Research with x402 APIs
Access Exa (neural search) and Firecrawl (web scraping) through x402-protected endpoints.
Setup
See rules/getting-started.md for installation and wallet setup.
Quick Reference
Task
Endpoint
Price
Best For
Neural search
https://stableenrich.dev/api/exa/search
$0.01
Semantic web search
Find similar
https://stableenrich.dev/api/exa/find-similar
$0.01
Pages similar to a URL
Extract text
https://stableenrich.dev/api/exa/contents
$0.002
Clean text from URLs
Direct answers
https://stableenrich.dev/api/exa/answer
$0.01
Factual Q&A
Scrape page
https://stableenrich.dev/api/firecrawl/scrape
$0.0126
Single page to markdown
Web search
https://stableenrich.dev/api/firecrawl/search
$0.0252
Search with scraping
Crawl website
https://stableenrich.dev/api/cloudflare/crawl
$0.10
Multi-page site crawl
Poll crawl
GET https://stableenrich.dev/api/cloudflare/jobs?token=...
Free
Poll crawl results
When to Use What
Scenario
Tool
General web search
WebSearch (free) or Exa ($0.01)
Semantic/conceptual search
Exa search
Find pages like X
Exa find-similar
Get clean text from URL
Exa contents
Scrape blocked/JS-heavy site
Firecrawl scrape
Search + scrape results
Firecrawl search
Quick fact lookup
Exa answer
Crawl entire site/section
Cloudflare crawl
See rules/when-to-use.md for detailed guidance.
Exa Neural Search
Semantic search that understands meaning, not just keywords:
npx agentcash@latest fetch https://stableenrich.dev/api/exa/search -m POST -b '{
"query": "startups building AI agents for customer support",
"numResults": 10,
"type": "neural"
}'
Options:
query - Search query (required)
numResults - Number of results (default: 10, max: 25)
type - "neural" (semantic) or "keyword" (traditional)
includeDomains - Only search these domains
excludeDomains - Skip these domains
startPublishedDate / endPublishedDate - Date range filter
category - Filter by content type: "company", "research paper", "news", "pdf", "github", "tweet", "personal site", "linkedin profile", "financial report"
Tip: Use category: "linkedin profile" for people/profile discovery
Returns: List of URLs with titles, snippets, and relevance scores.
Find Similar Pages
Find pages semantically similar to a reference URL:
npx agentcash@latest fetch https://stableenrich.dev/api/exa/find-similar -m POST -b '{
"url": "https://example.com/article-i-like",
"numResults": 10
}'
Great for:
Finding competitor products
Discovering related content
Expanding research sources
Extract Text Content
Get clean, structured text from URLs:
npx agentcash@latest fetch https://stableenrich.dev/api/exa/contents -m POST -b '{
"urls": [
"https://example.com/article1",
"https://example.com/article2"
]
}'
Options:
urls - Array of URLs to extract
text - Include full text (default: true)
highlights - Include key highlights
Cheapest option ($0.002) when you already have URLs and just need the content.
Direct Answers
Get factual answers to questions:
npx agentcash@latest fetch https://stableenrich.dev/api/exa/answer -m POST -b '{"query": "What is the population of Tokyo?"}'
Returns a direct answer with source citations. Best for:
Factual questions
Quick lookups
Verification of claims
Firecrawl Scrape
Scrape a single page to clean markdown:
npx agentcash@latest fetch https://stableenrich.dev/api/firecrawl/scrape -m POST -b '{"url": "https://example.com/page-to-scrape"}'
Options:
url - Page to scrape (required)
formats - Output formats: ["markdown", "html", "links"]
onlyMainContent - Skip nav/footer/ads (default: true)
waitFor - Wait ms for JS to render
Advantages over WebFetch:
Handles JavaScript-rendered content
Bypasses common blocking
Extracts main content only
LLM-optimized markdown output
Firecrawl Search
Web search with automatic scraping of results:
npx agentcash@latest fetch https://stableenrich.dev/api/firecrawl/search -m POST -b '{
"query": "best practices for react server components",
"limit": 5
}'
Options:
query - Search query (required)
limit - Number of results (default: 5)
scrapeOptions - Options passed to scraper
Returns search results with full scraped content for each.
Cloudflare Website Crawl
Crawl multiple pages from a website with browser rendering. Async two-step pattern.
Step 1: Start the crawl (paid, $0.10)
npx agentcash@latest fetch https://stableenrich.dev/api/cloudflare/crawl -m POST -b '{
"url": "https://example.com",
"limit": 10,
"depth": 1,
"formats": ["markdown"]
}'
Returns 202 with {"token": "jwt..."}.
Step 2: Poll for results (SIWX, free)
npx agentcash@latest fetch "https://stableenrich.dev/api/cloudflare/jobs?token=JWT_TOKEN"
Poll every 3-5 seconds until complete.
Parameters:
url (required) — starting URL
limit (default 10, max 25) — max pages
depth (default 1, max 3) — max link depth
formats — ["markdown", "html", "json"]
render (default false) — execute JavaScript
options.includePatterns / excludePatterns — URL wildcards
Good for: crawling docs sites, scraping multiple pages, building sitemaps.
Workflows
Deep Research
(Optional) Check balance: npx agentcash@latest balance
Search broadly with Exa
Find related sources with find-similar
Extract content from top sources
Synthesize findings
npx agentcash@latest fetch https://stableenrich.dev/api/exa/search -m POST -b '{"query": "AI agents in healthcare 2024", "numResults": 15}'
npx agentcash@latest fetch https://stableenrich.dev/api/exa/find-similar -m POST -b '{"url": "https://best-article-found.com"}'
npx agentcash@latest fetch https://stableenrich.dev/api/exa/contents -m POST -b '{"urls": ["url1", "url2", "url3"]}'
Blocked Site Scraping
Try WebFetch first (free)
If blocked/empty, use Firecrawl with waitFor for JS-heavy sites
npx agentcash@latest fetch https://stableenrich.dev/api/firecrawl/scrape -m POST -b '{"url": "https://blocked-site.com/article", "waitFor": 3000}'
Cost Optimization
Use Exa contents ($0.002) when you already have URLs
Use WebSearch/WebFetch first (free) and fall back to x402 endpoints
Batch URL extraction - pass multiple URLs to Exa contents
Limit results - request only as many as neededdon't have the plugin yet? install it then click "run inline in claude" again.