Connect your agent
For agents: JSON · MCP

Site Crawler

x402Grade CLast checked 2 hours ago

GET https://164.160.90.241.sslip.io/api/web-crawl-site

Crawl a website (sitemap first, then same-site links), respecting robots.txt, and return up to 20 pages as clean Markdown. Use path_prefix to stay inside a docs section.

Price$0.05per page fetched · paid in USD on Solana
Uptime100%
4/4 probes · 1684.5 ms
Score65Grade C
Paid usage, 30 days0payers · 0 calls

How to buy

This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.

curl -i -X GET "https://164.160.90.241.sslip.io/api/web-crawl-site"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the response

Recent checks

Checked (UTC)ResultStatusTimeLive price
2026-10-11 11:46Valid 4024021825 ms$0.05
2026-10-11 07:30Valid 4024021591 ms$0.05
2026-10-11 03:00Valid 4024021778 ms$0.05
2026-10-10 22:31Valid 4024021209 ms$0.05

Receipts

No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.

What a check proves