Website Crawler to Markdown
x402Grade BLast checked 3 hours ago
POST https://agentsvc.io/api/v1/proxy/site-crawl
Website crawler: read a whole website or one section of it (for example every page under /docs) as clean Markdown: starts at a URL, follows same-site links breadth-first and returns up to 20 pages with title and description. Use for documentation, product catalogs or company sites. For one page use web-scrape, for a known list of URLs web-read-batch. Charged only if at least one page was read.
Price$0.005per page fetched · paid in USD on Base
Uptime100%
4/4 probes · 591.5 ms
Score76Grade B
Paid usage, 30 days3payers · 10 calls
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X POST "https://agentsvc.io/api/v1/proxy/site-crawl"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseRecent checks
| Checked (UTC) | Result | Status | Time | Live price |
|---|---|---|---|---|
| 2026-10-11 10:01 | Valid 402 | 402 | 684 ms | $0.005 |
| 2026-10-11 05:30 | Valid 402 | 402 | 575 ms | $0.005 |
| 2026-10-11 01:15 | Valid 402 | 402 | 608 ms | $0.005 |
| 2026-10-10 20:45 | Valid 402 | 402 | 536 ms | $0.005 |
Receipts
No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.
What a check proves