Fetcher
GET https://api.fetcher.cloud/robots
Listed in x402 List · Data: x402-list.com (CC BY 4.0)
Fetch and parse robots.txt; answer whether a given user-agent may crawl a given path, and list sitemaps.
Other endpoints from api.fetcher.cloud
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| GET /extract | Web page extraction | $0.005 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET "https://api.fetcher.cloud/robots"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseRecent checks
| Checked (UTC) | Result | Status | Time | Live price |
|---|---|---|---|---|
| 2026-10-15 00:30 | No valid 402 | 400 | 1545 ms | not listed |
Receipts
No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.
What a check proves