api.strale.io
x402Grade BLast checked 4 hours ago
GET https://api.strale.io/x402/robots-txt-parse
Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.
Price$0.022per page fetched · paid in USD on Base
Uptime100%
3/3 probes · 307 ms
Score75Grade B
Paid usage, 30 days2payers · 3 calls
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET "https://api.strale.io/x402/robots-txt-parse"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseRecent checks
| Checked (UTC) | Result | Status | Time | Live price |
|---|---|---|---|---|
| 2026-10-11 06:31 | Valid 402 | 402 | 302 ms | $0.022 |
| 2026-10-11 02:00 | Valid 402 | 402 | 307 ms | $0.022 |
| 2026-10-10 21:30 | Valid 402 | 402 | 320 ms | $0.022 |
Receipts
No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.
What a check proves