relay402.georgespring.workers.dev
x402Grade CLast checked 11 min ago
GET https://relay402.georgespring.workers.dev/api/robots-check
Checks whether a given user agent may fetch a given path on a host, per the site's robots.txt (specific-agent groups, wildcard rules, Allow/Disallow longest-match). Also returns crawl-delay, sitemap URLs and whether the site publishes llms.txt or ai.txt. For scraping and research agents that want to crawl politely and prove compliance.
Price$0.001per page fetched · paid in USD on Base
Uptime100%
3/3 probes · 988 ms
Score68Grade C
Paid usage, 30 days0payers · 0 calls
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET "https://relay402.georgespring.workers.dev/api/robots-check"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseRecent checks
| Checked (UTC) | Result | Status | Time | Live price |
|---|---|---|---|---|
| 2026-10-11 11:46 | Valid 402 | 402 | 1041 ms | $0.001 |
| 2026-10-11 07:15 | Valid 402 | 402 | 988 ms | $0.001 |
| 2026-10-11 02:46 | Valid 402 | 402 | 973 ms | $0.001 |
| 2026-10-10 22:30 | Valid 402 | 402 | 1054 ms | $0.001 |
Receipts
No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.
What a check proves