PennyAPI Robots Permission Check
x402Grade BLast checked 2 hours ago
GET https://pennyregwatch.com/v1/robots
Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live provenance.
Price$0.001per page fetched · paid in USD on Base
Uptime100%
4/4 probes · 1274.5 ms
Score75Grade B
Paid usage, 30 days5payers · 5 calls
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET "https://pennyregwatch.com/v1/robots"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseRecent checks
| Checked (UTC) | Result | Status | Time | Live price |
|---|---|---|---|---|
| 2026-10-11 08:00 | Valid 402 | 402 | 1330 ms | $0.001 |
| 2026-10-11 03:30 | Valid 402 | 402 | 1691 ms | $0.001 |
| 2026-10-10 23:15 | Valid 402 | 402 | 733 ms | $0.001 |
| 2026-10-10 17:30 | Valid 402 | 402 | 1219 ms | $0.001 |
Receipts
No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.
What a check proves