For agents: JSON · MCP

ai-crawler-policy

x402Grade BLast checked 45 min ago

POST https://intel.rallylive.ca/dev/ai-crawler-policy

AI-crawler policy of a website: reads robots.txt and reports, for 20 known AI/LLM crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, anthropic-ai, CCBot, Google-Extended, Applebot-Extended, PerplexityBot, Bytespider, Amazonbot, cohere-ai, meta-externalagent and more), whether the root is allowed, blocked or unmentioned, plus an overall stance (open / selective / blocks-all-ai) and TDM/ai.txt hints. $0.01 per domain.

Price$0.01per page fetched · paid in USD on Base

Uptime100%

3/3 probes · 346 ms

Score70Grade B

Paid usage, 30 days0payers · 0 calls

How to buy

This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.

curl -i -X POST "https://intel.rallylive.ca/dev/ai-crawler-policy"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the response

Recent checks

Checked (UTC)	Result	Status	Time	Live price
2026-10-11 10:46	Valid 402	402	10 ms	$0.01
2026-10-11 06:15	Valid 402	402	18 ms	$0.01
2026-10-11 01:45	Valid 402	402	346 ms	$0.01
2026-10-10 21:15	Valid 402	402	570 ms	$0.01

Receipts

No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.

What a check proves