Connect your agent
For agents: JSON · MCP

Forest Web

x402Grade BLast checked 3 hours ago

POST https://http--forest-gas-station-mainnet--lcjl27p8lmjs.code.run/robots/context

Interpret the robots.txt crawling rules that apply to a specific public URL and user-agent before an automated fetch or crawl. Returns allow/disallow decision evidence, matched rules, crawl delay and sitemap hints from one bounded robots.txt read. This is protocol guidance, not authorization or an anti-bot bypass. Base mainnet USDC

Price$0.001per page fetched · paid in USD on Base
Uptime100%
4/4 probes · 741.5 ms
Score74Grade B
Paid usage, 30 days2payers · 2 calls

How to buy

This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.

curl -i -X POST "https://http--forest-gas-station-mainnet--lcjl27p8lmjs.code.run/robots/context"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the response

Recent checks

Checked (UTC)ResultStatusTimeLive price
2026-10-11 08:45Valid 402402605 ms$0.001
2026-10-11 04:15Valid 402402797 ms$0.001
2026-10-10 23:45Valid 402402686 ms$0.001
2026-10-10 18:45Valid 402402968 ms$0.001

Receipts

No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.

What a check proves