x402-markdown.onrender.com
GET https://x402-markdown.onrender.com/v1/crawl/permission
Listed in UltravioletaDAO
Before fetching, quoting or training on a web page, check the site's machine-readable AI/crawl signals for your crawler. GET /v1/crawl/permission?url=<public http(s) URL>&ua=<robots.txt product token, e.g. GPTBot, ClaudeBot, CCBot, Google-Extended; default *>. Evaluates robots.txt per RFC 9309 (group for ua else *, longest match, Allow wins ties; robots.txt 4xx = no restrictions, 5xx = treat as disallowed), ai.txt, TDMRep (/.well-known/tdmrep.json, tdm-reservation/tdm-policy headers and meta), X-Robots-Tag and <meta name=robots|<ua>> (noai, noimageai, noindex...). Returns verdict 'allowed' | 'disallowed' | 'unclear' plus reasons[] and every raw signal. Disallowed if robots.txt blocks the path for ua or any AI opt-out (noai, tdm-reservation=1, ai.txt disallow) is present; unclear if the page itself could not be checked. Errors are JSON {error:<code>, message, charged:false}. Not charged when robots.txt cannot be retrieved (DNS, connect, timeout) or the URL is not public (400 before paym
Other endpoints from x402-markdown.onrender.com
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| GET /markdown | Web page extraction | $0.1 |
| POST /markdown | Web page extraction | $0.1 |
| GET /v1/read | Web page extraction | $0.005 |
| GET /v1/read?format=chunks | Web page extraction | $0.02 |
| GET /v1/url/meta | Web page extraction | $0.005 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET 'https://x402-markdown.onrender.com/v1/crawl/permission'
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseEstimated calls per day
Paid calls to x402-markdown.onrender.com's tracked endpoints each day, estimated from the 30-day totals the x402 catalogues report. Each bar is the change in that 30-day total since the day before, plus the calls that left the 30-day window (taken as an average day). It is an estimate: Hagglyai does not measure or pay for these calls.
Usage available for 5 of 6 tracked endpoints, 0 paid calls in the last 30 days. Last updated 1 hour ago. Unknown usage is left out, not counted as zero.
Compared with other providers
x402-markdown.onrender.com ranks 301st of 301 in Web page extraction by its latest reported 30-day paid calls. Coverage matters: a provider whose endpoints report more of their usage can rank higher.
| # | Provider | Reported 30-day calls | Coverage |
|---|---|---|---|
| 1 | stableenrich.dev | 43,119 | 14 of 31 endpoints |
| 2 | win.oneshotagent.com | 12,134 | 14 of 27 endpoints |
| 3 | agent.pocket.network | 8,725 | 14 of 25 endpoints |
| 4 | market.datapackvibe.com | 8,324 | 5145 of 7341 endpoints |
| 5 | x402.orthogonal.com | 6,025 | 212 of 218 endpoints |
| 6 | agent402.tools | 4,357 | 152 of 237 endpoints |
| 7 | api.clawfetch.ai | 2,984 | 4 of 8 endpoints |
| 8 | api.kadec0.xyz | 2,184 | 12 of 12 endpoints |
| 301 | x402-markdown.onrender.com (this one) | 0 | 5 of 6 endpoints |