ScorpTech Recon x402 API
GET https://scorptech.it.com/api/x402/v1/robots-sitemap
Listed in x402 List · Data: x402-list.com (CC BY 4.0)
Fetch and parse robots.txt plus discovered sitemaps for a domain: user-agents, allow/disallow samples, sitemap index vs urlset, URL counts and sample locs. Useful for crawl planning and AI agent politeness checks.
Other endpoints from scorptech.it.com
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| GET /api/x402/v1/opengraph | Social media data | $0.005 |
| GET /api/x402/v1/url-markdown | Web page extraction | $0.005 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET 'https://scorptech.it.com/api/x402/v1/robots-sitemap'
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseEstimated calls per day
Paid calls to scorptech.it.com's tracked endpoints each day, estimated from the 30-day totals the x402 catalogues report. Each bar is the change in that 30-day total since the day before, plus the calls that left the 30-day window (taken as an average day). It is an estimate: Hagglyai does not measure or pay for these calls.
No usage reported for any of 3 tracked endpoints. Unknown usage is left out, not counted as zero.
Compared with other providers
Coverage matters: a provider whose endpoints report more of their usage can rank higher.
| # | Provider | Reported 30-day calls | Coverage |
|---|---|---|---|
| 1 | stableenrich.dev | 42,481 | 15 of 31 endpoints |
| 2 | win.oneshotagent.com | 12,253 | 14 of 28 endpoints |
| 3 | agent.pocket.network | 8,210 | 14 of 25 endpoints |
| 4 | market.datapackvibe.com | 7,551 | 4664 of 7890 endpoints |
| 5 | x402.orthogonal.com | 5,722 | 206 of 231 endpoints |
| 6 | agent402.tools | 4,340 | 153 of 237 endpoints |
| 7 | api.clawfetch.ai | 2,976 | 4 of 8 endpoints |
| 8 | api.kadec0.xyz | 1,617 | 12 of 12 endpoints |