robots.txt & Sitemap Analyzer
POST https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer
Listed in Coinbase x402 Bazaar
Give it domains. For each it parses robots.txt (user-agents, allow/disallow, crawl-delay, declared sitemaps, blocks-all) and the XML sitemap(s) (URL counts, nested sitemaps, lastmod coverage), and flags crawlability issues - with a signal and findings. Keyless, read-only. Up to 3 items per call; failed lookups are not charged.
Other endpoints from agent-data.centorprat.workers.dev
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| POST /tools/ai-crawler-access-test | Web page extraction | $0.03 |
| POST /tools/local-business-software-detector | Maps & places | $0.03 |
| POST /tools/weather-air-quality-earthquake-api | Weather | $0.015 |
| POST /tools/world-bank-country-economic-data | Stocks & forex | $0.03 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X POST "https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseEstimated calls per day
Paid calls to agent-data.centorprat.workers.dev's tracked endpoints each day, estimated from the 30-day totals the x402 catalogues report. Each bar is the change in that 30-day total since the day before, plus the calls that left the 30-day window (taken as an average day). It is an estimate: Hagglyai does not measure or pay for these calls.
Usage available for 5 of 5 tracked endpoints, 5 paid calls in the last 30 days. Last updated 2 hours ago. Unknown usage is left out, not counted as zero.
Compared with other providers
agent-data.centorprat.workers.dev ranks 178th of 269 in Web page extraction by its latest reported 30-day paid calls. Coverage matters: a provider whose endpoints report more of their usage can rank higher.
| # | Provider | Reported 30-day calls | Coverage |
|---|---|---|---|
| 1 | stableenrich.dev | 29,776 | 15 of 31 endpoints |
| 2 | win.oneshotagent.com | 14,426 | 12 of 26 endpoints |
| 3 | agent.pocket.network | 5,132 | 10 of 25 endpoints |
| 4 | x402.orthogonal.com | 4,708 | 47 of 260 endpoints |
| 5 | agent402.tools | 3,551 | 146 of 232 endpoints |
| 6 | x402.ottoai.services | 1,477 | 28 of 32 endpoints |
| 7 | api.kadec0.xyz | 1,415 | 12 of 12 endpoints |
| 8 | vaaya.ai | 1,028 | 36 of 68 endpoints |
| 178 | agent-data.centorprat.workers.dev (this one) | 5 | 5 of 5 endpoints |