WebberSites x402 Data API
GET https://api.webbersites.com/api/seo/robots-check
Listed in x402 List · Data: x402-list.com (CC BY 4.0)
robots.txt + llms.txt checker: crawler access verdicts for major search AND AI bots (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more), declared sitemaps, syntax warnings, and llms.txt / llms-full.txt presence with structure summary. ?url=any page on the site
Other endpoints from api.webbersites.com
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| GET /api/extract | Web page extraction | $0.02 |
| GET /api/price/bitcoin | Crypto prices & market data | $0.001 |
| GET /api/scrape | Web page extraction | $0.001 |
| GET /api/search | Web search | $0.01 |
| POST /api/search | Web search | $0.01 |
| GET /api/summarize | Web page extraction | $0.002 |
| GET /api/translate-text | Translation | $0.01 |
| POST /api/translate-text | Translation | $0.01 |
| GET /api/website/build | News | $0.05 |
| GET /api/website/page | News | $0.02 |
| GET /v1/messages | LLM inference | $0.01 |
| POST /v1/messages | LLM inference | $0.01 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET "https://api.webbersites.com/api/seo/robots-check"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseEstimated calls per day
Paid calls to api.webbersites.com's tracked endpoints each day, estimated from the 30-day totals the x402 catalogues report. Each bar is the change in that 30-day total since the day before, plus the calls that left the 30-day window (taken as an average day). It is an estimate: Hagglyai does not measure or pay for these calls.
Usage available for 5 of 13 tracked endpoints, 95 paid calls in the last 30 days. Last updated 3 hours ago. Unknown usage is left out, not counted as zero.
Compared with other providers
api.webbersites.com ranks 46th of 245 in Web page extraction by its latest reported 30-day paid calls. Coverage matters: a provider whose endpoints report more of their usage can rank higher.
| # | Provider | Reported 30-day calls | Coverage |
|---|---|---|---|
| 1 | stableenrich.dev | 28,201 | 15 of 31 endpoints |
| 2 | win.oneshotagent.com | 15,601 | 13 of 36 endpoints |
| 3 | x402.orthogonal.com | 4,071 | 189 of 249 endpoints |
| 4 | agent402.tools | 3,142 | 142 of 217 endpoints |
| 5 | agent.pocket.network | 2,525 | 13 of 24 endpoints |
| 6 | api.losbeto.xyz | 1,297 | 20 of 107 endpoints |
| 7 | x402.ottoai.services | 1,268 | 28 of 32 endpoints |
| 8 | api.x402node.dev | 1,237 | 161 of 194 endpoints |
| 46 | api.webbersites.com (this one) | 95 | 5 of 13 endpoints |