SiteCheck
GET https://api.sitecheck-api.workers.dev/api/robots
Listed in Coinbase x402 Bazaar
Checks whether a URL's path may be crawled under robots.txt (RFC 9309): the verdict for a user agent (default: *, Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot), the rule that decided it and its line, crawl-delay, sitemaps and the matching group's lines. Longest rule wins, allow wins a tie, * and $ work. No robots.txt means everything is allowed; a server error is a 503, not charged.
Other endpoints from api.sitecheck-api.workers.dev
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| GET /api/airports | Flights & travel | $0.001 |
| GET /api/chat | LLM inference | $0.004 |
| POST /api/chat | LLM inference | $0.004 |
| GET /api/company/registry | People & company enrichment | $0.003 |
| GET /api/company/ticker | Stocks & forex | $0.001 |
| GET /api/contacts | People & company enrichment | $0.01 |
| GET /api/crypto/candles | Crypto prices & market data | $0.002 |
| GET /api/crypto/convert | Crypto prices & market data | $0.001 |
| GET /api/crypto/news | News | $0.002 |
| GET /api/crypto/price | Crypto prices & market data | $0.001 |
| GET /api/crypto/whales | Crypto prices & market data | $0.003 |
| POST /api/describe-image | LLM inference | $0.003 |
| POST /api/entities | Web page extraction | $0.003 |
| GET /api/evm/address | On-chain data | $0.002 |
| GET /api/evm/balance | On-chain data | $0.002 |
| GET /api/evm/call | On-chain data | $0.002 |
| GET /api/evm/wallet | On-chain data | $0.003 |
| POST /api/extract | LLM inference | $0.004 |
| GET /api/flights | Flights & travel | $0.05 |
| GET /api/fx | Stocks & forex | $0.001 |
| GET /api/gas | On-chain data | $0.001 |
| GET /api/hn | News | $0.001 |
| POST /api/invoice/extract | Web page extraction | $0.005 |
| GET /api/markets/quote | Crypto prices & market data | $0.005 |
| POST /api/markets/quote | Crypto prices & market data | $0.005 |
| GET /api/ocr | LLM inference | $0.003 |
| POST /api/ocr | LLM inference | $0.003 |
| GET /api/read | Web page extraction | $0.002 |
| GET /api/resume/parse | People & company enrichment | $0.005 |
| POST /api/resume/parse | People & company enrichment | $0.005 |
| GET /api/sec/filings | Stocks & forex | $0.002 |
| GET /api/sec/search | Stocks & forex | $0.002 |
| GET /api/solana/token | Crypto prices & market data | $0.002 |
| GET /api/solana/trending | Crypto prices & market data | $0.003 |
| GET /api/solana/tx | On-chain data | $0.002 |
| GET /api/summarize | LLM inference | $0.003 |
| POST /api/summarize | LLM inference | $0.003 |
| GET /api/text/paraphrase | LLM inference | $0.003 |
| POST /api/text/paraphrase | LLM inference | $0.003 |
| GET /api/translate | Translation | $0.002 |
| POST /api/translate | Translation | $0.002 |
| GET /api/translate/subtitles | Translation | $0.004 |
| POST /api/translate/subtitles | Translation | $0.004 |
| GET /api/user-agent | Web page extraction | $0.001 |
| GET /api/weather | Weather | $0.001 |
| GET /api/weather/alerts | Weather | $0.001 |
| GET /api/youtube/transcript | Social media data | $0.03 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X GET "https://api.sitecheck-api.workers.dev/api/robots"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseEstimated calls per day
Paid calls to api.sitecheck-api.workers.dev's tracked endpoints each day, estimated from the 30-day totals the x402 catalogues report. Each bar is the change in that 30-day total since the day before, plus the calls that left the 30-day window (taken as an average day). It is an estimate: Hagglyai does not measure or pay for these calls.
Usage available for 29 of 48 tracked endpoints, 65 paid calls in the last 30 days. Last updated 2 hours ago. Unknown usage is left out, not counted as zero.
Compared with other providers
api.sitecheck-api.workers.dev ranks 57th of 241 in Web page extraction by its latest reported 30-day paid calls. Coverage matters: a provider whose endpoints report more of their usage can rank higher.
| # | Provider | Reported 30-day calls | Coverage |
|---|---|---|---|
| 1 | win.oneshotagent.com | 36,326 | 10 of 33 endpoints |
| 2 | stableenrich.dev | 28,133 | 15 of 31 endpoints |
| 3 | agent402.tools | 2,879 | 139 of 212 endpoints |
| 4 | x402.orthogonal.com | 2,115 | 188 of 243 endpoints |
| 5 | agent.pocket.network | 1,564 | 13 of 24 endpoints |
| 6 | api.x402node.dev | 1,228 | 163 of 194 endpoints |
| 7 | vaaya.ai | 1,226 | 40 of 76 endpoints |
| 8 | api.losbeto.xyz | 1,202 | 20 of 107 endpoints |
| 57 | api.sitecheck-api.workers.dev (this one) | 65 | 29 of 48 endpoints |