Genesis
x402Not rated yetLast checked 2 hours ago
POST https://genesis.palsus2023.workers.dev/v1/robots_check
Listed in x402 List · Data: x402-list.com (CC BY 4.0)
Fetch and inspect robots.txt for a public website and return its directives. Use before crawling or scraping to inspect crawler instructions and robots.txt policies. Price: $0.002 USDC via x402 on Base.
Price$0.002per page fetched · paid in USD on Base
Uptime100%
1/1 probes · 1503 ms
Score–Needs 3 checks
Paid usage, 30 days0payers · 0 calls
Other endpoints from genesis.palsus2023.workers.dev
The same service's other paid functions that Hagglyai tracks, each with its own price. Functions outside Hagglyai's categories are not listed.
| Endpoint | Category | Price per call |
|---|---|---|
| POST /v1/html_to_text | Web page extraction | $0.002 |
| POST /v1/page_extract | Web page extraction | $0.005 |
| POST /v1/structured_scrape | Web page extraction | $0.005 |
How to buy
This endpoint takes pay-per-call payments over x402. Call it once without paying to see its live price; any x402 client then pays and retries automatically.
curl -i -X POST "https://genesis.palsus2023.workers.dev/v1/robots_check"
# HTTP/1.1 402 Payment Required: price, asset and payTo are in the responseRecent checks
| Checked (UTC) | Result | Status | Time | Live price |
|---|---|---|---|---|
| 2026-10-15 00:30 | Valid 402 | 402 | 1503 ms | $0.002 |
Receipts
No test purchases yet. Graded test purchases are next on our list; until then every number here comes from unpaid checks.
What a check proves