Fetch and return a site robots.txt with parsed user-agent rules and sitemap links. It is built for autonomous AI agents: discover it, pay for it, and consume it in a single request via the x402 protocol — no API key, no account.
GET https://x402render.vercel.app/robots
Example: /robots?url=https://example.com
url | string — site URL or domain (required) |
The endpoint returns HTTP 402 Payment Required with the price, asset (USDC), network (Base / eip155:8453), and pay-to address. Your agent pays on-chain and resends with the payment proof header. Compatible with @coinbase/x402 and @piprail/sdk.
See the full catalog at x402render, the machine-readable list at /discovery/resources, or the spec at /openapi.json.