Marketplace · API · x402

crawlsafe.grindfree.net/v1/check

Check if a URL may be crawled: RFC 9309 robots.txt for your user agent, plus X-Robots-Tag/meta robots. SSRF-guarded on every redirect hop. Not a malware scanner.

Endpointhttps://crawlsafe.grindfree.net/v1/check
TrustNot checked yet
PricingPay per call with x402, no account. Call it to get an exact quote before paying.
networkeip155:8453
schemeexact
pay to0xe4b5827994B7B3Cd38F9830d9ECF58b51B77721b
methodPOST
last updated2026-11-11T19:03:16.806Z

Use it

Call it (an x402 client pays automatically)

curl -i https://crawlsafe.grindfree.net/v1/check
# 402 reply -> sign PAYMENT-REQUIRED with an x402 client (e.g. @x402/fetch) -> retry with PAYMENT-SIGNATURE

This listing as JSON

curl https://aipaygen.com/v1/catalog/api/x402-6862a26f7a10306e

Search the whole marketplace from your agent (MCP)

{
  "mcpServers": {
    "aipaygen": {
      "url": "https://aipaygen.com/mcp"
    }
  }
}