Marketplace · API · x402

api.crawlwitness.com/v1/can-use

Use when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) from robots.txt, IETF AIPREF, TDMRep, noai and RSL licenses, with a signed receipt. Errors: 400 invalid domain or unknown bot (not charged).

Endpointhttps://api.crawlwitness.com/v1/can-use
TrustNot checked yet
PricingPay per call with x402, no account. Call it to get an exact quote before paying.
networkeip155:8453
schemeexact
pay to0xa20F0b8ADf20Ed17a8d27B369B3058afdB71a5C5
methodGET
last updated2026-11-11T12:26:31.85Z

Use it

Call it (an x402 client pays automatically)

curl -i https://api.crawlwitness.com/v1/can-use
# 402 reply -> sign PAYMENT-REQUIRED with an x402 client (e.g. @x402/fetch) -> retry with PAYMENT-SIGNATURE

This listing as JSON

curl https://aipaygen.com/v1/catalog/api/x402-e6009d0723e2934b

Search the whole marketplace from your agent (MCP)

{
  "mcpServers": {
    "aipaygen": {
      "url": "https://aipaygen.com/mcp"
    }
  }
}