Pay-per-crawl / compare

AIPayGen pay-per-crawl vs Cloudflare

"Isn't this just Cloudflare?" Fair question. Cloudflare is building in the same direction, which says the idea is right. Here's the honest difference.

CloudflareAIPayGen pay-per-crawl
Blocks AI crawlersYes: Bot Management (Enterprise add-on), and a free "Block AI bots" switchCharges them; blocking free with robots.txt
Charges AI crawlers per pagePay Per Crawl: closed beta, moving to Pay Per Use (Jul 2026). Monetization Gateway (x402): waitlistYes, live today
Works if your site isn't on CloudflareNoYes: WordPress, Nginx, Apache, Caddy, Vercel/Next.js, Express, Django, or a Cloudflare Worker
How crawlers payCloudflare's billing; stablecoins over x402 for Monetization Gatewayx402, USDC on Base, straight to your wallet; or prepaid credit through paid_fetch for agents without a wallet
Crawler has to sign up firstRegistered crawlers (Pay Per Crawl)No
Catches AI crawlers posing as browsersYes, with Cloudflare's bot detectionFor operators that publish IP ranges (OpenAI, Anthropic, Perplexity, Mistral, DuckDuckGo, Common Crawl)
See which AI crawlers visitCloudflare dashboard (AI Crawl Control)Private AI crawler report per site, plus a weekly email
Open sourceNoYes: snippets and WordPress plugin on GitHub
Cost to the site ownerDepends on plan; Bot Management is EnterpriseFree; you keep 100% of your price

When to use Cloudflare

If your site is already behind Cloudflare and you get into their beta or waitlist, use theirs. Their bot detection is better than anything that runs on one server, and it's built in.

When to use this

If your site isn't on Cloudflare (most of the web isn't), or you want it working today, or you want crawlers paying you directly in USDC with no middleman holding the money. It also runs as a Cloudflare Worker if you're on Cloudflare's free plan.

See it work

A live demo on Vercel, not Cloudflare: aipaygen-ppc-demo.vercel.app. Open it in a browser and you get the page. Ask as GPTBot and you get the price:

curl -i -A GPTBot https://aipaygen-ppc-demo.vercel.app/

And what happened when we charged a real AI training crawler on our own site: the case study.

Set it up free

Cloudflare details from Cloudflare's own announcements (Pay Per Crawl, the July 2026 move to Pay Per Use, Monetization Gateway, Bot Management) as of November 2026. Tell us if something changed.