Pay-per-crawl / compare
AIPayGen pay-per-crawl vs Cloudflare
"Isn't this just Cloudflare?" Fair question. Cloudflare is building in the same direction, which says the idea is right. Here's the honest difference.
| Cloudflare | AIPayGen pay-per-crawl | |
|---|---|---|
| Blocks AI crawlers | Yes: Bot Management (Enterprise add-on), and a free "Block AI bots" switch | Charges them; blocking free with robots.txt |
| Charges AI crawlers per page | Pay Per Crawl: closed beta, moving to Pay Per Use (Jul 2026). Monetization Gateway (x402): waitlist | Yes, live today |
| Works if your site isn't on Cloudflare | No | Yes: WordPress, Nginx, Apache, Caddy, Vercel/Next.js, Express, Django, or a Cloudflare Worker |
| How crawlers pay | Cloudflare's billing; stablecoins over x402 for Monetization Gateway | x402, USDC on Base, straight to your wallet; or prepaid credit through paid_fetch for agents without a wallet |
| Crawler has to sign up first | Registered crawlers (Pay Per Crawl) | No |
| Catches AI crawlers posing as browsers | Yes, with Cloudflare's bot detection | For operators that publish IP ranges (OpenAI, Anthropic, Perplexity, Mistral, DuckDuckGo, Common Crawl) |
| See which AI crawlers visit | Cloudflare dashboard (AI Crawl Control) | Private AI crawler report per site, plus a weekly email |
| Open source | No | Yes: snippets and WordPress plugin on GitHub |
| Cost to the site owner | Depends on plan; Bot Management is Enterprise | Free; you keep 100% of your price |
When to use Cloudflare
If your site is already behind Cloudflare and you get into their beta or waitlist, use theirs. Their bot detection is better than anything that runs on one server, and it's built in.
When to use this
If your site isn't on Cloudflare (most of the web isn't), or you want it working today, or you want crawlers paying you directly in USDC with no middleman holding the money. It also runs as a Cloudflare Worker if you're on Cloudflare's free plan.
See it work
A live demo on Vercel, not Cloudflare: aipaygen-ppc-demo.vercel.app. Open it in a browser and you get the page. Ask as GPTBot and you get the price:
curl -i -A GPTBot https://aipaygen-ppc-demo.vercel.app/And what happened when we charged a real AI training crawler on our own site: the case study.
Cloudflare details from Cloudflare's own announcements (Pay Per Crawl, the July 2026 move to Pay Per Use, Monetization Gateway, Bot Management) as of November 2026. Tell us if something changed.