AI crawlers / which sites block them / Entertainment and media

Which entertainment sites block AI crawlers?

Of 29 entertainment sites we checked on 2026-11-16, 17 (59%) block at least one AI crawler in robots.txt, and 11 (38%) block GPTBot.

SiteAI crawlers blockedGPTBotClaudeBotGoogle-ExtendedPerplexityBotCCBotChecked
ign.com25 of 29BlockedBlockedAllowedBlockedBlocked2026-11-16
netflix.com20 of 29AllowedAllowedAllowedAllowedBlocked2026-11-16
pitchfork.com19 of 29AllowedBlockedBlockedBlockedBlocked2026-11-16
primevideo.com18 of 29AllowedAllowedAllowedBlockedBlocked2026-11-16
billboard.com17 of 29BlockedBlockedBlockedBlockedBlocked2026-11-16
hollywoodreporter.com17 of 29BlockedBlockedBlockedBlockedBlocked2026-11-16
rollingstone.com17 of 29BlockedBlockedBlockedBlockedBlocked2026-11-16
variety.com17 of 29BlockedBlockedBlockedBlockedBlocked2026-11-16
gamespot.com14 of 29BlockedBlockedBlockedAllowedBlocked2026-11-16
polygon.com14 of 29BlockedBlockedBlockedBlockedBlocked2026-11-16
hulu.com13 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
nba.com9 of 29BlockedBlockedBlockedBlockedBlocked2026-11-16
espn.com8 of 29BlockedAllowedBlockedAllowedBlocked2026-11-16
kotaku.com8 of 29AllowedAllowedAllowedAllowedBlocked2026-11-16
metacritic.com5 of 29BlockedAllowedAllowedAllowedBlocked2026-11-16
disney.com2 of 29BlockedAllowedBlockedAllowedAllowed2026-11-16
playstation.com1 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
apple.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
crunchyroll.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
fifa.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
max.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
mlb.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
nfl.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
paramountplus.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
peacocktv.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
rottentomatoes.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
spotify.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
steampowered.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16
xbox.com0 of 29AllowedAllowedAllowedAllowedAllowed2026-11-16

Open a site for the full list of 29 crawlers. 1 site in this group could not be read.

How we know: we read each site's public robots.txt and test 29 AI crawler names against it. A site can also block crawlers at its firewall, which nobody outside can see, so "allows" here means "robots.txt doesn't say no". Each site is rechecked about once a week.

Other kinds of site: News · Reference · Shopping · Social and community · Developer tools · AI companies · Finance · Travel · Education · Government and public bodies · SaaS and business software