Can AI Read Your Site? (AI crawler check)
FreeSee if your site accidentally blocks the AI assistants behind ChatGPT, Claude, and Perplexity — which would keep you out of their answers.
Free to use — 3 exports a day. Upgrade for unlimited.
Don't be invisible to AI search
AI engines can only cite content they're allowed to crawl. If your robots.txt blocks GPTBot, ClaudeBot, or PerplexityBot — often by accident — you simply won't appear in their answers, no matter how good your content is. Check it in seconds.
Can AI Read Your Site? (AI crawler check) — FAQ
What does the AI crawler checker do?+
It reads your site's robots.txt and tells you whether the major AI crawlers — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, and CCBot — are allowed to access your content. If they're blocked, you can't appear in AI answers.
Why would my site block AI crawlers?+
Many sites block AI bots by accident — via a security setting, a CMS default, or a Cloudflare rule — without realizing it cuts them out of ChatGPT, Perplexity, and Google AI Overviews. This is one of the most common, invisible reasons businesses don't show up in AI search.
Should I allow AI crawlers?+
If you want to be discovered and cited in AI search (and most businesses do), yes — allow them. The exception is if you have a specific reason to protect content from AI training. This tool shows you exactly what's currently allowed or blocked.
Is it free?+
Completely free, no signup. We just read your public robots.txt — nothing is stored.
Related free tools
How Do You Show Up on Google & AI?
Type your business name — and your website if you have one — and see how you currently appear on Google, plus whether AI assistants can even read your site. Real checks, no signup.
OpenLocal AI Visibility Grid
See whether AI recommends your business for 'best [service] in [city]' across any cities worldwide — and in any language.
OpenAI Visibility Checker
See if AI assistants like ChatGPT recommend your business — and which competitors they name instead.
OpenLocal Listings & Google Profile Optimizer
Get optimized Google Business Profile content and the exact directories to be listed in — for any country.
OpenStart growing your website today
Create your free site in minutes — no credit card, and you own and export everything you build.