AI crawlers
- OAI-SearchBot (answers)Allowed
- Claude-SearchBot (answers)Allowed
- PerplexityBot (answers)Blocked
- GPTBot (training)Blocked
People now ask ChatGPT, Gemini, Claude and Perplexity what they used to type into Google. Arva SEO shows whether those answers can reach, quote and name your website, and what to change.
The AI crawler check and AI readiness score are free on every plan. No credit card required.
01AI crawlers
A free check of your robots.txt against 19 AI crawlers, grouped by what they do, so you only block what you mean to.
02Four measures
From each site audit: how easily AI answer engines can read and quote your pages. It checks snippets, text hidden until clicked, question headings with direct answers, authors, dates and sources, each tied to published guidance.
Ask ChatGPT, Claude and Gemini the questions your customers ask, every week or month, with web search on. See whether answers cite or name you, what they said, and which competitors they name.
Weekly rank checks show which of your keywords bring up an AI Overview and, on paid plans, whether it cites your website.
From Google Analytics: visits from ChatGPT, Perplexity, Gemini, Copilot, Claude and others, free with the Analytics connection you already have.
03What to do about it
AI answers lean on what the rest of the web says about a business, so the advice covers both.
How often AI answers, from ChatGPT, Gemini, Claude, Perplexity and Google’s AI Overviews, name or cite your business when people ask about what you offer. It depends on whether AI crawlers can reach your pages, how easily your pages can be quoted, and what other websites say about you.
Yes. AI answer tracking asks ChatGPT, Claude and Gemini your customers’ questions with web search on, and records whether each answer cites your website or names your business, and the same for your competitors. It runs on your own AI key.
Blocking answer crawlers keeps your pages out of those assistants’ answers. Blocking training crawlers doesn’t remove you from answers; it’s a business choice. The crawler check shows which is which before you decide.
It’s optional. No major AI search engine has said it uses llms.txt, so the readiness score lists it as information only, not as a fix.
The AI crawler check, the AI readiness score and visits from AI assistants are free on every plan. AI answer tracking uses your own AI key, and AI Overview citations are included on paid plans.
06Related features
AI credits on every plan, your own AI key, and Arva SEO in AI assistants.
Briefs, an editor with AI help, a live score and drafts sent to WordPress.
Weekly rankings by location and device, with history and AI Overview checks.
Keywords, traffic, links and speed, side by side with your competitors.
07Start today
Create an account in a minute, verify your website and see whether AI can reach it. No credit card required.