RobotsGuard
    Inside the RobotsGuard app · Free account required

    AI Crawler Detection for the GEO era

    See exactly which AI bots can read your site: GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and 30+ more. Find out if you're visible in ChatGPT, Claude, and Perplexity answers, or accidentally blocked.

    Search is splitting in two. Half your traffic now comes from AI assistants. If they can't crawl you, you don't exist in their answers, no matter how well you rank on Google.

    Sign up to detect AI access I already have an account

    Free account · No credit card · 30 seconds to start

    30+ AI crawlers
    Per-bot verdicts
    AI visibility score
    Training vs. assistant split
    app.robotsguard.com / ai-crawlers
    AI BOT ACCESS · example.comVisibility score: 5 / 8
    GPTBot
    OpenAI training
    Blocked
    ChatGPT-User
    ChatGPT live answers
    Allowed
    ClaudeBot
    Anthropic training
    Blocked
    Claude-Web
    Claude live answers
    Allowed
    PerplexityBot
    Perplexity index
    Allowed
    Google-Extended
    Gemini / SGE training
    Partial
    CCBot
    Common Crawl (used by many LLMs)
    Allowed
    Bytespider
    ByteDance / TikTok AI
    Blocked

    Sign in to scan your site

    The full AI crawler detector lives inside the app. Create a free account to see your AI visibility.

    Open the detector
    What it detects

    Built for the GEO era, not 2010 SEO

    Every signal that decides whether AI assistants can, and will, quote your site.

    30+ AI Crawlers Tracked

    GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider, Applebot-Extended, and every other AI bot that matters for GEO.

    Per-Bot Access Verdict

    For every AI crawler: allowed, blocked, or partially blocked, across your homepage, product pages, blog, and any URL you care about.

    Accidental Block Detection

    Catches the most common GEO killer: a generic Disallow that quietly blocks every AI bot you didn't realize was matching.

    AI Visibility Score

    A single score showing how visible your site is to AI assistants. Track it over time and see the impact of every change.

    Training vs. Assistant Bots

    We separate training crawlers (CCBot, GPTBot) from live assistant crawlers (ChatGPT-User, Perplexity-User), because the SEO consequences are different.

    Recommendations Per Bot

    Plain-English suggestions: 'Allow ClaudeBot to appear in Claude's answers' or 'Block CCBot to prevent training on your content.'

    How it works

    From signup to AI visibility map in under a minute

    01

    Sign in to the app

    Create your free account in 30 seconds. The AI crawler detector lives inside the RobotsGuard workspace.

    02

    Add your domain

    We fetch your robots.txt, meta tags, and headers, and run them against every known AI crawler.

    03

    See your AI visibility

    One dashboard: which AI bots can read you, which can't, and what's costing you GEO visibility right now.

    Why this matters

    If ChatGPT can't read you, you're not in the answer.

    Hundreds of millions of users now ask AI assistants instead of Googling. When ChatGPT, Claude, or Perplexity recommend a product, source, or service, the brands they cite get the click, and the brands they don't are invisible.

    Most sites have no idea which AI bots they're blocking. Find out in seconds.

    Sites accidentally blocking GPTBot~40%
    AI search query growth (YoY)10×+
    AI bots tracked by typical SEO tools0-2
    AI bots we track30+

    Frequently asked

    Ready when you are

    See your AI visibility map in seconds

    Sign up free and find out which AI bots can, and can't, read your site right now.

    Create free account See all features
    Start monitoring your site