Free page check

Can AI crawlers read your page?

Paste one page address. We fetch that page once, read the markup that tells crawlers what to do with it, and read the site's robots.txt to check the crawler rules for that page. No account or card. Download your report before leaving; it is not saved.

Last updated

This is a technical check, not a visibility score.

To see which brands assistants mention, start a 7-day trial. This page checks technical access and markup.

What the check does, exactly

  • Fetches the one page you name, following at most five redirects, with a time limit and a size limit.
  • Reports the status, the response time and the URL that actually answered.
  • Reads title, meta description, canonical, meta robots, X-Robots-Tag and whether structured data markup is present.
  • Reads the site's robots.txt and works out, for that exact path, which AI crawlers are allowed.
  • One page is fetched, only when you press the button, with limits on time, size and redirects.
  • This is not an AI visibility measurement: no assistant was asked anything, and no brand was looked for in any answer.
  • Robots rules are a site's stated preference. Permission to crawl is not proof of a visit, an index entry or a citation.
  • Structured data is detected, not validated against Schema.org.
  • The page report is not saved. Hashed abuse counters are retained to enforce limits. Download the result if you want to keep it.

Checks are rate limited so one visitor cannot use the whole allowance, or point it at one site.

Questions about the free check

Which AI crawlers does the free check look at?
OAI-SearchBot, GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider, bingbot. bingbot is included because Microsoft Copilot has no crawler of its own and answers from the Bing index.
If a crawler is allowed, will my page be cited?
Not necessarily. Robots rules are a site's stated preference. Permission to crawl is not proof of a visit, an index entry or a citation.
Is this an AI visibility score?
No. No AI engine is asked anything and no brand is looked for in any answer. It checks one page's technical access and markup: the HTTP response, title, meta description, canonical, meta robots, X-Robots-Tag and whether structured data is present.
Does it validate my structured data?
No. Structured data is detected, not validated against Schema.org.
Do I need an account, and is my report saved?
No account or card is needed, and the page report is not saved, so download it before you leave. Hashed abuse counters are retained to enforce rate limits.