AI crawler access
Inspect robots.txt and page directives for the submitted URL.
Free website diagnostics
Inspect public pages for crawler rules, readable HTML, structured data and content signals. Review the evidence and decide what needs attention.
This check inspects crawler access rules for one URL. It does not run every tool.
Inspect robots.txt and page directives for the submitted URL.
Permission in robots.txt is not proof that a real crawler can pass every network or security control.
Enter a public URL to run this check.
Inspect robots.txt and page directives for the submitted URL.
Inspect optional llms.txt files and their referenced links.
See which text and structure are available without running JavaScript.
Find sitemaps and inspect a limited sample of their URLs.
Inspect JSON-LD syntax, entity properties and visible-content matches.
Inspect declared interfaces and conventional discovery endpoints when relevant to the site.
Find writing and structure candidates for editorial review.
Inspect source markup near claim candidates and relevant authorship or date signals.
Compare the names, descriptions and identity signals declared on the submitted page.
Compare two to five pages using the same checks and inspect their differences.
Record a dated snapshot of six technical categories with supporting observations.
No. These tools inspect selected website signals; they do not predict AI recommendations or citations.
No. Checks are read-only. Any draft or recommendation must be reviewed and applied by you.
Usually it covers one submitted page and a limited set of resources. Each report states its actual scope.
No. It is optional and experimental. Focus first on access, readable content and accurate information.
No. Submit public URLs only. Do not include credentials or sensitive information.