Technical SEOAvailable

Robots.txt and Indexability Tester

Check robots.txt, meta robots, X-Robots-Tag, HTTP status and canonical signals together for a specific public URL.

Protected server-side checkNo permanent storage by default

Request scope

One bounded public HTTP response is fetched. Local, private and reserved networks are blocked.

About this check

What the tool checks

Understand whether a page is reachable and requested for indexing while keeping crawl access, index directives and actual index state separate.

How this check works

The report combines the applicable robots.txt rule with the final response status, HTML meta directives, HTTP X-Robots-Tag and canonical.

What this check cannot establish on its own

Crawl access and declared indexability do not prove actual indexing; the authoritative status remains with the search engine or Search Console.

Data sources

The public robots.txt file, final HTTP headers and HTML directives for the submitted URL.