Technical SEO tools
Check a URL, a robots.txt rule or a server log. Choose the tool that matches the job.
Crawler Analysis Tool
See whether a public page responds, which crawler rules apply and what appears in its initial HTML.
Choose the right diagnostic
Start with the URL check when you need status, canonical, robots.txt and initial HTML evidence for one public page in the same report.
Use a focused tool when the missing evidence is already clear: a redirect chain, one robots.txt rule, a bounded log sample, an IP allocation or verification of a claimed bot request.
Treat every result as a bounded observation. A successful fetch does not prove indexing, ranking or a visit from the crawler named in a user-agent string.