CASINO CRAWL SIGNAL home Contact

Offline, browser-only

Tools

Two small tools that run entirely in your browser. Nothing you paste is uploaded, no website is fetched, and no result here is a statement about how Google has crawled or indexed a real site.

Robots.txt rule explorer

Paste robots.txt rules, a crawler token and a path. The explorer applies the matching rules Google documents: one group per crawler (the most specific user-agent match), groups for the same agent merged, the longest matching rule winning, the least restrictive rule winning a tie, * and $ wildcards, and case-sensitive paths.

Enter rules and a path, then choose Check rule.

What this does not doIt does not fetch your live robots.txt, follow redirects, model every crawler's fallback behavior or decide indexing. Allowed for crawling does not mean indexed, and a disallowed URL can still be indexed without its content if other pages link to it. Confirm important decisions with Search Console's robots.txt report and Google's robots.txt specification. The rules engine is covered by 26 unit tests built from Google's documented examples. The tests are kept with the site's build source and are available on request.

Audit tracker

A manual checklist of 14 checks drawn from our technical SEO checklist, with a progress bar and a plain-text export for your audit records.

Open the audit tracker

What we will not build without safeguards

A tool that fetches any URL you type is a security risk for us and for the sites it is pointed at. We will only add live fetching after a separate review covering private-address and redirect protections, rate limits, robots.txt compliance and abuse controls. Until then, every tool on this site is offline.