Free ToolSEO SafetyGovernance

robots.txt & Meta Robots Builder + Tester

Prevent catastrophic noindex/disallow mistakes. Build valid robots.txt, test paths against Googlebot/Bingbot, and generate per-page meta robots tags.

Client-side only Wildcard + $ matcher Download robots.txt

robots.txt Builder

Add UA Block
Governance Presets
Tips: Wildcards (*) and end anchors ($) are supported in the tester. Without wildcards, paths use prefix matching.

Rule Tester

Longest match wins; ties favor Allow. Wildcards (*) and end anchors ($) supported. Otherwise prefix match.

Meta Robots Builder

<meta name="robots" content="index, follow, max-image-preview:large">
Use <meta name="robots" for page-level control. For per-bot control (e.g., Googlebot), you can also use name="googlebot" with the same content.

Notes & Acceptance

  • • Tester shows the first effective rule using a longest-match strategy; ties favor Allow.
  • • Supports wildcard (*) and end-anchor ($) patterns (Google extensions).
  • • Warns if Disallow: / appears under User-agent: *.
  • • Optional Sitemap: https://example.com/sitemap.xml line included at the end.
  • • Everything runs locally in your browser.
Support the Builders

We provide these tools free of charge. If they’ve been useful, consider buying us a coffee to encourage us.

Buy Us a Coffee