JSON formatter & validator
Format, beautify, validate, and minify JSON online. Pinpoint syntax errors by line and column, sort keys, and copy or download the result.
Robots.txt generator
Create a robots.txt file: disallow paths, add sitemaps, and block AI crawlers like GPTBot and ClaudeBot or specific search engines.
How to use Robots.txt generator
Create a valid robots.txt file to tell search engines and other crawlers what they can access.
- Allow or block everything by default, then list paths to disallow or allow
- One-click blocking for AI crawlers such as GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and Common Crawl
- Block individual search engines
- Add your sitemap URLs
Upload the file to the root of your site, for example https://example.com/robots.txt. Robots.txt is a request, not access control: don't use it to hide private pages.
Robots.txt generator FAQs
Is Robots.txt generator free?
Robots.txt generator is a free online tool on ReallyUseful.Tools. No account is required.
Does Robots.txt generator run in my browser?
Robots.txt generator is designed to run in your browser where supported, so files can stay on your device instead of being uploaded to a server.
More Developer Tools
Base64 encode / decode
Encode text to Base64 or decode Base64 back to text with full UTF-8 support and an optional URL-safe alphabet.
Unix timestamp converter
Convert Unix epoch timestamps to human-readable dates and back. Supports seconds and milliseconds, local time, UTC, and ISO 8601.
Hash generator
Generate MD5, SHA-1, SHA-256, SHA-512, SHA3, and CRC32 hashes for text or files. Verify checksums and create HMACs locally.
Regex tester
Test JavaScript regular expressions with live match highlighting, capture groups, flags, and replace preview.