SEO tools
WordPress Robots.txt Generator
Generate an SEO-friendly robots.txt for WordPress: protect wp-admin, keep admin-ajax working, add your sitemap and optional AI crawler rules.
Upload it as robots.txt to your site root, or paste it into your SEO plugin's robots.txt editor. Then test it in Google Search Console.
How to use the WordPress Robots.txt Generator
-
1
Enter your site address and sitemap location.
-
2
Tick the rules you want.
-
3
Upload the file as robots.txt to your site root, or paste it into your SEO plugin.
About this tool
Build a robots.txt for a WordPress site in seconds. It keeps the admin area out of the crawl without breaking admin-ajax, adds your sitemap, and can optionally ask AI training crawlers to stay away.
Frequently asked questions
Does robots.txt remove pages from Google?
No. It controls crawling, not indexing. To remove a page from results, use a noindex tag or remove the page.
Should I block wp-content?
No. Google needs your CSS, JavaScript and images to render pages properly.