Robots.txt Generator | Younire | Free SEO & Website Analyzer

Search Engine Optimization

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

Enter more information about the Robots.txt Generator tool!

A robots.txt file is very important to your website because it gives instructions to search engines and web bots, and basically tells them which pages to crawl and which pages to ignore. If your Robots.txt file has the wrong information in it, you might end up telling search engines to completely ignore your entire website and you will not be listed in search results. 

Our Free Robots.txt Generator tool is very simple to use and will generate a clean and accurate robots.txt file for you in seconds. Just fill out the form above and chose which search engines and bots you want to allow then hit the Create Robots.txt button.

If you liked this free tool, then you might need to check our Awesome and Free XML Sitemap Generator