Free Robots.txt Generator Online

Search Engine Optimization

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

Robots.txt file is most important for a website or blog where you can define which post/page Search Engine bots should crawl and index. Using the proper command in the Robots.txt file, you can easily block specific page, post or folder from search engines of your website. This is one of the important parts of on page SEO. Our Free Robots.txt Generator will help you to generator a proper robotx.txt file. Simply input all information and click on the Create Robots.txt Button. You will get your robots.txt file code. Copy this code and create a notepad file with the name robots.txt and paste the code. Save the notepad file and upload it to your website server.