How to upload robots.txt file

You can upload the contents of the robot.txt file via Webasyst backend. Open Site app, navigate to its "Site settings" screen, and find the “robots.txt” setting.

Special cases

The contents of the robots.txt file which you have specified in Site app settings are not taken into account in the following cases:

• If there is a file named robots.txt in Webasyst root directory. In this case the existing file is used instead of the conitents of the Site settings field. If you want that Webasyst setting is used for robots.txt, delete the file.
• If your website base URL contains a subdirectory name. E.g., for a website located at http://yourdomain.com/info/, “robots.txt” field contents will not be used. Instead, the corresponding setting or file will be used for the site without directory name; e.g., http://yourdomain.com/.