A robots.txt file resides at the root of your site. For www.example.com, for example, the robots.txt file is located at www.example.com/robots.txt. robots.txt is a text file that respects the robots exclusion standard. A robots.txt file includes one or more rules. Each rule blocks (or allows) a given robot's access to a specified file path on that website.