# You can keep automated visitors from accessing specified pages and folders # through an agreement called the Robots Exclusion Standard. # Just place this robots.txt file in the root folder of # your web server and specify which robots to exclude and # which folders to exclude them from. The pound sign is used for comments. # # The following code keeps all agents or robots out of the /protected folder # User-Agent: * # # The asterisk * above specifies all agents or robots # Disallow: /protected # # The / indicates that all folders immediately under the server root # starting with /protected should be excluded