############################### # # sample robots.txt file for this website # # addresses all robots by using wild card * # User-agent: * # list folders robots are not allowed to index Disallow /bluePrint/ Disallow /bookChapters/ Disallow /docs/ Disallow /freeArticles/ Disallow /javaFiles/ Disallow /lists/ Disallow /newsletters/ Disallow /phd/ Disallow /siteImages/ Disallow /wolf/ # # End of robots.txt file # ###############################