############################### # # User-agent: * # # list folders robots are not allowed to index # Disallow: /scripts/ Disallow: /scripts/ Disallow: /Upload/ Disallow: /Upload/Upload Disallow: /webalizer/ Disallow: /includes/ Disallow: /dbadmin/ Disallow: /Awstats/ Disallow: /cp/ # list specific files robots are not allowed to index # Disallow: /accdb.asp Disallow: /accdb1.asp # # ###############################