#robots.txt #01/17/03 #this file dictates which folders and files bots may and may-not index #it must be named "robots.txt" and placed in the webRoot. ("/robots.txt") User-agent: * Disallow: /admintool/ Disallow: /images/ Disallow: /includes/ Disallow: /pages/ Disallow: /process_callback.asp Disallow: /site_action.asp Disallow: /404.asp