# This script specifies the files and folders the website that shouldn't # be indexed by search engine spiders. #User-agent field specifies the robot, for example googlebot. In this case all robots User-agent: * #Disallow prevents the robot from indexing/downloading the specified folders Disallow: /_db_backups/ Disallow: /_hcc_thumbs/ Disallow: /images/ Disallow: /images/_hcc_thumbs/ Disallow: /aspnet_client/system_web/4_0_30319/ Disallow: /refLetters/ Disallow: /SpryAssets/ Disallow: /stats/ Disallow: /_notes/ #Disallow prevents the robot from indexing any dynamic urls #Disallow: /? Sitemap: http://www.primesourceconstruction.com/sitemap.xml