# This file robots.txt is a file generate to direct search engines what to explore and what not # File created by dgate(http://www.sirius-training.co.il/dgate) # This says to apply these settings to ALL search engine spiders/crawlers User-agent: * # These settings will keep spiders from indexing your unwanted pages # This assumes that your OSC install is in your web site's ROOT directory Disallow: /SCP # This line will tell googlebot-image to not search and download images from this site in order to decrease bandwith usage User-agent: Googlebot-Image Disallow: /