#This is a sample of standard scanbot controls
#provided by Jaxnconsulting.Com 
#
# Reason: Search engines will look in your root domain for a special file named "robots.txt" (http://www.mydomain.com/robots.txt). 
#    The file tells the robot (spider) which files it may spider (download). 
#    This system is called, The Robots Exclusion Standard. 
#
# Instructions:
#   The format for the robots.txt file is special. It consists of records. 
#   Each record consists of two fields : a User-agent line and one or more Disallow: lines. 
#   The robots.txt file should be created in Unix line ender mode! 
#   Most good text editors will have a Unix mode or your FTP client *should* do the conversion for you. 
#   NOTE: Do not attempt to use an HTML editor that does not specifically have a text mode to create a robots.txt file.
#
# This file is provided as information only. No person or company mentioned accepts any responsibility for the mis-use,
# changes in standards, nor the non-compliance of other entities.
#
# We are just trying to help!.  Good luck.
# We found this information at http://www.searchengineworld.com/robots/robots_tutorial.htm
# Their references are :
#    http://www.webmasterworld.com/forum93/
#    http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
#
User-agent: *
Disallow: /images

User-agent: *
Disallow: /cgi-bin

User-agent: *
Disallow: /copywrite

User-agent: *
Disallow: /mysql

User-agent: *
Disallow: /sw_oscommerce

User-agent: *
Disallow: /oscommerce

User-agent: *
Disallow: /shopping

User-agent: *
Disallow: /index.php