# /robots.txt file for http://209.200.34.69 # mail pmacafee@qstc.net for constructive criticism User-agent: webcrawler Disallow: User-agent: * Disallow: /cgi-bin Disallow: /logs Disallow:/_private Disallow:/database Disallow:/vti_pvt Disallow:/vti_txt Disallow:/vti_cnf Disallow:/vti_log Disallow:/vti_script