User-agent: * Disallow: /download/ Disallow: /downloads/ Disallow: /funx/ Disallow: /01_cms/ Disallow: /js/ Disallow: /phpcounter/ Disallow: /tmp/ Disallow: /content/ Disallow: /formfields/ Disallow: /cgi-bin/ Disallow: /06_popup Disallow: /fvn2004/ Disallow: /FVN_files/ Disallow: /inx/ Disallow: /phpedit/ Disallow: /redaxo/ Disallow: /files/ User-agent: A-Online Search User-agent: ATN_Worldwide User-agent: Arachnophilia User-agent: ArchitextSpider User-agent: Crawler V 0.2.1 admin@crawler.de User-agent: CoolBot User-agent: Deweb/1.01 User-agent: grabber User-agent: Eule-Robot User-agent: Arachnoidea User-agent: IBM_Planetwide User-agent: InfoSeek Sidewinder/0.9 User-agent: Slurp User-agent: LinkWalker User-agent: WebMoose User-agent: Tarantula User-agent: Gulliver/1.3 User-agent: fido/1.0 Harvest/1.4.pl2 User-agent: MegaSheep User-agent: Ultraseek User-agent: whatUseek_winona Disallow: *