User-agent: * Disallow: /admin/ Disallow: /classes/ Disallow: /data/ Disallow: /data2/ Disallow: /flash/ Disallow: /images/fonts/ Disallow: /scripts/ Disallow: /store/admin/ Disallow: /store/avspec/ Disallow: /store/seller/ Disallow: /sweeps/admin/ Disallow: /temp/ Disallow: /tinymce/ Disallow: /tools/ Disallow: /twitteroauth/ Disallow: /users/ Disallow: /wx/editcamera.php Disallow: /wx/reviewcamera.php # Voila bot is too agressive User-agent: VoilaBot Disallow: / # iltrovatore bot is too agressive User-agent: iltrovatore-Setaccio Disallow: / # some bugs are noted online that can overload a system # User-agent: MSIECrawler # Disallow: / User-agent: HyperRobot Disallow: /