tags:

views:

43

answers:

2

Hello,

Here is the copy of my robots.txt content

Sitemap: http://www.go4film.com/sitemap.xml

User-agent: ia_archiver
Disallow: /

User-agent: robtexbot
Disallow: /

User-agent: Googlebot
Allow: /

Here I only allow googlebot.And block Alexa and everything

So could someone please tell me if I block search engines like yahoo,ask,bing and archive like alexa from my website what I did in my robots then whether it affects my visitor count or ranking in Alexa or indexing in yahoo,bing.

A: 

I think to ban yadex.ru now It started make half traffic of my picture site ;)

nerkn
+1  A: 
moontear
but is it true that these bots steal the bandwidth of the website very drastically.
pravat231
Yes, they do eat bandwidth. Best thing to do is to exclude the bots from your bandwidth hoggers e.g. the `/images/` directory. Accessing just your plain HTML pages shouldn't be a problem - only if you had dynamically generated URLs which the bots all want to crawl.
moontear