tags:

views:

40

answers:

2
Q: 

How can i keep log of every bots (google, yahoo etc) visit to my website

How can I keep record/log of every bot's visit to my website. I want to know how frequently crawlers are crawling my website and which pages are being indexed or crawled. Is there any php script which i can use to know the visits of google, yahoo and other bots.

A: 

parse your log files for the user agent i have seperate log files in the first place google the rest for yourself or consider accepting some answers

Joe Hopfgartner  2010-10-02 22:08:24
A: 

use awstats or robotstats, it will do the job.

Tuf  2010-10-04 21:43:37

related questions

IDE suggestions: Eclipse IDE vs. Zend Studio ( confused )
MySQL/Apache Error in PHP MySQL query
Lightweight IDE for Linux
What PHP framework would you choose for a new application and why?
Why is my ternary expression not working?
How can I get at the matches when using preg_replace in PHP?
Mechanisms for tracking DB schema changes
Wordpress theme development offline tools
Using object property as default for method property
How can I get the authenticated user name under Apache using plain HTTP authentication and PHP?
Make XAMPP/Apache serve file outside of htdocs
How do you debug PHP scripts?
PHP Variables passed by value or by reference?
Best way to implement unit testing in PHP
Connect PHP to an AS/400
Best way to access Exchange using PHP?
PHP Session Security
How do I access a remote form in php?
What's the best way to generate a tag cloud from an array? (using h1 through h6 for sizing)
Apache/PHP: error_log per Virtual Host?
How do I track file downloads with apache/PHP
How would you access Object properties from within an object method?
Flat File Databases in PHP
Best way to allow plugins for a PHP application
Latest information on PHP upcoming releases