Crawler Trends

This feature of Logaholic provides you with an insight into the frequency of crawler activity for the different kinds of crawlers on your site.

The pie chart "Top Crawlers" tells you which are the top 10 most active crawlers on your site.

It is important to know which crawlers are most active on your pages, because ultimately the crawlers determine your site's ranking on SERPS. Therefore you need to make sure that the crawlers you want (such as GoogleBot) crawl the pages you want. In some cases you would like to keep some pages ( for instance your site's statistics) "hidden from crawlers" and by seeing which of them are regularly crawled, you can prevent that.

Oftentimes it is not recommended that your site gets crawled too much. If too many bots and crawlers are busy on your site, eventually it will slow down its performance and make it less user friendly.