For those that venture away from straight blogging and into datafeeds, script stores, api’s, and more you know that getting a site deeply indexed is a sink or swim proposition.

Even for traditional bloggers it might help you see where the googlebot goes on your blog to help diagnose problems.

CrawlTrack

For those that care about where the googlebot goes on their site, I’ve been enjoying a tool called Crawltrack.fr this weekend.

CrawlTrack is a free application (license GNU GPL), which allow to track search-engines crawlers and spiders visits on your website and to follow day after day your position in the main search engines and social bookmarks index.

I’ve got crawltrack on a half dozen sites and already I can see what sites are getting crawled more, which sites aren’t getting crawled, which parts of the sites are getting crawled more, etc. Really cool stuff.

Installation

The install was easy if you know your database information.

One of the coolest features of Crawltrack is the ability to track MULTIPLE sites all from one place.

However, if your host disables fsockopen you might have some trouble with the multiple sites, however tracking one site is still easy.

For the googlebot geeks

Crawltrack.fr is a real easy way to track the bots. I really wish I had stumbled on this tool a couple years ago.