Google Bots Pre-Occupation with My Calendars

I am not really keen on the Calendars and so I remove them where every possible on each module. However the google bot seems to have a really unhealthy pre-occupation with the calendars, whether or not I have removed them from public view. I can see the google bot is currently leeching a page on the calendar in year 2041. I have seen it leeching way into the future again and again on every installed modules calendar.  Much as I like the google bots attention, this is extra traffic and would like to rid myself of it. If the google bot is going to leech it should be doing it on other pages which actually have some useful information to index. Is their a way to have a module but stop access to the calendars?

Quote · 18 Feb 2010

Use your robots.txt file to tell google not to crawl that part of your site.

Light man a fire keep him warm for a night, light him ON fire & he will be warm the rest of his life
Quote · 18 Feb 2010

makes sense. Did not think about that Smile

Thanks

Quote · 18 Feb 2010

Calendars are considered to be "crawler traps," because of the limitless amount of pages they can produce.

It's one of the reasons why I deny access to all bots, both by robots.txt and by IP address.

BoonEx Certified Host: Zarconia.net - Fully Supported Shared and Dedicated for Dolphin
Quote · 18 Feb 2010

Thanks for the info. Very useful as always Magnussoft Smile

Calendars are considered to be "crawler traps," because of the limitless amount of pages they can produce.

It's one of the reasons why I deny access to all bots, both by robots.txt and by IP address.

Quote · 18 Feb 2010

how must it look like, that all url´s with calendar are blocked?

is this correct?

Disallow: *calendar*

ue30 Mods - http://www.boonex.com/market/posts/ue30
Quote · 1 Apr 2010

Hi,

I am having the same issue with Google and calender. I have set up robots.txt to block them but Google is still showing them. I removed the module and deleated it but now the site just redirwects to profile. Its doing my head in. Can i set it up to redirect to the home page?  Google webmasters is showing me 58 pages not found. I cant get me head around this!!! Help please.

Any one else have these issues? If so some advice on what you did would be great.

Is there a mod out there that can help with pages and seo etc?

Thanks

M

Quote · 15 Mar 2011
 
 
Below is the legacy version of the Boonex site, maintained for Dolphin.Pro 7.x support.
The new Dolphin solution is powered by UNA Community Management System.