How to prevent robots (Google Bot, MSNBot, Yahoo Slurp! etc.) from displaying cached pages of your site
By Angsuman Chakraborty, Gaea News NetworkTuesday, April 12, 2005
Site Owners often detest the fact that google caches an old copy of their site and displays it on searches which brings up the site pages.
A simple way to prevent robots (including Google, Yahoo etc.) from caching your site contents is to include the following within the head section of your web page.
<META NAME="ROBOTS" CONTENT="NOARCHIVE">
To prevent just Google use:
<META NAME="GOOGLEBOT" CONTENT="NOARCHIVE">
To prevent MSN Bot use:
<META NAME="msnbot" CONTENT="noarchive">
Note: MSN Bot do not indicate support for noarchive tag with the generic name ROBOTS (unlike Yahoo & Google).
|
August 31, 2006: 5:15 am
[...] Faster. The translator plugin uses object caching to achieve significant performance improvement. You can configure the duration of the cache (and disable it too). In short your translated pageswill load much faster on average. [...] |
|
August 2, 2005: 12:38 pm
[...] I can exert some control over MSN using the robots.txt file meta language to exclude MSNBOT, or to prevent it from archiving all my content. completely or restrict its access; I may do this soon. Trackback · • • • [...] |
|
April 12, 2005: 7:32 pm
How to prevent search engines keeping cached pages of your site Useful little hint if you need to do this Simple Thoughts � Archive � How to prevent robots (Google Bot, MSNBot, Yahoo Slurp! etc.) from displaying cached pages of your site. |
cihip