Itjbmarketing’s Blog


Robots.txt by jbenomore
April 17, 2009, 8:28 am
Filed under: 1 | Tags:

Hi,

This article provide a good overview of bots, and tells you what they can do and how they work. It is a bit technical but useful.

http://searchengineland.com/a-deeper-look-at-robotstxt-17573

Advertisements

Leave a Comment so far
Leave a comment



Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s



%d bloggers like this: