g

Wednesday, March 18, 2009

Search Engines Spider

In the same way that there are two camps in the directory based property, spider based search engines (as described earlier) also tear into those that charge and those that don't. Those search engines that indict for enclosure do offer certain benefits over those that do not. The robot is definite to visit your site within a certain time period, and often to revisit on a normal basis. However, this does not mean that your site is sure to be included, particularly if you are found to be using unethical optimization techniques, such as cloaking. The free spider based search properties often take a lot longer to get round to sending a robot to your site, and may not resume on a regular basis.

Google is one exemption to the rule above in that it has a very regular prototype of indexing as much of the web as it can find, despite of whether you have submitted your site or not. Often, you will find your site scheduled in Google before you even consider using search engine optimization, although quite what rank you will attain without optimization is another matter. In fact, the only way to be sure that you site is not scheduled in Google, long term (if you have any reason to want to not be), is to use a Robots Exclusion Protocol, as discussed earlier.

Labels: ,

posted by jarabni @ 2:05 AM,


0 Comments: