August 28, 2006 Comments
|
|
Shari Thurow's column over at ClickZ today has an interesting tidbit in it than many small business owners and new SEM practitioners should read and consider. It's an explanation of the difference between a site being spidered and a site being indexed. Most site owners assume that the two words are one and the same...meaning you get spidered and you are then in the index. As Shari points out, that's not always the case.
From the article:
The biggest misconception at this year's conference was the difference between the spidering and indexing processes. The index is a subset of the spider. Search engines access Web content through the spidering process. Then, they filter out duplicates and other bad content and create the index.
A Web site can be spidered and not included in a search engine index.
Go back and read that last line again. Then think about it. It's not uncommon for me to talk to a site owner or to get an email from someone that's confused as to why they aren't showing up in Yahoo! or Google. Usually, these site owners have seen proof in their log files that the spiders from these engines have been to their sites. Sometimes the spiders have been there dozens of times and have visited every single one of their pages, yet the site still fails to show up in the index.
This is where it's important to remember that there are plenty of stumbling blocks that can keep a site from being indexed and ranked. That may mean a simple technical errors like a robots.txt file that's set to exclude the indexing of an entire site (rather than of certain areas) or an improperly routed 301 redirect. It could also mean that there are serious errors in your code, or that the content of your site is somehow being dubbed as duplicate to another site.
In other words, just because you aren't showing up in Google doesn't mean that Googlebot hates you. Sometimes it means that there are serious issues that need to be addressed.
Jennifer Laycock is the Editor of Search Engine Guide, an educational web site aimed at translating the search marketing world into something that small business owners can understand. Jennifer specializes in common sense search engine marketing, viral marketing and customer outreach via social media and blogs. A former search marketing consultant and in-house trainer, Jennifer’s clients have included companies like Verizon, American Greetings and Highlights for Children. Her primary clients now are a little girl named Elnora and a little boy named Emmitt.
|
|
|
Search marketing information for small business owners.
Fetching the best small business news.
A friendly place to share small business ideas and knowledge.
A different kind of small business marketing conference.
The directory of the best small business sites and tools.
Home of our network.
Copyright © 1998 - 2009 K. Clough, Inc. All Rights Reserved. Privacy
FreeFind Site Search Engine - FreeFind adds a "search this site" feature to your website, making your site easier to use. FreeFind also gives you reports showing what your visitors are searching for, enabling you to improve your site. FreeFind's advanced site search engine and automatic site map technology can be added to your website for free.
(Unpaid placement - FreeFind is a Search Engine Guide partner.)