Print Article for : Problem Retrieving Search Results

Your Online Guide » Guide to Technology » Web Site Development

[P694]Problem Retrieving Search Results

by Kathryn Lively, Kat

So, you spent a considerable amount of time designing your website. You have attractive graphics on display, user-friendly navigation, perhaps a bit of Flash or javascript to enchance the user's experience on your site. The site's content is fresh, relevant, and original. A site such as yours should attract much attention in relevant search results, so why is incoming traffic so slow? Why are the search engines not caching your information as quickly and as often as you would like?

You look at your website and wonder what could be wrong. On the outset, the site looks fine, but consider this: what the average Internet user sees is not what the search engine spider (or "bot") sees when it crawls the web to collect the data. The spider reads the site's code, all of the characters and data you or your HTML editor added to create the site. Oftentimes, a spider will attempt to crawl a site only to become entangled in a different kind of web! If there is one character out of place, additional code that shouldn't be there, or code that is unreadable to spiders, your website just may be bypassed altogether.

Remember all of those fancy Flash and javascript doo-dads you implemented? Some spiders can't read that type of code, and you may be blocking them from collecting your information for search. Be sure to allow room for spiders to move around. Keep complicated code to a minimum or forgo it altogether. The cleaner a website's code is, the better a web crawler can spider the site and gather relevant data for caching. The more relevant, updated information a seach engine spider gathers from a site, the better that site's chances are in search results.

A good way to determine whether or not your website is searchable is to have the code validated. The W3C Validator is a free service recommended to validate site code and check for conformance to W3C standards. The World Wide Web Consortium (W3C) is an international consortium where member organizations, a full-time staff, and the public, work together to develop standards for the World Wide Web. Simply enter your URL in the validator and a list of errors, where applicable, will alert you to what needs to be improved in the code of your site. Think of it as fine tuning, it may take some time to improve your site's code, but in the long run the increase in search referrals will have made it work the hard work.

In my opinion, one of the most crucial topics is Vertical Creep.

Vertical creep is when non-organic and non-paid results start occupying top spots in search results. Verticals started showing up in search results back when Altavista was popular, and since then have grown into a much more sophisticated part of the overall search engine results page. Greg Jarboe was the first to speak of vertical creep and introduced everyone to verticals.

All the engines have verticals in some form or another nowadays. Google has its famous ?OneBox? which is generally the place immediately below the top sponsored ads but immediately above the organic results. This is where you will find news, Froogle, and image results which may match a query.

For example, I wrote a few weeks ago about how, when you searched for Olympics on Google, you were presented with video results at the top of the page. But it doesn't stop there. Do a search for New Orleans, for example, and in Google you are presented with not only news results but also map results, pushing the organic results down so that only the top 2 or 3 results are showing. Much less than the typical 4 or 5 we are used to seeing.

One of the biggest impacts of Verticals is the ?stretching? of the search results page. It is becoming ever clearer that everything but the top 1 or 2 organic is worth less because it could be pushed below the fold, whereas sponsored's value is increasing because there are less organic results visible.

According to Gord Hotchkiss, however, the impact on verticals, at least on Yahoo! And MSN, isn't as great. His firm has recently completed research on how users interact with search engines. The Yahoo! MSN research performed by Hotchkiss? firm is a follow up to Google research the firm completed last year at this time.

According to Hotchkiss, Google does a better job of incorporating Verticals into results. Google users are more accepting of them while Yahoo! and MSN users tend to scan more of the results on a page, thereby negating the impact verticals have on organic results.

This could mean a couple of things. First, as Hotchkiss suggests, Google may have ?trained? its users. We are used to seeing the verticals (and hit bolding and inconsistently displayed sponsored results) and are therefore more accepting to the varying page changes, while Yahoo! and MSN users are less forgiving, perhaps because they feel the results displayed are less relevant. This isn't too hard to believe considering he gave an example of searching for New York Pizza on MSN and NOT getting pizza places but getting news about pizza in New York.

Personally, I too have experienced this, especially with MSN. It seems to have more of a problem determining what types of verticals are relevant to the searcher.

Bob Carilli was up next and presented a case study on how effective verticals have been for one of his clients.

Through some analysis they found that Froogle shopping results were showing up a lot for his clients? competitive keyword terms, yet the Froogle listings were unoptimized.

They responded by creating a data feed for Froogle which was optimized to target these great phrases which had poor Froogle listings. As a result, his client's site quickly moved to the top of the Froogle listings for those phrases. While it is unclear, I would assume this would have translated into similar top rankings in the Google area where Froogle is displayed.

This also shows that, as search marketers, we shouldn't rely solely on SEO or PPC. There are dozens of verticals out there we could tap into if we had an open mind.

If you look at Google alone, there are opportunities in Google News (with properly optimized press releases), Froogle, as mentioned above, Google Local, Google Base, Google Video and more. Similarly, with Yahoo! and MSN there are verticals to research. Both engines also have a shopping portal, as well as news, video and local results.

In the end, verticals could become the ?poor man's? SEO tactic. If you can't compete organically and can't pay for top sponsored, perhaps you can optimize your product feed to appear ahead of all your competitors?

Article Source : Music And Child Development

About Author

Both Kathryn Lively & Rob Sullivan are contributors for EditorialToday. The above articles have been edited for relevancy and timeliness. All write-ups, reviews, tips and guides published by EditorialToday.com and its partners or affiliates are for informational purposes only. They should not be used for any legal or any other type of advice. We do not endorse any author, contributor, writer or article posted by our team.

Kathryn Lively has sinced written about articles on various topics from Lose Weight, Laptops and Advertising Guide. Kathryn Lively is an Internet specialist with , a Virginia Beach-based website design and hosting company.. Kathryn Lively's top article generates over 673000 views. to your Favourites.

Rob Sullivan has sinced written about articles on various topics from PPC Advertising, Web Development. Rob Sullivan is a SEO Consultant and Writer for . Textlinkbrokers is the trusted leader in building long term rankings through safe and effective. Rob Sullivan's top article generates over 4400 views. to your Favourites.