Articles & News About Jobs & Employment

Search Engine Robots - How They Work, What They Do (Part II)

If your site isn't found in the search engines, it is probably because the robots couldn't deal with it. It could be something as simple as not being able to find the site, or it may be more complicated issues involving the robot's not being able to crawl the site or figure out what your pages are all about.

Submitting your site to the major search engines: that will help with the "can't find it" problem. Even having links pointing back to your site can be enough to attract the search engine robots. Google, for example, suggests that you may not have to submit your pages; they will find your site if you have a link pointing back to it from at least one other site on the web.

If the robots can find your site but can't make sense of it, then you may need to look at the content and technology used on your pages. Frames, Flash, dynamically generated pages, and invalid HTML source code can cause problems when the search engine robot tries to access your web pages. While some search engines are beginning to be able to index dynamically generated pages and Flash (e.g. Google and AllTheWeb), use of some of these technologies can hinder your ability to be indexed by the search engine robots.

Text in images cannot be read by the search engine robots. Using ALT image text is an important way to help the robots "read" your images. Websites with extensive images rely heavily on ALT text to present their content. How Do I Get The Most Out Of Indexing?

If you know what to "feed" the spidering robots you will help yourself with search engine ranking.

Having a website full of good content is the major factor. Search engines exist to serve their visitors, not to rank your website. You need to be sure to present yourself in your site in the way that will be most useful to the search engine visitor. Each search engine has its own idea of what is important in a page, but they all value text highly. Making sure that the text on your pages includes your most important keyword phrases will help the search engine evaluate the content of those pages.

Making sure that you have good title and meta tags will further assist the search engines in understanding what your page is about. If the text on the page is about widgets, the title is about widgets, and the meta tags are about widgets, the search engine will have a pretty good idea that you are all about widgets. When their visitors search for widgets, the search engines know to list your site in the results.

A sitemap page is a very good way of giving the search engine robot every opportunity to reach your website pages. Since robots click through the links of your web pages, make sure that at least your most important pages are included in the sitemap; you may even want to include all your pages there, depending on the size of your site. Be sure to add a link to the sitemap page from each page on your site.

Another important consideration is that of keeping all of your pages within a small number of "clicks" from your top page. Many robots will not follow links more than two or three levels deep, so if your "widgets" page can only be reached from your home page by following multiple links (e.g. home page >> about us page >> products page >> widgets page), the robot may not crawl deep enough to get to the widgets page. Testing Your Website For Search Engine Robot Accessibility

To get an idea just what the search engine robot "sees" on your page, you can look at the Sim Spider tool. You may be surprised at how different your site looks to the robot. You can find this tool at http://www.searchengineworld.com/cgi-bin/sim_spider.cgi

You will see text and ALT image text show up in the results. If your entire website is built in Flash, you will see nothing at all because robots don't understand Flash movies. The Bottom Line

When it comes to search engine robots, think simply. Lots of good content and text, hyperlinks the robots can follow, optimization of your pages, topical links pointing back to your site and a sitemap will help insure the best results when the robots come visiting.

Resources

*SpiderSpotting - Search Engine Watch http://searchenginewatch.com/webmasters/spiders.html

*Robotstxt.org List of robots and protocols for setting up a robots.txt file. http://www.robotstxt.org/

*Spider-Food Tutorials, forums and articles about Search Engine spiders and Search Engine Marketing. http://spider-food.net/

*Spiderhunter.com Articles and resources about tracking Search Engine spiders. http://www.spiderhunter.com/

*Sim Spider Search Engine Robot Simulator Search Engine World has a spider that simulates what the Search Engine robots read from your website. http://www.searchengineworld.com/cgi-bin/sim_spider.cgi

Daria Goetsch is the founder and Search Engine Marketing Consultant for Search Innovation Marketing, a Search Engine Optimization company serving small businesses. She has specialized in Search Engine Promotion since 1998, including three years as the Search Engine Specialist for O'Reilly Media, Inc., a technical book publishing company.

Copyright © 2002-2005 Search Innovation Marketing. http://www.searchinnovation.com All Rights Reserved.

Permission to reprint this article is granted if the article is reproduced in its entirety, without editing, including the bio information. Please include a hyperlink to http://www.searchinnovation.com when using this article in newsletters or online.

Other Article Sites

findabook.com  moneycd.info  a-mortgage.info   about-lemon-laws.info  aboutstudentloans.info
all-about-publishing.info  auctions-articles.info  bestcollege-university.com  bestispconnection.com
biblefolder.com  blogger-website.com  books-used.info  brokers-guide.info  buywindows.info  cable-dsl.info
career-miner.com  carpel-tunnel.info  cashinaflash.info  cashloanreviews.info  casinobell.com  chat-house.info
clearmycredit.info  collegeloantips.info  crones.info  depression-articles.info   dirnic.net  dishguides.info
divers-below.com  expodog.info   financewizz.com  fire-insurance.info  getgood.info  handleit.net   it-idea.info
health-supplies.info  hosting-right.com  insidealert.com  insurance-facts.info  jobs-employment.info
justgood.info  lookgold.net   lowcost-travel.info  money-source.info  myhostzone.info  numisblog.com
peoplesearchfinder.info  pr-articles.info  realeas.com   refinancing-guides.info  spyware-remove.info
telelot.info  the-law.info   toppaid.info  travel-deals.info  travelcorrect.com  wedding-guide-site.com
your-blog.info  your-credit.info

Finding that Work at Home Job - A Job in Itself
The trend of corporate America creating work at home jobs for telecommuters is growing, which is good news for those of you who are looking to do your work in your pajamas every day. Technology has made the work at home job more appealing to both bosses and employees, though it does not mean the trend has hit the mainstream, so a work at home job can still be hard to find.

Legitimate Work At Home Jobs - Become Wealthy Working From Home
It all started when I was franticly going from company to company passing out my resume, needing a job so bad it hurt I had a college degree but could not get hired no matter what for the life of me

Work at Home Businesses Versus Work at Home Jobs
Is a work at home business better than a work at home job? You bet. Hands down. But each option has pros and cons. It may be that for right now you're just not ready to start a work at home business. Its a big committment. That's OK. But if you're dedicated, smart and willing to work harder than most, settling for a work at home job could be selling yourself short.

Work From Home - How To Prepare For A Work From Home Job
Surely, you must have already heard about the perks of working from home Not only do you get the opportunity of being with your loved ones, but also the chance of earning good money doing what you like

7 Benefits of Owning a Computer Work at Home Job
Computer work at home jobs are growing in numbers Some cost very little to start-up and others are completely free to start

Job Work From Home On My Computer
In my long quest for a job, work from home on my computer seemed to be the best available option Especially, since I needed to work around the many schedules of my family

At Home Work - Find Your Next Work At Home Job
At home work is easy to find these days thanks to the internet Work from home jobs are a form of self employment, which is hitting today's society in huge numbers

Being A Work At Home Business Opportunity Seeker And Finding Work From Home Jobs
The problem with work from home jobs is simply that so many people want to have them Because of this, there are lots of people who want to take advantage of people who truly want to be able to have the freedom of a home business

Work at Home Agent - Job Ideas For a Work at Home Agent
Are you interested in jobs that require you to spend hours on the phone talking to customers If you like personal relations work and have good interpersonal skills, then do consider the opportunity of being a work at home agent

Work at Home Data Entry Jobs Career Are Available Now
Work at home data entry jobs career allow you the freedom to spend more time with your family It is perfect employment for someone who is looking for a job they can control themselves

Work at Home Jobs Vs Self Employment
Work at Home Jobs vs Owning a Home Based BusinessNot everyone is interested in owning their own home business, but a lot of people are interested in dropping out of the rat race a little bit. More and more jobs are available where you can work from home.

Home Computer Work - 3 Ideas For Home Computer Work Jobs
Surely, many people out there have told you about the wonders of working from home and being your own boss Well, not only are you able to save on transportation costs and have more time to spend with your family, you are also able to do whatever you like, whenever you feel like it

On Campus Interviews - A Chance For Your "First Job" As Well As Career Employment
During the course of training or secondary educations some organizations - companies, firms as well as major non-profit organizations of great status and reputation will offer campus interviews to graduating students in such fields as engineering, electronics, business management, law accounting, computer information systems and marketing

Work at Home Data Entry Jobs, Work at Home, Data Entry Jobs
37 Work at Home Data Entry Jobs - The New Age Career Move