by denis | Mar 7, 2007 | Search
I have seen many articles and the like discussing proper use of the Robots Meta tag. It almost seems common knowledge of the purpose of this tag, but every now and then you find some confusion over its purpose and how it works. Recently Vanessa Fox over at the...
by denis | Aug 2, 2006 | Tools
This is a short posting but it has the potential to have a wonderous impact on your website. Back in June Google implemented a Robots.txt validator that allows you to check for errors. The robots.txt file can easily ruin your chances for ranking if it is not carefully...
by denis | Aug 2, 2006 | Search
Have you noticed how infrequently and deeply Ask appears to be indexing websites? I reviewed a number of my client’s websites and discovered that of the big 4 robots (Google, Yahoo, MSN and ASK) Ask is dramatically falling behind. Where the other search engines...
by denis | Jul 6, 2005 | Tips
Spiders make great geek pets, at least virtual ones do. Here at StepForth, we keep a couple spiders on our system to test sites, pages and documents in the hopes of learning more about the behaviours of common search engine spiders such as GoogleBot, Yahoo’s...
by Jim Hedger | Dec 1, 2004 | Search
Google “…is big. Really Big. You just won’t believe how vastly hugely mind-bogglingly big it is.” (excerpt from The Hitchhiker’s Guide to the Galaxy) Google is the most powerful information resource humans have ever constructed. The power...