SEO

What do search engine spiders see?

August 23, 2006

Ever wondered what the search engine spiders see? Me too.When you understand how they are viewing your page you are far better equipped to optimise the page. Recently in some of Matt Cutts’ vidyos he mentioned the lynx browser. What is lynx? It is a text only browser for the web. Basically, if you can [...]

Robots.txt

August 11, 2006

What is the robots.txt file for? When a search engine spider visits your site a number of them check to see if a robots.txt file is there first, if it is and it contains rules that apply to the particular bot/spider visiting then it will follow those rules. The rules that go in the file [...]

NOODP

August 7, 2006

Again, this information is excerpted from one of Matt Cutts video articles – someone wrote in because they were noticing that at times the description that Google was using for their site in search results was actually the description of their site in the Open Directory Project – instead of the meta description tag for [...]