Comments on: The Robots Meta Tag and Robots.txt File

By: indir

indir — Mon, 13 Apr 2009 18:29:23 +0000

I loved the picture, Mig. The “Lame guy disallow” is very funny! lol

By: Mihaela Lica

Mihaela Lica — Thu, 02 Apr 2009 15:31:38 +0000

Very good observation. However, I had to delink your site – if you read my warning in the comments box, you will understand why.

By: The Name You Know

The Name You Know — Thu, 02 Apr 2009 15:24:40 +0000

I’m in the process of adding a robots.txt file to my site because my site does not get indexed by Yahoo and some people recommended that I add a robots.txt file. Thanks for the tip about adding a link to the sitemap. Here’s a tip from me: each subdomain needs it’s own robots.txt file.

By: Wilson Pon

Wilson Pon — Tue, 03 Mar 2009 06:43:54 +0000

I loved the picture, Mig. The “Lame guy disallow” is very funny! lol

By: Grog

Grog — Mon, 02 Mar 2009 20:33:14 +0000

Great post! I would be interested in knowing the likely hood of a website being hacked once you set up the robot file. I recently switched my blog to dofollow and it seems as though I get spammed constantly. Grog’s last blog post..Emergency Room Malpractice On The Rise

By: Ma

Ma — Mon, 02 Mar 2009 13:40:13 +0000

I had fun playing around with meta tags around the first of last year sometime. I've removed them since then but still remember the experience. I ended up committing hari cari as far as search engines go but what the heck. It was an interesting experience. Ma’s last blog post..Poetry: A Street by Leonard Cohen