Dont Mess With Robots.txt File Without Proper Knowledge
There are few questions that Google can’t give a perfect answer, and one such question is – “How to optimize a blog/website in Google?”. No wonder you would surely find lot’s of material for the above question but, most of the answers you find from Google never seem to work.

Me on FB

Email

RSS

Twitter

Gbuzz

FB Page
Last week I made significant changes to my blog and used different strategies which helped me optimize few of my blog posts in Google. I Got a pretty good results for all the work I’ve done. Most of my pages ranked high including a latest post of mine (Shorter URL means Better SEO for Google).
This positive response from Google provoked the Alter-Ego(My second personality) inside me who is responsible for all the misdeeds that happened for sometime now. I’m a really innocent guy and its totally my Alter-Ego who do mischievous things around me to play with my innocence, dignity and pride.
Now, for convenience I will call my Alter Ego as Mr:X. He is the one who insisted me to mess up with robots.txt file for better SERP results. The angel inside me tried to stop , but the senior partner Mr. X always dominated the angel. I modified the robots.txt file and replaced the file with the default txt file in the home directory.
Things started collapsing from the next couple of hours. The articles that were posted after the change in the robots.txt file didn’t get indexed by Google. Here are the articles that were posted after the change in the robots file.
1: A birthday boy to Another Birthday boy.
2: Category Review For New Readers.
Both these articles were not indexed by Google. I checked for problem and found its was the robots.txt file that caused the whole mess. Mr.X (My Alter-Ego) started to laugh at me the instant he found that there is a problem.
Moral of the Story:
Never trust your Alter-Ego in your life, they collapse things for nothing.
|
|
|




















January 29th, 2010 at 8:32 pm
LOlz . Very true man. Alter- ego is like devil for me too
January 29th, 2010 at 10:54 pm
I loved your way of explanation! this article rocks!
even i am facing problem by google.. they are not indexing my recent posts..
can i have ur gmail IM? please DM me @che2on twitter profile
February 4th, 2010 at 12:50 pm
Great sharing. I was looking about this topic for the last few times. I want to write a post on it soon in my blog.
February 6th, 2010 at 11:43 am
Even blog has issues with robots.txt.. I am trying hard to solve them.. Hope they will be back in track soon ..
February 11th, 2010 at 8:25 am
For some reason only the words of the post is being displayed, is it my web browser or the website?