Thanks for Visiting India 365 :)

| Mobile | RSS

Dont Mess With Robots.txt File Without Proper Knowledge

January 29th, 2010 | 5 Comments | Posted in Tech by admin

There are few questions that Google can’t give a perfect answer, and one such question is – “How to optimize a blog/website in Google?”. No wonder you would surely find lot’s of material for the above question but, most of the answers you  find from Google never seem to work.

fbme Dont Mess With Robots.txt File Without Proper KnowledgeMe on FB email Dont Mess With Robots.txt File Without Proper KnowledgeEmail rss Dont Mess With Robots.txt File Without Proper Knowledge RSS tweet Dont Mess With Robots.txt File Without Proper KnowledgeTwitter gbuzz Dont Mess With Robots.txt File Without Proper KnowledgeGbuzz fb Dont Mess With Robots.txt File Without Proper KnowledgeFB Page


Last week I made significant changes to my blog and used different strategies which helped me optimize few of my blog posts in Google. I Got a pretty good results for all the work I’ve done. Most of my pages ranked high including a latest post of mine (Shorter URL means Better SEO for Google).

This positive response from Google provoked the Alter-Ego(My second personality) inside me who is responsible for all the misdeeds that happened for sometime now. I’m a really innocent guy and its totally my Alter-Ego who do mischievous things around me to play with my innocence, dignity and pride.

Now, for convenience I will call my Alter Ego as Mr:X. He is the one who insisted me to mess up with robots.txt file for better SERP results. The angel inside me tried to stop , but the senior partner Mr. X always dominated the angel. I modified the robots.txt file and replaced the file with the default txt file in the home directory.

Robots.txt Dont Mess With Robots.txt File Without Proper Knowledge

Things started collapsing from the next couple of hours. The articles that were posted after the change in the robots.txt file didn’t get indexed by Google. Here are the articles that were posted after the change in the robots file.

1: A birthday boy to Another Birthday boy.

2: Category Review For New Readers.

Both these articles were not indexed by Google. I checked for problem and found its was the robots.txt file that caused the whole mess. Mr.X (My Alter-Ego) started to laugh at me the instant he found that there is a problem.

Moral of the Story:

Never trust your Alter-Ego in your life, they collapse things for nothing.

email Dont Mess With Robots.txt File Without Proper KnowledgeEmail Newsletter
fbme Dont Mess With Robots.txt File Without Proper KnowledgeCatch me on FB
tweet Dont Mess With Robots.txt File Without Proper KnowledgeI'm on Twitter too
rss Dont Mess With Robots.txt File Without Proper Knowledge Our RSS Feed
su Dont Mess With Robots.txt File Without Proper KnowledgeOur SU Profile
gbuzz Dont Mess With Robots.txt File Without Proper KnowledgeI'm on GBuzz
fb Dont Mess With Robots.txt File Without Proper KnowledgeOur FB Page
Leave a Reply 304 views, 1 so far today |
Tags:

Related Posts

Follow Discussion

5 Responses to “Dont Mess With Robots.txt File Without Proper Knowledge”

  1. Yogesh Mankani Says:

    LOlz . Very true man. Alter- ego is like devil for me too :)

  2. Chethan Says:

    I loved your way of explanation! this article rocks!
    even i am facing problem by google.. they are not indexing my recent posts..
    can i have ur gmail IM? please DM me @che2on twitter profile

  3. shahnawaz Says:

    Great sharing. I was looking about this topic for the last few times. I want to write a post on it soon in my blog.

  4. Rajesh Kanuri @ TechCats Says:

    Even blog has issues with robots.txt.. I am trying hard to solve them.. Hope they will be back in track soon ..

  5. My Life Is Says:

    For some reason only the words of the post is being displayed, is it my web browser or the website?

Leave a Reply

Sorry, no posts matched your criteria.