Can Robots.txt Increase Your Rankings?

Neil Patel says his traffic increased 11% after he added some duplicate content pages to his robots.txt on his blog. The idea is to get rid of junk pages that aren't helping your search rankings, which helps the other pages that you do want indexed to improve in the search results. It makes sense, although it's hard to know if this is the only reason his traffic increased. I'd be more convinced if he had a before and after ranking report that improved in addition to the traffic...although even then, there are so many other factors in play, it's hard to know if the robots.txt file was solely responsible. Still, it doesn't hurt to utilize the robots.txt file for what it was intended. I'll have to experiment with this a bit with this blog to see if it makes a difference.
Labels: robots.txt, seo, tips

