Thread: what the hell is Robots.txt?
View Single Post
  #2  
Old 04-11-2012, 11:34 PM
Doublestep Doublestep is offline
Banned


Join Date: Dec 2011
Posts: 212
Default
do you even read the text under the error, you gigantic fucktard?

http://en.wikipedia.org/wiki/Robots_exclusion_standard