You are hereSpam the spammers / Reply to comment
Reply to comment
Robots.txt
Submitted by Dieter_be (not verified) on Sat, 06/07/2008 - 08:03.
And you'll probably want to update your robots.txt to keep 'good' crawlers (search engines etc) from wasting their time on these domains. (evil crawlers ignore robots,txt anyway). I don't know if you can enter foreign domains in your robots.txt but you can always put the links on a separate page and put that page in your robots.txt
Dieter




