Robots.txt expert needed
Hello,
MSN bot is going mad on my site. I have the ip xxx.xx.xx.xxx of the most offending ip address. How do I disallow this bot by ip in a robots.txt file. I want to be sure I am only disallowing this ip only and not other bots. Any help on this is appreciated.
cheers
|