|
|
|
| mn :: comp | |
Yahoo!'s Slurp engine has been ignoring robots.txt on my site for a couple of months, and I'm tired of it. There's no administrative contact associated with it, and of course general queries haven't worked, so I'm hereby blocking their stupid search engine.
RewriteCond %{HTTP_USER_AGENT} Yahoo\!\ Slurp
RewriteRule ^.*$ - [F]
|
Last modified: Nov 25, 2005 12:48 pm.
|
||
|
|
