General > General Discussion

How to avoid crawler like google or yahoo ?

(1/1)

pppplus:
When a bot (like google or yahoo) crawls my site, it opens a vistor request.

Is it possible to avoid it ?

Thanks

Inspirer:
Create robots.txt file in the root of your site.

User-Agent: *
Disallow: /webim/
Allow: /

pppplus:
oh yes, simple...

Navigation

[0] Message Index