How to stop different web crawlers from visiting java based web application? -
this question has answer here:
- how disallow specific page robots.txt 4 answers
i working on struts2 based web application , want stop web crawlers visiting application.
to stop requesting crawlers machines, must know ip address of machines. can create new filter application. can ip of request app in filter. if ip mapping ip address of crawler. kick request out apps. hope help.
Comments
Post a Comment