引用文章
感謝 阿駕
http://twntwn.info/blog/ajer001/archives/1362
可以利用 .htaccess 擋掉一些垃圾。
參考 Mark的 透過 .htaccess 來阻擋 Referer Spam 的內容
SetEnvIfNoCase Remote_Addr [IP Address] ban
SetEnvIfNoCase User-Agent [Browser Name] ban
SetEnvIfNoCase Referer [Referer Keyword] ban
<Files *>
Order Allow,Deny
Allow from all
Deny from env=ban
</Files>
阿杰老師 修改的設定
#ban jay
SetEnvIfNoCase User-Agent ^Baidu ban
SetEnvIfNoCase User-Agent ^baiduspider ban
SetEnvIfNoCase User-Agent ^Baiduspider ban
SetEnvIfNoCase Remote_Addr 81.95.146.162 ban
SetEnvIfNoCase Remote_Addr 220.181.19.* ban
SetEnvIfNoCase Remote_Addr 202.10* ban
SetEnvIfNoCase Referer ^125mb.* ban
SetEnvIfNoCase Referer ^adult.* ban
SetEnvIfNoCase Referer ^amateur.* ban
SetEnvIfNoCase Referer ^asian.* ban
SetEnvIfNoCase Referer ^ballaire.* ban
SetEnvIfNoCase Referer ^boy.* ban
SetEnvIfNoCase Referer ^casino.* ban
SetEnvIfNoCase Referer ^cutethumb.* ban
SetEnvIfNoCase Referer ^epraha.* ban
SetEnvIfNoCase Referer ^erotic.* ban
SetEnvIfNoCase Referer ^gamble.* ban
SetEnvIfNoCase Referer ^gay.* ban
SetEnvIfNoCase Referer ^girl.* ban
SetEnvIfNoCase Referer ^incest.* ban
SetEnvIfNoCase Referer ^invest.* ban
SetEnvIfNoCase Referer ^ispy.* ban
SetEnvIfNoCase Referer ^lesbian.* ban
SetEnvIfNoCase Referer ^loan.* ban
SetEnvIfNoCase Referer ^lolita.* ban
SetEnvIfNoCase Referer ^movie.* ban
SetEnvIfNoCase Referer ^pharmacy.* ban
SetEnvIfNoCase Referer ^phathookups.* ban
SetEnvIfNoCase Referer ^picture.* ban
SetEnvIfNoCase Referer ^pills.* ban
SetEnvIfNoCase Referer ^poker.* ban
SetEnvIfNoCase Referer ^porn.* ban
SetEnvIfNoCase Referer ^sex.* ban
SetEnvIfNoCase Referer ^shit.* ban
SetEnvIfNoCase Referer ^teen.* ban
SetEnvIfNoCase Referer ^texas-hold.* ban
SetEnvIfNoCase Referer ^texashold.* ban
SetEnvIfNoCase Referer ^viagra.* ban
SetEnvIfNoCase Referer ^video.* ban
SetEnvIfNoCase Referer ^woman.* ban
SetEnvIfNoCase Referer ^women.* ban
SetEnvIfNoCase Referer ^ua-princeton.* ban
SetEnvIfNoCase Referer ^kredit.* ban
SetEnvIfNoCase Referer ^rateandscore.* ban
SetEnvIfNoCase Referer ^anti-spyware.* ban
SetEnvIfNoCase Referer ^carolinabodyshop.* ban
SetEnvIfNoCase Referer ^bdsm.* ban
SetEnvIfNoCase Referer ^tristones.* ban
SetEnvIfNoCase Referer ^viaspeip.* ban
SetEnvIfNoCase Referer ^upindex.* ban
SetEnvIfNoCase Referer ^autoclan.* ban
SetEnvIfNoCase Referer ^findteam.* ban
SetEnvIfNoCase Referer ^searchsure.* ban
SetEnvIfNoCase Referer ^auditions.* ban
<Files *>
Order Allow,Deny
Allow from all
Deny from env=ban
</Files>
#end ban jay
參考文章
http://www.seoclub.cn/baidu/content/20060221215004.htm
此外 還可以擴大這個列表，屏蔽那些Email提取爬蟲、網站克隆爬蟲等。
SetEnvIfNoCase User-Agent "^baiduspider" ban_bot
SetEnvIfNoCase User-Agent "^HTTrack" ban_bot
SetEnvIfNoCase User-Agent "^EmailCollector" ban_bot
SetEnvIfNoCase User-Agent "^EmailWolf" ban_bot
SetEnvIfNoCase User-Agent "^ExtractorPro" ban_bot
SetEnvIfNoCase User-Agent "^Offline" ban_bot
SetEnvIfNoCase User-Agent "^WebCopier" ban_bot
SetEnvIfNoCase User-Agent "^Webdupe" ban_bot
SetEnvIfNoCase User-Agent "^WebZIP" ban_bot
SetEnvIfNoCase User-Agent "^Web Downloader" ban_bot
SetEnvIfNoCase User-Agent "^WebAuto" ban_bot
SetEnvIfNoCase User-Agent "^WebCapture" ban_bot
SetEnvIfNoCase User-Agent "^WebMirror" ban_bot
SetEnvIfNoCase User-Agent "^WebStripper" ban_bot
deny from env=ban_bot