阻止Comscore机器人访问

Question

实际上，我得到了机器人设备的机器人欺诈，而在用户代理，它似乎comscore爬虫。

Mozilla/5.0 (兼容；接近；+https://www.comscore.com/Web-Crawler)

如何才能停止从代理IP访问机器人。

非常感谢

Answer 1

如果你使用cloudflare，你可以用这个删除它。

​

(http.user_agent contains "Yandex") 
or (http.user_agent contains "muckrack") 
or (http.user_agent contains "Qwantify") 
or (http.user_agent contains "Sogou") 
or (http.user_agent contains "BUbiNG") 
or (http.user_agent contains "knowledge") 
or (http.user_agent contains "CFNetwork") 
or (http.user_agent contains "Scrapy") 
or (http.user_agent contains "SemrushBot") 
or (http.user_agent contains "AhrefsBot") 
or (http.user_agent contains "Baiduspider") 
or (http.user_agent contains "python-requests") 
or ((http.user_agent contains "crawl") 
or (http.user_agent contains "Crawl") 
or (http.user_agent contains "bot" and not http.user_agent contains "bingbot" and not http.user_agent contains "Google" and not http.user_agent contains "Twitter")
or (http.user_agent contains "Bot" and not http.user_agent contains "Google") 
or (http.user_agent contains "Spider") 
or (http.user_agent contains "spider") 
and not cf.client.bot)

​

在cloudflare上配置：

​

​

检查块：

​

​