搜外网>搜外问答>问答页面

站点被爬怎么解

36.106.166.96 - - [08/May/2021:20:27:37 +0800] "GET /69.html HTTP/1.1" 200 8005 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
175.184.167.176 - - [08/May/2021:20:27:37 +0800] "GET /55.html HTTP/1.1" 200 7066 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
110.177.179.170 - - [08/May/2021:20:27:37 +0800] "GET /52.html HTTP/1.1" 200 8451 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
120.85.110.32 - - [08/May/2021:20:27:37 +0800] "GET /49.html HTTP/1.1" 200 11445 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
36.248.89.249 - - [08/May/2021:20:27:37 +0800] "GET /82.html HTTP/1.1" 200 6673 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
113.57.96.9 - - [08/May/2021:20:27:37 +0800] "GET /tags-110.html HTTP/1.1" 200 4224 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
119.39.46.47 - - [08/May/2021:20:27:37 +0800] "GET /46.html HTTP/1.1" 200 9263 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
221.11.20.172 - - [08/May/2021:20:27:37 +0800] "GET /tags-3_2.html HTTP/1.1" 200 7230 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
222.79.49.120 - - [08/May/2021:20:27:37 +0800] "GET /83.html HTTP/1.1" 200 6646 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
171.12.10.2 - - [08/May/2021:20:27:37 +0800] "GET /tags-28.html HTTP/1.1" 200 4182 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"


带着正常浏览器的ua来爬怎么解

频率还老高了、有点烦

追加问题
    0 人参与回答
该问题还没有收到回答 :(
SEO培训招生中
190