搜外网>搜外问答>问答页面

部分真蜘蛛返回404

如题。2月新站,访问网站首页的真实蜘蛛(9月1日)有70来条,其中有十几条返回404,服务器正常,没有宕机,百思不得其解。求达人帮忙分析一下。

2021-09-01 01:17:05 GET / - 80 - 116.179.32.35 Mozilla... - 200 0 0 359
2021-09-01 01:17:05 GET / - 80 - 220.181.108.142 Mozilla... - 200 0 0 359
2021-09-01 01:21:57 GET / - 80 - 220.181.108.187 Mozilla... - 200 0 0 515
2021-09-01 01:21:57 GET / - 80 - 220.181.108.146 Mozilla... - 200 0 0 562
2021-09-01 01:23:18 GET / - 80 - 220.181.108.99 Mozilla... - 200 0 0 468
2021-09-01 01:26:00 GET / - 80 - 220.181.108.105 Mozilla... - 200 0 0 468
2021-09-01 01:33:35 GET / - 80 - 220.181.108.178 Mozilla... - 404 ??????????????? 0 0 109
2021-09-01 01:48:29 GET / - 80 - 116.179.32.88 Mozilla... - 200 0 0 500
2021-09-01 02:32:28 GET / - 80 - 220.181.108.183 Mozilla... - 200 0 0 515
2021-09-01 02:49:58 GET / - 80 - 220.181.108.182 Mozilla... - 200 0 0 218
2021-09-01 03:11:35 GET / - 80 - 220.181.108.90 Mozilla... - 404 ??????????????? 0 0 109
2021-09-01 03:22:19 GET / - 80 - 220.181.108.153 Mozilla... - 200 0 0 1156
2021-09-01 03:50:06 GET / - 80 - 116.179.32.75 Mozilla... - 200 0 0 1359
2021-09-01 04:09:58 GET / - 80 - 220.181.108.153 Mozilla... - 200 0 0 1171
2021-09-01 04:13:57 GET / - 80 - 116.179.32.172 Mozilla... - 200 0 0 1203
2021-09-01 04:30:03 GET / - 80 - 220.181.108.100 Mozilla... - 200 0 0 1656
2021-09-01 06:11:41 GET / - 80 - 220.181.108.76 Mozilla... - 404 ??????????????? 0 0 78
2021-09-01 06:11:43 GET / - 80 - 116.179.32.51 Mozilla... - 404 ??????????????? 0 0 78
2021-09-01 06:11:49 GET / - 80 - 116.179.32.136 Mozilla... - 404 ??????????????? 0 0 77
2021-09-01 06:11:58 GET / - 80 - 116.179.32.199 Mozilla... - 404 ??????????????? 0 0 93
2021-09-01 07:58:23 GET / - 80 - 220.181.108.172 Mozilla... - 200 0 0 234
2021-09-01 08:44:26 GET / - 80 - 220.181.108.116 Mozilla... - 200 0 0 1187
2021-09-01 09:14:35 GET / - 80 - 220.181.108.153 Mozilla... - 200 0 0 234
2021-09-01 09:15:30 GET / - 80 - 116.179.32.241 Mozilla... - 200 0 0 1140
2021-09-01 09:29:30 GET / - 80 - 116.179.32.29 Mozilla... - 200 0 0 1124
2021-09-01 09:53:28 GET / - 80 - 220.181.108.182 Mozilla... - 200 0 0 1203
2021-09-01 10:07:42 GET / - 80 - 42.194.242.213 Mozilla... - 200 0 0 1078
2021-09-01 10:33:36 GET / - 80 - 220.181.108.153 Mozilla... - 200 0 0 1166
2021-09-01 10:48:54 GET / - 80 - 220.181.108.173 Mozilla... - 404 ??????????????? 0 0 125
2021-09-01 10:48:54 GET / - 80 - 220.181.108.155 Mozilla... - 404 ??????????????? 0 0 109
2021-09-01 10:48:54 GET / - 80 - 220.181.108.166 Mozilla... - 404 ??????????????? 0 0 171
2021-09-01 10:48:54 GET / - 80 - 220.181.108.91 Mozilla... - 404 ??????????????? 0 0 171
2021-09-01 11:03:28 GET / - 80 - 220.181.108.155 Mozilla... - 404 ??????????????? 0 0 93
2021-09-01 11:11:14 GET / - 80 - 220.181.108.118 Mozilla... - 404 ??????????????? 0 0 93
2021-09-01 11:57:54 GET / - 80 - 116.179.32.235 Mozilla... - 404 ??????????????? 0 0 93
2021-09-01 12:44:24 GET / - 80 - 220.181.108.165 Mozilla... - 200 0 0 1500
2021-09-01 12:44:46 GET / - 80 - 220.181.108.154 Mozilla... - 200 0 0 1093
2021-09-01 12:45:29 GET / - 80 - 116.179.32.170 Mozilla... - 200 0 0 1046
2021-09-01 13:52:47 GET / - 80 - 220.181.108.142 Mozilla... - 200 0 0 1140
2021-09-01 14:01:10 GET / - 80 - 116.179.32.137 Mozilla... - 200 0 0 1171
2021-09-01 14:37:56 GET / - 80 - 220.181.108.119 Mozilla... - 200 0 0 1199
2021-09-01 14:47:53 GET / - 80 - 116.179.32.229 Mozilla... - 200 0 0 1124
2021-09-01 15:06:25 GET / - 80 - 220.181.108.161 Mozilla... - 200 0 0 1078
2021-09-01 15:20:53 GET / - 80 - 220.181.108.161 Mozilla... - 200 0 0 1062
2021-09-01 15:36:31 GET / - 80 - 220.181.108.93 Mozilla... - 200 0 0 1156
2021-09-01 15:49:56 GET / - 80 - 116.179.32.167 Mozilla... - 200 0 0 1296
2021-09-01 15:57:58 GET / - 80 - 220.181.108.184 Mozilla... - 200 0 0 1374
2021-09-01 16:47:07 GET / - 80 - 220.181.108.176 Mozilla... - 200 0 0 1109
2021-09-01 16:51:30 GET / - 80 - 220.181.108.92 Mozilla... - 200 0 0 1093
2021-09-01 17:09:27 GET / - 80 - 116.179.32.167 Mozilla... - 200 0 0 1203
2021-09-01 17:34:34 GET / - 80 - 116.179.32.32 Mozilla... - 200 0 0 1171
2021-09-01 18:02:42 GET / - 80 - 116.179.32.17 Mozilla... - 200 0 0 1312
2021-09-01 18:14:16 GET / - 80 - 116.179.32.16 Mozilla... - 200 0 0 1109
2021-09-01 18:34:03 GET / - 80 - 220.181.108.81 Mozilla... - 200 0 0 1328
2021-09-01 19:10:41 GET / - 80 - 116.179.32.148 Mozilla... - 200 0 0 1155
2021-09-01 19:33:11 GET / - 80 - 220.181.108.96 Mozilla... - 404 ??????????????? 0 0 250
2021-09-01 19:33:18 GET / - 80 - 116.179.32.172 Mozilla... - 200 0 0 1234
2021-09-01 19:40:45 GET / - 80 - 220.181.108.185 Mozilla... - 404 ??????????????? 0 0 93
2021-09-01 19:45:55 GET / - 80 - 116.179.32.81 Mozilla... - 404 ??????????????? 0 0 93
2021-09-01 19:46:32 GET / - 80 - 220.181.108.114 Mozilla... - 200 0 0 1156
2021-09-01 20:14:09 GET / - 80 - 220.181.108.106 Mozilla... - 200 0 0 1125
2021-09-01 20:16:28 GET / - 80 - 116.179.32.109 Mozilla... - 200 0 0 1140
2021-09-01 20:26:43 GET / - 80 - 116.179.32.132 Mozilla... - 404 ??????????????? 0 0 109
2021-09-01 20:41:02 GET / - 80 - 220.181.108.179 Mozilla... - 200 0 0 234
2021-09-01 22:25:27 GET / - 80 - 116.179.32.150 Mozilla... - 200 0 0 328
2021-09-01 22:33:21 GET / - 80 - 116.179.32.79 Mozilla... - 200 0 0 1172
2021-09-01 23:01:14 GET / - 80 - 116.179.32.138 Mozilla... - 200 0 0 1171
2021-09-01 23:14:27 GET / - 80 - 116.179.32.238 Mozilla... - 200 0 0 1234

追加问题
    3 人参与回答
我的微信:sec_vip 等 1 人赞同该回答

你去诊断一下看是否真死链,设立死链文件提交就好了

推推蛙
推推蛙 · 擅长SEOSEM爱采购诊断、方案编写、优化运维。微信:tuituiwaseo
我的微信:sec_vip 等 1 人赞同该回答

1、真蜘蛛返回码404,那么百度站长里面是否有抓取异常,如果真的有,那么就需要再次抓取诊断下,看看是否异常;
2、如果抓取异常里面显示正常,你的哪些页面抓取诊断也正常,那么无需担忧,不会有影响。

我的微信:sec_vip 等 1 人赞同该回答

我连真假蜘蛛都分不清