今天 WebServer 出了点问题,重装了服务,这才不到 10 分钟,这日志。。。
日志大概有几千条 目前,谁能明确的说一下这到底是什么东西?为什么会一直在请求一个不存在的页面?
我搜索到的资料 https://user-agents.net/string/go-http-client-1-1
说是爬虫,但是是哪里的爬虫啊?这也太频繁了!
114.80.59.141 - - [11/Mar/2019:17:57:54 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.6.231.157 - - [11/Mar/2019:17:57:55 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
150.138.99.200 - - [11/Mar/2019:17:57:55 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
125.94.49.149 - - [11/Mar/2019:17:57:56 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.110.205.228 - - [11/Mar/2019:17:57:57 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
114.80.59.206 - - [11/Mar/2019:17:57:58 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
111.126.120.154 - - [11/Mar/2019:17:57:58 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.16.206.28 - - [11/Mar/2019:17:57:59 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
61.147.223.32 - - [11/Mar/2019:17:58:00 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.97.5.45 - - [11/Mar/2019:17:58:00 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
49.79.239.158 - - [11/Mar/2019:17:58:00 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.163.190.30 - - [11/Mar/2019:17:58:01 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
117.21.189.27 - - [11/Mar/2019:17:58:02 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
144.123.31.160 - - [11/Mar/2019:17:58:02 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
117.91.177.208 - - [11/Mar/2019:17:58:02 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
47.108.35.154 - - [11/Mar/2019:17:58:03 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
14.29.40.155 - - [11/Mar/2019:17:58:03 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
49.7.41.135 - - [11/Mar/2019:17:58:03 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.97.245.152 - - [11/Mar/2019:17:58:03 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
175.6.249.24 - - [11/Mar/2019:17:58:05 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
124.238.245.30 - - [11/Mar/2019:17:58:05 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
175.6.10.149 - - [11/Mar/2019:17:58:05 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
220.170.91.76 - - [11/Mar/2019:17:58:06 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
60.160.146.201 - - [11/Mar/2019:17:58:06 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.110.143.23 - - [11/Mar/2019:17:58:07 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
139.196.128.190 - - [11/Mar/2019:17:58:07 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
27.159.68.206 - - [11/Mar/2019:17:58:07 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
49.79.237.22 - - [11/Mar/2019:17:58:07 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.57.82.152 - - [11/Mar/2019:17:58:07 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.96.109.162 - - [11/Mar/2019:17:58:08 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.103.250.206 - - [11/Mar/2019:17:58:08 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
175.6.42.72 - - [11/Mar/2019:17:58:09 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.163.159.65 - - [11/Mar/2019:17:58:09 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
175.6.241.68 - - [11/Mar/2019:17:58:09 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.163.191.85 - - [11/Mar/2019:17:58:10 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.96.63.165 - - [11/Mar/2019:17:58:10 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
175.6.10.21 - - [11/Mar/2019:17:58:10 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.99.227.38 - - [11/Mar/2019:17:58:11 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.110.205.76 - - [11/Mar/2019:17:58:13 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
150.138.98.25 - - [11/Mar/2019:17:58:14 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
61.184.215.34 - - [11/Mar/2019:17:58:14 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
122.225.67.159 - - [11/Mar/2019:17:58:15 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.163.190.234 - - [11/Mar/2019:17:58:15 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.110.143.99 - - [11/Mar/2019:17:58:16 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
111.6.126.38 - - [11/Mar/2019:17:58:16 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.61.181.209 - - [11/Mar/2019:17:58:16 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
58.51.149.25 - - [11/Mar/2019:17:58:16 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
14.152.46.25 - - [11/Mar/2019:17:58:16 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
61.160.204.157 - - [11/Mar/2019:17:58:17 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
116.8.119.165 - - [11/Mar/2019:17:58:18 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
118.112.14.201 - - [11/Mar/2019:17:58:18 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
114.80.174.10 - - [11/Mar/2019:17:58:19 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
116.211.153.153 - - [11/Mar/2019:17:58:20 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
219.144.99.22 - - [11/Mar/2019:17:58:20 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
114.80.187.154 - - [11/Mar/2019:17:58:21 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
103.15.97.49 - - [11/Mar/2019:17:58:21 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
59.63.240.176 - - [11/Mar/2019:17:58:22 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
27.159.71.185 - - [11/Mar/2019:17:58:22 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
115.231.228.159 - - [11/Mar/2019:17:58:23 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
150.138.180.72 - - [11/Mar/2019:17:58:23 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
140.249.38.29 - - [11/Mar/2019:17:58:24 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
39.96.135.231 - - [11/Mar/2019:17:58:26 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.61.180.157 - - [11/Mar/2019:17:58:26 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
59.63.231.38 - - [11/Mar/2019:17:58:27 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
150.138.144.154 - - [11/Mar/2019:17:58:28 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
61.131.39.39 - - [11/Mar/2019:17:58:28 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
221.236.10.151 - - [11/Mar/2019:17:58:28 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
47.102.180.99 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
58.58.80.157 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
58.49.238.165 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.99.228.39 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
117.91.179.214 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
124.239.159.167 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
221.229.206.27 - - [11/Mar/2019:17:58:29 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
116.31.73.69 - - [11/Mar/2019:17:58:30 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
1.180.204.66 - - [11/Mar/2019:17:58:32 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
110.185.124.206 - - [11/Mar/2019:17:58:32 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.104.137.73 - - [11/Mar/2019:17:58:32 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
101.227.209.207 - - [11/Mar/2019:17:58:32 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
49.7.22.78 - - [11/Mar/2019:17:58:33 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
150.138.179.155 - - [11/Mar/2019:17:58:33 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.96.58.163 - - [11/Mar/2019:17:58:34 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
180.97.5.3 - - [11/Mar/2019:17:58:34 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.131.227.13 - - [11/Mar/2019:17:58:35 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
116.211.183.34 - - [11/Mar/2019:17:58:35 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
117.27.140.212 - - [11/Mar/2019:17:58:35 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.60.159.31 - - [11/Mar/2019:17:58:36 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
47.102.180.159 - - [11/Mar/2019:17:58:37 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
58.215.145.31 - - [11/Mar/2019:17:58:38 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.136.179.92 - - [11/Mar/2019:17:58:38 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
36.104.139.27 - - [11/Mar/2019:17:58:38 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
114.80.179.21 - - [11/Mar/2019:17:58:39 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
119.84.134.35 - - [11/Mar/2019:17:58:39 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
218.94.210.149 - - [11/Mar/2019:17:58:39 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
14.215.23.156 - - [11/Mar/2019:17:58:40 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
121.63.141.26 - - [11/Mar/2019:17:58:40 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
116.207.113.165 - - [11/Mar/2019:17:58:41 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
219.147.75.157 - - [11/Mar/2019:17:58:41 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
219.147.83.215 - - [11/Mar/2019:17:58:41 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
123.53.182.33 - - [11/Mar/2019:17:58:41 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
182.242.47.29 - - [11/Mar/2019:17:58:41 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.96.181.161 - - [11/Mar/2019:17:58:41 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
222.222.88.166 - - [11/Mar/2019:17:58:42 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
119.84.72.150 - - [11/Mar/2019:17:58:42 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
117.25.139.141 - - [11/Mar/2019:17:58:42 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
122.228.95.168 - - [11/Mar/2019:17:58:44 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
49.7.24.176 - - [11/Mar/2019:17:58:44 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
106.15.218.149 - - [11/Mar/2019:17:58:44 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
175.6.249.156 - - [11/Mar/2019:17:58:44 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
121.207.229.160 - - [11/Mar/2019:17:58:44 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
1.193.218.22 - - [11/Mar/2019:17:58:44 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
116.253.191.162 - - [11/Mar/2019:17:58:45 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
219.144.98.40 - - [11/Mar/2019:17:58:45 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.107.239.24 - - [11/Mar/2019:17:58:45 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
111.6.126.39 - - [11/Mar/2019:17:58:45 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
119.84.52.48 - - [11/Mar/2019:17:58:46 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
113.137.55.167 - - [11/Mar/2019:17:58:47 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
110.185.121.165 - - [11/Mar/2019:17:58:47 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
114.80.59.178 - - [11/Mar/2019:17:58:47 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
218.92.0.38 - - [11/Mar/2019:17:58:48 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
183.61.14.37 - - [11/Mar/2019:17:58:48 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
150.138.99.217 - - [11/Mar/2019:17:58:48 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
223.221.181.166 - - [11/Mar/2019:17:58:49 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
103.15.97.52 - - [11/Mar/2019:17:58:50 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
118.112.15.71 - - [11/Mar/2019:17:58:50 +0800] "GET /test.html HTTP/1.1" 404 13833 "-" "Go-http-client/1.1"
1
ysc3839 2019-03-11 19:58:47 +08:00 via Android 1
1. “谁能明确的说一下这到底是什么东西?”
这是客户端在请求你的服务器。 2. “为什么会一直在请求一个不存在的页面?” 因为客户端想这么请求。 3. “说是爬虫,但是是哪里的爬虫啊?” 你的日志里有写 IP 地址,就是那里的爬虫。 |
2
anguiao 2019-03-11 19:59:34 +08:00 1
CC 攻击?
|
3
tumbzzc 2019-03-11 19:59:53 +08:00 via Android 1
直接屏蔽这个 ua
|
4
AlisaDestiny 2019-03-11 20:14:51 +08:00 1
可能是用 golang 写的爬虫吧。
但是不要太在意 UA,这玩意人家想写什么就写什么。 |
5
hundan 2019-03-11 20:43:57 +08:00 via Android 3
研究过 是阿里云的全站加速 为了确定最优线路用的
|
7
xfspace 2019-03-11 22:31:36 +08:00 via Android 1
随手 shodan 几个 IP
SSL 签的是 CN=*.alicdn.com CDN 回源? |
8
hundan 2019-03-12 01:17:12 +08:00 via Android 1
@Steps 其实就是 cdn 啦 不过就是全站 cdn 针对整个网站是动态的那种的 倒也不是必须这么测试 我记得好像有个设置 意思大概是说是否采用自研算法自动优化线路什么优化边缘计算什么的 这个选项取消掉就行了 具体的记不清了 我明天上电脑看下再回复你
|
9
hundan 2019-03-12 08:37:20 +08:00 1
在全站加速里面,把这个关了就好了
|
11
zhuzhiqiang 2019-03-12 09:23:04 +08:00
@Steps 我确实是有开这个服务 终于搞清楚了 [捂脸]
|
12
Steps OP @zhuzhiqiang #11 我已经关闭了动态加速,但是还是有请求,我观望一下看看 24 小时候是否还会有这个
|
13
zhuzhiqiang 2019-03-12 10:12:27 +08:00
@Steps 姐姐 我微信 enpxNTE3(base64) 可以的话 能否加个好友
|
14
fengerzh 2019-03-14 06:58:32 +08:00
我今天也遇到这问题了,简直就是恶意攻击啊。我把动态加速关了,但现在还在一直访问,只能观察一天看看情况。
|
15
Steps OP |
16
WanJiJun 2019-04-03 17:34:07 +08:00
@hundan 非常感谢,我也是大约一个月前开始出现这个问题,拦截 UA,一月有几十万次,很大的影响了服务器。
删了动态 CDN 加速,完美解决。 |
18
DuXing 2021-01-25 17:07:23 +08:00
我也遇到了带有此 UA 的日志,不过 IP 来自日本某数据中心。我并没有使用 ali 的什么服务。
有点像是扫漏洞的感觉…… |