Gateway Loads Log - 05:47:08 5/26/18
Time Host Referer User Agent
02:54:15 68.74.116.17 VenusCrawler/Nutch-1.12 (crawler@mycompany.com)
01:54:59 66.160.140.182 The Knowledge AI
20:37:00 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
21:14:08 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
03:35:53 95.216.19.112 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
01:56:45 17.58.101.236 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) Ap
22:02:03 95.216.11.31 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
12:02:19 46.229.168.71 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
08:17:31 195.146.37.19 Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.
12:53:24 52.86.143.107 MauiBot (crawler.feedback+wc@gmail.com)
19:25:11 23.253.102.136 OutclicksBot/4 +https://www.outclicks.net/agent/dc
21:10:30 66.160.140.182 The Knowledge AI
06:43:05 64.62.252.173 The Knowledge AI
13:01:50 66.160.140.183 The Knowledge AI
17:27:02 64.62.252.169 The Knowledge AI
13:00:09 66.249.69.72 Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww
23:17:45 66.160.140.180 The Knowledge AI
23:09:49 66.160.140.180 The Knowledge AI
23:04:39 66.160.140.180 The Knowledge AI
23:01:13 66.160.140.180 The Knowledge AI
22:59:14 66.160.140.180 The Knowledge AI
03:59:06 65.49.2.180 Mozilla/5.0 (compatible; Go-http-client/1.1; +cent
10:42:17 94.130.237.98 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
04:14:24 66.160.140.183 The Knowledge AI
19:53:02 64.62.252.163 The Knowledge AI
15:58:54 64.62.252.164 The Knowledge AI
13:42:29 166.88.162.90 http://www.baidu.com Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)
06:13:12 34.227.95.252 cis455crawler
19:11:02 66.160.140.183 The Knowledge AI
17:17:02 64.62.252.163 The Knowledge AI
04:27:35 46.229.168.66 Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http:
17:17:48 65.49.2.175 Mozilla/5.0 (compatible; Go-http-client/1.1; +cent
23:59:42 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http:
20:36:57 69.197.177.50 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
03:48:54 64.62.252.163 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
14:52:10 89.38.99.128 Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/5
11:37:13 46.229.168.71 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
10:24:17 64.62.252.163 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
05:56:50 94.23.45.37 http://2.bp.blogspot.com/-Ha5XI2tqaUc/WfdFa_vREfI/AAAAAAAAIEs/H6-MO6Zn Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/5
04:46:19 54.87.92.19 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:44:52 54.157.59.81 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
05:40:35 54.39.17.193 DigitalPebble Crawler/1.8 (StormCrawler Benchmark;
19:27:30 94.130.237.98 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
17:33:08 34.224.1.2 MauiBot (crawler.feedback+wc@gmail.com)
11:44:02 14.139.162.2 Mozilla/5.0 (compatible; MSIE 7.0; Windows 98; Spa
04:45:29 54.205.247.208 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:23:43 54.205.247.208 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:20:55 54.211.246.112 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:13:38 54.205.247.208 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
23:29:33 64.62.252.162 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
04:45:49 54.159.247.106 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:45:22 54.163.123.21 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:29:14 50.16.94.207 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:23:24 54.205.201.126 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:45:26 54.163.175.246 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:23:37 54.166.21.207 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:16:04 54.167.167.102 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:11:16 54.163.150.112 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
03:57:15 54.204.222.161 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
17:01:03 54.210.173.232 MauiBot (crawler.feedback+wc@gmail.com)
12:07:21 64.62.252.164 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
17:52:13 34.207.212.77 MauiBot (crawler.feedback+wc@gmail.com)
17:21:04 34.207.212.77 MauiBot (crawler.feedback+wc@gmail.com)
14:34:57 54.159.3.32 MauiBot (crawler.feedback+wc@gmail.com)
13:37:17 64.62.252.163 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
17:55:53 64.62.252.164 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
17:04:01 54.152.175.127 MauiBot (crawler.feedback+wc@gmail.com)
15:16:59 54.152.175.127 MauiBot (crawler.feedback+wc@gmail.com)
11:59:43 54.167.87.120 MauiBot (crawler.feedback+wc@gmail.com)
05:45:41 64.62.252.162 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
00:52:41 66.249.73.76 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
21:13:39 54.236.41.202 MauiBot (crawler.feedback+wc@gmail.com)
16:54:39 64.62.252.163 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
13:46:05 66.249.73.74 Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww
19:27:45 34.229.66.214 MauiBot (crawler.feedback+wc@gmail.com)
17:11:55 52.201.221.10 MauiBot (crawler.feedback+wc@gmail.com)
16:23:56 64.62.252.164 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
16:01:09 64.62.252.163 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
15:49:04 38.121.93.94 Python-urllib/3.5
13:56:23 64.62.252.169 BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
12:01:58 54.236.17.203 MauiBot (crawler.feedback+wc@gmail.com)
11:34:35 54.236.17.203 MauiBot (crawler.feedback+wc@gmail.com)
10:50:44 54.174.183.254 MauiBot (crawler.feedback+wc@gmail.com)
10:16:31 54.165.59.7 ia_archiver
09:28:34 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http:
07:34:12 46.229.168.75 Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http:
04:47:47 54.211.182.77 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:44:14 54.197.131.3 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:25:17 50.16.47.163 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:03:14 54.205.5.0 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
19:28:16 24.231.152.7 http://www.paperfections.com/paperfections/more-great-blogs-to-brows.h Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_3) Ap
15:33:43 54.84.59.149 MauiBot (crawler.feedback+wc@gmail.com)
15:32:55 54.152.49.161 MauiBot (crawler.feedback+wc@gmail.com)
12:49:40 54.236.43.229 MauiBot (crawler.feedback+wc@gmail.com)
11:17:54 54.236.43.229 MauiBot (crawler.feedback+wc@gmail.com)
04:49:30 54.211.181.189 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:49:09 54.197.76.55 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:35:05 54.211.144.253 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:26:17 54.204.171.233 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207
04:14:38 54.159.183.65 Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/201207