Gateway Loads Log - 12:05:30 8/15/18
Time Host Referer User Agent
07:39:43 216.244.66.227 Mozilla/5.0 (compatible; DotBot/1.1; http://www.op
16:58:41 94.23.214.93 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) Ap
11:50:51 17.58.101.236 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) Ap
00:02:40 54.165.59.7 ia_archiver
16:09:06 66.249.69.104 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
20:43:41 95.216.144.38 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
23:52:09 66.249.75.70 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
10:30:48 93.158.161.164 Mozilla/5.0 (compatible; YandexBot/3.0; +http://ya
10:30:45 5.255.250.185 Mozilla/5.0 (compatible; YandexBot/3.0; +http://ya
14:28:10 66.249.75.72 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
22:02:55 46.229.168.66 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
06:59:26 66.249.75.70 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
04:27:19 138.201.250.239 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
21:55:39 113.78.65.70 http://www.stampingtop50.com/ Opera/9.80 (Windows NT 6.2; Win64; x64) Presto/2.1
03:01:10 113.78.65.70 http://www.stampingtop50.com/ Opera/9.80 (Windows NT 6.2; Win64; x64) Presto/2.1
22:59:04 54.224.216.155 CCBot/2.0 (http://commoncrawl.org/faq/)
14:29:08 138.201.250.239 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
05:52:01 46.229.168.71 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
08:26:00 18.236.73.141 A6-Indexer
17:06:15 17.58.101.236 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) Ap
14:58:59 66.249.75.7 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
11:15:49 188.40.107.254 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
14:54:58 5.255.250.43 Mozilla/5.0 (compatible; YandexBot/3.0; +http://ya
14:54:55 93.158.161.164 Mozilla/5.0 (compatible; YandexBot/3.0; +http://ya
11:55:11 66.249.75.7 Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww
19:47:43 66.249.75.70 Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww
01:44:37 66.160.140.181 The Knowledge AI
09:12:29 188.40.107.254 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
04:35:57 54.202.53.211 A6-Indexer
13:26:47 66.249.65.106 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/
14:30:40 94.130.237.98 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
11:52:59 66.160.140.183 The Knowledge AI
21:32:49 17.58.101.236 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) Ap
16:34:54 66.160.140.180 The Knowledge AI
22:24:33 34.220.134.178 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36
21:04:38 64.62.252.164 The Knowledge AI
16:59:07 52.201.229.103 MauiBot (crawler.feedback+wc@gmail.com)
17:17:00 64.62.252.173 The Knowledge AI
21:57:57 66.160.140.182 The Knowledge AI
17:10:54 52.91.117.107 MauiBot (crawler.feedback+wc@gmail.com)
00:09:33 212.83.163.210 Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/53
05:05:03 216.244.66.227 Mozilla/5.0 (compatible; DotBot/1.1; http://www.op
19:59:42 167.114.1.124 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
17:07:50 17.58.101.236 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) Ap
08:11:58 5.255.250.185 Mozilla/5.0 (compatible; YandexBot/3.0; +http://ya
04:58:19 34.211.175.178 Mozilla/5.0 (Macintosh; PPC Mac OS X 10.8; rv:48.0
05:04:40 64.62.252.169 The Knowledge AI
19:34:48 34.224.1.179 MauiBot (crawler.feedback+wc@gmail.com)
17:53:56 46.229.168.76 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
16:23:31 46.229.168.76 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
16:06:04 64.62.252.163 The Knowledge AI
23:33:04 54.165.59.7 ia_archiver
02:04:13 198.55.113.218 Apache-HttpClient/4.5.3-SNAPSHOT (Java/1.8.0_152)
15:34:15 1.160.39.171 http://paperfections.typepad.com/paperfections/2012/08/justrite-august Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/53
11:32:34 46.229.168.76 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
10:23:20 46.229.168.76 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
23:22:49 64.62.252.173 The Knowledge AI
13:06:14 54.158.175.189 MauiBot (crawler.feedback+wc@gmail.com)
03:45:10 64.62.252.163 The Knowledge AI
16:13:27 54.196.37.101 MauiBot (crawler.feedback+wc@gmail.com)
15:31:37 5.255.250.185 Mozilla/5.0 (compatible; YandexBot/3.0; +http://ya
09:04:09 69.30.213.138 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
21:25:58 66.160.140.183 The Knowledge AI
23:54:54 54.175.53.195 http://www.paperfections.com/paperfections/2018/04/partial-die-cutting Scrapy/1.5.0 (+https://scrapy.org)
21:37:53 64.62.252.164 The Knowledge AI
16:49:10 217.182.194.69 Barkrowler/0.7 (+http://www.exensa.com/crawl)
16:34:26 216.244.66.227 Mozilla/5.0 (compatible; DotBot/1.1; http://www.op
02:54:15 68.74.116.17 VenusCrawler/Nutch-1.12 (crawler@mycompany.com)
01:54:59 66.160.140.182 The Knowledge AI
20:37:00 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
21:14:08 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
03:35:53 95.216.19.112 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
01:56:45 17.58.101.236 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) Ap
22:02:03 95.216.11.31 Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj
12:02:19 46.229.168.71 Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://
08:17:31 195.146.37.19 Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.
12:53:24 52.86.143.107 MauiBot (crawler.feedback+wc@gmail.com)
19:25:11 23.253.102.136 OutclicksBot/4 +https://www.outclicks.net/agent/dc
21:10:30 66.160.140.182 The Knowledge AI
06:43:05 64.62.252.173 The Knowledge AI
13:01:50 66.160.140.183 The Knowledge AI
17:27:02 64.62.252.169 The Knowledge AI
13:00:09 66.249.69.72 Mozilla/5.0 (compatible; Googlebot/2.1; +http://ww
23:17:45 66.160.140.180 The Knowledge AI
23:09:49 66.160.140.180 The Knowledge AI
23:04:39 66.160.140.180 The Knowledge AI
23:01:13 66.160.140.180 The Knowledge AI
22:59:14 66.160.140.180 The Knowledge AI
03:59:06 65.49.2.180 Mozilla/5.0 (compatible; Go-http-client/1.1; +cent
10:42:17 94.130.237.98 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webm
04:14:24 66.160.140.183 The Knowledge AI
19:53:02 64.62.252.163 The Knowledge AI
15:58:54 64.62.252.164 The Knowledge AI
13:42:29 166.88.162.90 http://www.baidu.com Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)
06:13:12 34.227.95.252 cis455crawler
19:11:02 66.160.140.183 The Knowledge AI
17:17:02 64.62.252.163 The Knowledge AI
04:27:35 46.229.168.66 Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http:
17:17:48 65.49.2.175 Mozilla/5.0 (compatible; Go-http-client/1.1; +cent
23:59:42 46.229.168.73 Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http: