Systematically browses the World Wide Web to collect information (seen in the last 30 days)

882 ASNs and 14,175 IP Addresses tagged with crawler.


AS16509	Amazon.com, Inc.	#160	2,670	3.19.77.247
AS714	Apple Inc.	#948	1,290	17.241.75.249
AS16276	OVH SAS	#346	1,070	51.195.183.48
AS14618	Amazon.com, Inc.	#743	721	3.219.80.71
AS13238	YANDEX LLC	#6,458	649	213.180.203.244
AS32934	Facebook, Inc.	#545	628	173.252.70.32
AS15169	Google LLC	#137	571	66.249.69.12
AS136907	HUAWEI CLOUDS	#1,391	512	114.119.155.111
AS4837	CHINA UNICOM China169 Backbone	#25	480	110.249.201.150
AS4134	CHINANET BACKBONE	#6	458	58.48.162.196
AS24940	Hetzner Online GmbH	#414	414	144.76.22.195
AS396982	Google LLC	#1,972	309	34.121.183.213
AS8075	Microsoft Corporation	#234	279	74.7.175.184
AS51747	Internet Vikings International AB	#21,880	236	5.133.213.206
AS210743	Babbar SAS	—	200	217.113.196.26
AS45899	VNPT Corp	#36	194	103.131.71.206
AS140577	Ahrefs Pte Ltd	#30,243	194	168.100.149.104
AS13335	Cloudflare, Inc.	#58	119	172.71.254.54
AS36040	Google LLC	#27,327	68	136.22.142.11
AS5089	Virgin Media Limited	#97	62	62.253.3.69
AS701	Verizon Business	#75	61	65.206.58.71
AS55836	Reliance Jio Infocomm Limited	#1	59	157.50.164.5
AS5410	Bouygues Telecom SA	#98	53	213.44.19.198
AS6805	Telefonica Germany GmbH & Co.OHG	#67	48	78.51.235.82
AS7941	Internet Archive	#28,326	45	207.241.232.217