Systematically browses the World Wide Web to collect information (seen in the last 30 days)

877 ASNs and 14,285 IP Addresses tagged with crawler.


AS16509	Amazon.com, Inc.	#158	2,645	3.138.102.88
AS16276	OVH SAS	#352	1,216	51.161.37.85
AS714	Apple Inc.	#952	1,215	17.241.219.15
AS14618	Amazon.com, Inc.	#745	694	54.172.190.201
AS13238	YANDEX LLC	#6,353	649	5.255.231.107
AS32934	Facebook, Inc.	#541	612	173.252.70.36
AS136907	HUAWEI CLOUDS	#1,374	593	114.119.145.225
AS15169	Google LLC	#138	565	66.249.69.104
AS4134	CHINANET BACKBONE	#5	468	111.225.148.16
AS4837	CHINA UNICOM China169 Backbone	#25	453	110.249.201.77
AS24940	Hetzner Online GmbH	#416	405	65.108.103.115
AS396982	Google LLC	#1,853	320	34.59.235.36
AS8075	Microsoft Corporation	#236	286	172.203.190.136
AS51747	Internet Vikings International AB	#21,466	254	5.133.208.136
AS140577	Ahrefs Pte Ltd	#30,291	205	168.100.149.202
AS45899	VNPT Corp	#38	193	103.131.71.33
AS210743	Babbar SAS	—	181	217.113.196.226
AS13335	Cloudflare, Inc.	#57	120	104.28.163.234
AS36040	Google LLC	#27,149	71	136.22.147.5
AS5089	Virgin Media Limited	#97	65	62.252.232.5
AS55836	Reliance Jio Infocomm Limited	#1	62	49.47.70.122
AS5410	Bouygues Telecom SA	#100	61	213.44.17.73
AS701	Verizon Business	#74	58	65.206.58.72
AS7941	Internet Archive	#27,735	49	207.241.231.197
AS6805	Telefonica Germany GmbH & Co.OHG	#64	45	78.51.65.86