Systematically browses the World Wide Web to collect information (seen in the last 30 days)

882 ASNs and 14,060 IP Addresses tagged with crawler.


AS16509	Amazon.com, Inc.	#160	2,590	13.59.118.14
AS714	Apple Inc.	#948	1,256	17.241.227.92
AS16276	OVH SAS	#346	1,129	5.39.1.234
AS14618	Amazon.com, Inc.	#742	711	34.226.89.140
AS13238	YANDEX LLC	#6,435	649	87.250.224.208
AS32934	Facebook, Inc.	#544	609	173.252.107.4
AS15169	Google LLC	#135	569	64.233.172.101
AS136907	HUAWEI CLOUDS	#1,388	532	114.119.141.178
AS4134	CHINANET BACKBONE	#6	467	111.225.149.217
AS4837	CHINA UNICOM China169 Backbone	#25	465	110.249.201.30
AS24940	Hetzner Online GmbH	#415	401	144.76.22.213
AS396982	Google LLC	#1,971	311	34.96.62.5
AS8075	Microsoft Corporation	#232	275	74.7.228.35
AS51747	Internet Vikings International AB	#21,872	221	192.121.157.22
AS140577	Ahrefs Pte Ltd	#30,237	198	168.100.149.135
AS45899	VNPT Corp	#38	194	103.131.71.239
AS210743	Babbar SAS	—	189	217.113.194.13
AS13335	Cloudflare, Inc.	#57	121	172.68.174.113
AS36040	Google LLC	#27,187	66	136.22.149.13
AS55836	Reliance Jio Infocomm Limited	#1	62	49.44.84.133
AS5089	Virgin Media Limited	#97	61	62.252.232.7
AS701	Verizon Business	#74	58	65.196.86.11
AS5410	Bouygues Telecom SA	#98	56	213.44.22.73
AS6805	Telefonica Germany GmbH & Co.OHG	#66	47	78.54.125.200
AS7941	Internet Archive	#28,071	44	207.241.232.170