Crawler Verify
Confirm whether crawler traffic is verified, known but unverified, or missing crawler evidence.
What this checks
- The entered IPv4 or IPv6 address.
- Optional User-Agent text for crawler-family context.
- Verification status, method, family, hostname, range, and explanation fields returned by the first-party endpoint.
How to interpret results
- Verified means the IP and returned method matched known crawler verification evidence.
- Known unverified means crawler context may exist but was not confirmed enough to trust automatically.
- Unknown or unavailable results should be checked with reverse DNS, DNS lookup, and server logs.
Common issues
- Crawler verification depends on fresh DNS and range data.
- Spoofed User-Agent strings can look convincing even when the IP is unrelated.
Privacy note
Crawler Verify sends the entered IP address and optional User-Agent to the site's first-party verification proxy. The browser never receives upstream credentials.
Key Tools and References
Frequently Asked Questions
What does crawler verification return?
It returns a verification status, crawler family, method, hostname or range fields when available, and an explanation from the first-party verification endpoint.
Should I trust User-Agent text alone?
No. User-Agent strings are easy to spoof. Use IP, reverse/forward DNS, range, and status details together.