User-Agent Generator / Bot · Crawler Directory / SEO

SEO Bot · Crawler User-Agents

The representative User-Agents that bots and crawlers in the SEO category use in their actual requests.

AhrefsBotMozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
SemrushBotMozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)

Bot User-Agents can change over time and can also be forged. Don't judge access control by the UA string alone — combine it with reverse DNS lookups or verification against official IP ranges.