recent traces · ua-tracer

Recent homepage requests

Filter by user agent and the matching requests appear right below. Showing requests whose user agent contains Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html).

By user agent

Running counts across all 28211 homepage requests (1 distinct agents). Click one to set the filter above.

Unsolicited / well-known requests

Paths a user agent fetched on its own that ua-tracer never links to: robots.txt, sitemap.xml, /.well-known/*, llms.txt, the root favicon, and similar. Reveals what an agent probes on its own initiative.

Filtered to path /robots.txt to user agent Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html). clear filters

By path

Each unsolicited path with its request count and how many distinct user agents hit it. Click a path to see the individual requests; click a user agent below to reverse-look-up everything that UA did.

Requests (70 shown)

The Related trace column links a probe to a homepage trace from the same user agent and IP within 30 minutes (the same crawler that fetched a well-known file usually also loaded /). The offset shows how long before/after the probe that trace was minted.

← back to the live tracer (mints a new trace)