ua-tracer by Paul Kinlan

recent traces · ua-tracer

ua-tracer

what does a user agent actually fetch, follow & run?

All recent homepage requests, newest first. This page does not mint a new trace (unlike /), so you can browse the log without adding noise.

Recent homepage requests

Filter by user agent and the matching requests appear right below. Showing requests whose user agent contains SemrushBot.

clear
TimestampUser AgentAssets
2026-09-27 00:13:46.991 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
0
no JS—
2026-09-21 06:53:39.055 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-09-06 13:04:08.432 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-08-30 17:12:57.058 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-08-17 06:41:20.934 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-08-14 03:07:22.184 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-31 18:15:45.017 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-23 20:53:23.686 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-19 07:50:26.075 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-15 14:57:19.494 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-09 00:22:52.242 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-09 00:22:49.151 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
0
no JS—
2026-07-02 21:04:44.681 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-06-27 17:42:49.906 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe

By user agent

Running counts across all 12867 homepage requests (1 distinct agents). Click one to set the filter above.

User AgentRequestsJS ran
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
14 0

Unsolicited / well-known requests

Paths a user agent fetched on its own that ua-tracer never links to: robots.txt, sitemap.xml, /.well-known/*, llms.txt, the root favicon, and similar. Reveals what an agent probes on its own initiative.

Filtered to path /robots.txt to user agent SemrushBot. clear filters

By path

Each unsolicited path with its request count and how many distinct user agents hit it. Click a path to see the individual requests; click a user agent below to reverse-look-up everything that UA did.

PathRequestsDistinct UAs
/robots.txt 35 1

Requests (35 shown)

The Related trace column links a probe to a homepage trace from the same user agent and IP within 30 minutes (the same crawler that fetched a well-known file usually also loaded /). The offset shows how long before/after the probe that trace was minted.

TimestampPathUser Agent (click for reverse lookup)Related trace
2026-09-28 15:48:48.188 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 14:46:58.995 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 13:39:14.253 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 12:21:13.581 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 10:37:08.955 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 09:06:32.145 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 08:03:10.264 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 06:58:41.899 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 05:47:19.360 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 04:43:13.758 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 03:42:49.426 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 02:36:17.793 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 01:08:35.648 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-28 00:04:15.051 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 23:02:58.306 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 22:02:57.219 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 20:58:38.971 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 19:55:50.626 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 18:49:38.018 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 17:43:07.821 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 16:28:48.825 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 14:50:19.899 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 13:37:31.965 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 12:28:42.596 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 11:20:50.822 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 10:03:32.582 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 08:48:07.871 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 07:06:47.904 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 05:36:38.246 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 04:32:43.211 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 02:53:58.189 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 01:33:12.413 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 00:13:46.410 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-27 00:13:44.431 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 23:09:16.676 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —

← back to the live tracer (mints a new trace)