ua-tracer by Paul Kinlan

recent traces · ua-tracer

ua-tracer

what does a user agent actually fetch, follow & run?

All recent homepage requests, newest first. This page does not mint a new trace (unlike /), so you can browse the log without adding noise.

Recent homepage requests

Filter by user agent and the matching requests appear right below. Showing requests whose user agent contains SemrushBot.

clear
TimestampUser AgentAssets
2026-08-14 03:07:22.184 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
0
no JS
2026-07-31 18:15:45.017 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-23 20:53:23.686 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-19 07:50:26.075 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-15 14:57:19.494 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-09 00:22:52.242 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-07-09 00:22:49.151 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
0
no JS
2026-07-02 21:04:44.681 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe
2026-06-27 17:42:49.906 UTC
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
1
no JSiframe

By user agent

Running counts across all 7481 homepage requests (1 distinct agents). Click one to set the filter above.

User AgentRequestsJS ran
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
9 0

Unsolicited / well-known requests

Paths a user agent fetched on its own that ua-tracer never links to: robots.txt, sitemap.xml, /.well-known/*, llms.txt, the root favicon, and similar. Reveals what an agent probes on its own initiative.

Filtered to user agent SemrushBot. clear filters

By path

Each unsolicited path with its request count and how many distinct user agents hit it. Click a path to see the individual requests; click a user agent below to reverse-look-up everything that UA did.

PathRequestsDistinct UAs
/robots.txt 40 1

Requests (40 shown)

The Related trace column links a probe to a homepage trace from the same user agent and IP within 30 minutes (the same crawler that fetched a well-known file usually also loaded /). The offset shows how long before/after the probe that trace was minted.

TimestampPathUser Agent (click for reverse lookup)Related trace
2026-08-14 04:14:07.686 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-14 03:07:21.714 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-14 00:03:26.286 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 19:51:38.390 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 18:26:36.870 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 16:44:26.391 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 15:28:47.959 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 14:25:26.302 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 13:04:35.903 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 11:59:57.109 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 10:16:43.087 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 09:14:57.465 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 07:54:10.034 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 06:27:30.443 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 05:14:20.751 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 04:14:04.551 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 02:43:11.289 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 01:38:11.272 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-13 00:30:51.835 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 23:11:31.035 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 21:51:28.206 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 20:48:50.200 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 19:40:03.310 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 18:38:21.495 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 17:34:19.998 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 16:33:40.359 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 15:17:46.834 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 14:12:03.552 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 13:09:56.179 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 12:09:39.450 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 11:00:29.752 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 09:50:44.542 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 08:35:05.998 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 07:32:45.830 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 06:27:48.151 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 05:23:39.753 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 04:16:24.481 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 03:10:23.696 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 01:51:40.219 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
2026-08-12 00:42:04.784 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)

← back to the live tracer (mints a new trace)