ua-tracer by Paul Kinlan

recent traces · ua-tracer

ua-tracer

what does a user agent actually fetch, follow & run?

All recent homepage requests, newest first. This page does not mint a new trace (unlike /), so you can browse the log without adding noise.

Recent homepage requests

Filter by user agent and the matching requests appear right below.

TimestampUser AgentAssets
2026-09-24 22:34:14.378 UTC
(no user-agent)
 0
no JS—
2026-09-24 22:04:14.100 UTC
(no user-agent)
 0
no JS—
2026-09-24 21:52:32.913 UTC
ClaudeBot/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
 11
no JS✓ ClaudeBotCSSJSmoduleimgfontfaviconapple-iconmanifestpreloadprefetchiframe
2026-09-24 21:47:55.567 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-09-24 21:34:15.692 UTC
(no user-agent)
 0
no JS—
2026-09-24 21:04:15.135 UTC
(no user-agent)
 0
no JS—
2026-09-24 20:34:14.249 UTC
(no user-agent)
 0
no JS—
2026-09-24 20:04:16.018 UTC
(no user-agent)
 0
no JS—
2026-09-24 19:52:42.381 UTC
Chrome/50.0.2661.102
User-Agent:Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36
 0
no JS—
2026-09-24 19:40:17.431 UTC
Chrome/147.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/147.0.0.0 Safari/537.36
 0
no JS—
2026-09-24 19:34:14.297 UTC
(no user-agent)
 0
no JS—
2026-09-24 19:04:13.868 UTC
(no user-agent)
 0
no JS—
2026-09-24 18:34:13.563 UTC
(no user-agent)
 0
no JS—
2026-09-24 18:04:14.722 UTC
(no user-agent)
 0
no JS—
2026-09-24 17:46:36.232 UTC
GoogleOther
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GoogleOther) Chrome/153.0.8010.52 Safari/537.36
 6
no JSCSSJSmoduleprefetchiframe@import
2026-09-24 17:42:30.870 UTC
Chrome/120.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 1
no JSfavicon
2026-09-24 17:34:13.802 UTC
(no user-agent)
 0
no JS—
2026-09-24 17:04:13.923 UTC
(no user-agent)
 0
no JS—
2026-09-24 16:38:20.047 UTC
SeznamBot/4.0
Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/)
 0
no JS—
2026-09-24 16:34:14.274 UTC
(no user-agent)
 0
no JS—
2026-09-24 16:15:29.274 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-09-24 16:04:14.494 UTC
(no user-agent)
 0
no JS—
2026-09-24 15:47:58.858 UTC
Googlebot/2.1
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.52 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
 12
no JS✓ GooglebotCSSJSmoduleprefetchiframe@import
2026-09-24 15:45:59.450 UTC
Firefox/123
Mozilla/5.0 (Android 14; Mobile; rv:123.0) Gecko/123.0 Firefox/123
 0
no JS—
2026-09-24 15:34:14.683 UTC
(no user-agent)
 0
no JS—
2026-09-24 15:32:23.541 UTC
r/1
Hello from Palo Alto Networks, find out more about our scans in https://docs-cortex.paloaltonetworks.com/r/1/Cortex-Xpanse/Scanning-activity
 0
no JS—
2026-09-24 15:04:14.022 UTC
(no user-agent)
 0
no JS—
2026-09-24 14:58:45.702 UTC
Chrome/124.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
 0
no JS—
2026-09-24 14:42:32.015 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-09-24 14:34:14.288 UTC
(no user-agent)
 0
no JS—
2026-09-24 14:04:13.901 UTC
(no user-agent)
 0
no JS—
2026-09-24 14:02:18.960 UTC
Chrome/146.0.7680.178
Mozilla/5.0 (Linux; Android 11; V2164A Build/RP1A.200720.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/146.0.7680.178 Mobile Safari/537.36 VivoBrowser/31.0.0.1
 0
no JS—
2026-09-24 13:46:02.286 UTC
MobileSafari/600.1.4
MobileSafari/600.1.4 CFNetwork/711.1.12 Darwin/14.0.0
 0
no JS—
2026-09-24 13:41:24.712 UTC
meta-webindexer/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/145.0.0.0 Safari/537.36 (compatible; meta-webindexer/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler))
 0
no JS—
2026-09-24 13:35:11.282 UTC
Chrome/155.0.0.0
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/155.0.0.0 Mobile Safari/537.36
 20
JS ranCSSJSmoduleimgfontcss-bgcss-fontfaviconapple-iconmanifestpreloadprefetchiframe-img@importCSP reportreport-api
2026-09-24 13:34:14.304 UTC
(no user-agent)
 0
no JS—
2026-09-24 13:04:14.754 UTC
(no user-agent)
 0
no JS—
2026-09-24 12:34:14.606 UTC
(no user-agent)
 0
no JS—
2026-09-24 12:05:47.123 UTC
Chrome/125.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36
 0
no JS—
2026-09-24 12:04:14.648 UTC
(no user-agent)
 0
no JS—
2026-09-24 11:34:13.902 UTC
(no user-agent)
 0
no JS—
2026-09-24 11:13:12.087 UTC
Chrome/87.0.4280.88
Mozilla/5.0 (Macintosh; Intel Mac OS X 11_0_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36
 7
no JSJSmoduleprefetchiframeCSP reportreport-api
2026-09-24 11:13:09.002 UTC
Chrome/120.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 1
no JSfavicon
2026-09-24 11:10:55.838 UTC
Mozilla/5.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 0
no JS—
2026-09-24 11:04:14.080 UTC
(no user-agent)
 0
no JS—
2026-09-24 10:45:06.272 UTC
bingbot/2.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36
 0
no JS✓ Bingbot—
2026-09-24 10:39:32.216 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-09-24 10:34:14.247 UTC
(no user-agent)
 0
no JS—
2026-09-24 10:04:13.870 UTC
(no user-agent)
 0
no JS—
2026-09-24 09:34:14.603 UTC
(no user-agent)
 0
no JS—
← prev1–50 of 200next →

By user agent

Running counts across all 12423 homepage requests (1718 distinct agents). Click one to set the filter above.

User AgentRequestsJS ran
(no user-agent)
 3815 0
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 1019 1
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 337 0
Chrome/120.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 160 2
Chrome/78.0.3904.108
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36
 123 0
YandexBot/3.0
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
 119 0
SeznamBot/4.0
Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/)
 110 0
Chrome/149.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.0.0 Safari/537.36
 95 88
Feedbox/1.0
Feedbox/1.0 (+https://github.com/feedbox)
 93 0
Chrome/131.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36
 90 2
Amazonbot/0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
 78 0
Chrome/120.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 71 1
Chrome/131.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36
 64 1
curl/8.20.0
curl/8.20.0
 57 0
Chrome/124.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
 57 0
Chrome/150.0.0.0
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.0.0 Safari/537.36
 55 6
Chrome/133.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36
 54 0
Chrome/150.0.0.0
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.0.0 Mobile Safari/537.36
 52 40
Drupalbot
Mozilla/5.0 (compatible; Drupalbot; +https://www.drupal.org)
 49 0
Go-http-client/1.1
Go-http-client/1.1
 47 0
Version/17.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.1 Safari/605.1.15
 46 0
Chrome/89.0.4389.114
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.114 Safari/537.36
 46 0
OhDear.app
OhDear.app (+https://ohdear.app/docs/features/broken-links-detection)
 42 0
argus-rss/1
argus-rss/1
 41 0
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
 41 0
← prev1–25 of 1718next →

Unsolicited / well-known requests

Paths a user agent fetched on its own that ua-tracer never links to: robots.txt, sitemap.xml, /.well-known/*, llms.txt, the root favicon, and similar. Reveals what an agent probes on its own initiative.

Filtered to path /robots.txt. clear filters

By path

Each unsolicited path with its request count and how many distinct user agents hit it. Click a path to see the individual requests; click a user agent below to reverse-look-up everything that UA did.

PathRequestsDistinct UAs
/sitemap.xml 202 11
/robots.txt 177 32
/llms.txt 7 2
/ai.txt 6 1
/favicon.ico 2 2
/.well-known/assetlinks.json 1 1
/.well-known/oauth-authorization-server 1 1
/.well-known/host-meta.json 1 1
/.well-known/openid-configuration 1 1
/security.txt 1 1
/.well-known/security.txt 1 1

Requests (177 shown)

The Related trace column links a probe to a homepage trace from the same user agent and IP within 30 minutes (the same crawler that fetched a well-known file usually also loaded /). The offset shows how long before/after the probe that trace was minted.

TimestampPathUser Agent (click for reverse lookup)Related trace
2026-09-24 22:38:16.357 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-24 22:33:41.514 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 21:58:51.088 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 21:52:32.877 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) m61oOY7V (+36ms)
2026-09-24 21:20:26.422 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-24 20:56:18.632 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 20:48:34.084 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-24 20:45:53.392 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 19:55:52.354 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 19:45:45.937 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 18:51:43.303 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 18:43:21.330 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-24 18:27:03.649 UTC /robots.txt Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot) —
2026-09-24 17:50:51.501 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 17:45:23.843 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 17:17:54.617 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-24 17:14:37.213 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-24 16:50:25.697 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 16:38:20.272 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) bjg4iFco (−225ms)
2026-09-24 15:47:58.766 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 15:45:58.269 UTC /robots.txt Mozilla/5.0 (Android 14; Mobile; rv:123.0) Gecko/123.0 Firefox/123 —
2026-09-24 15:45:19.501 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 15:04:41.975 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-24 14:43:26.951 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-24 14:43:05.087 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 14:21:15.256 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-24 14:19:39.958 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 14:11:52.479 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 14:09:51.081 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-24 13:26:38.014 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 13:23:56.206 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-24 13:13:22.489 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-24 13:08:54.932 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 12:41:13.856 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-24 12:19:10.744 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 12:05:32.596 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 11:58:34.469 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-09-24 11:31:04.203 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Reflectionbot/1.0; +https://reflection.ai/bot) Chrome/151.0.0.0 Safari/537.36 —
2026-09-24 11:18:52.270 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 10:57:07.836 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-24 10:50:56.168 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 10:17:07.816 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 09:57:26.125 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-24 09:57:12.290 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-09-24 09:23:31.240 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-24 09:14:59.551 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-24 09:14:10.010 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 09:09:57.187 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 09:09:02.775 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 09:06:58.678 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 09:05:36.941 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 09:03:11.390 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 08:57:59.940 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-24 08:51:55.292 UTC /robots.txt Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) —
2026-09-24 08:29:16.354 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) —
2026-09-24 08:02:10.567 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 07:48:32.647 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 07:44:51.442 UTC /robots.txt Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) —
2026-09-24 07:14:26.554 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-24 06:49:10.073 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 06:43:22.715 UTC /robots.txt Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) —
2026-09-24 06:39:42.007 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 05:47:02.109 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 05:36:09.517 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 05:26:00.500 UTC /robots.txt Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) —
2026-09-24 05:12:19.584 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 04:43:29.990 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 04:33:16.789 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 04:26:30.528 UTC /robots.txt jobs-crawler/0.2 rUq3NhNS (−202ms)
2026-09-24 04:19:30.629 UTC /robots.txt Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) —
2026-09-24 03:34:23.468 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 03:29:18.719 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 02:41:14.281 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-24 02:36:01.542 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-24 02:33:08.928 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 02:30:30.651 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; NoahBot/1.0; +https://noahwire.com/bot-info) vfSyvj5k (+732ms)
2026-09-24 02:04:59.939 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 01:32:03.416 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 01:18:48.157 UTC /robots.txt Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) —
2026-09-24 01:13:37.175 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-24 00:56:21.141 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-24 00:52:29.262 UTC /robots.txt lawa/0.1 (i'm studying the world of HTTP headers! am i abusing you, or do you just want to say hi? email robin@dreamstation.systems https://dreamstation.systems/personal/lawa.html) yDb7xhQl (+10.3s)
2026-09-24 00:47:16.524 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 00:31:42.280 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 23:33:44.089 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 23:27:14.040 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 23:01:34.584 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36 geq1i4OC (+5.8s)
2026-09-23 22:32:08.728 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 22:07:19.307 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-23 21:58:18.503 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 21:49:54.939 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-23 21:28:14.108 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 21:20:44.519 UTC /robots.txt python-requests/2.32.5 —
2026-09-23 20:35:57.104 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 20:32:37.330 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-23 20:29:28.719 UTC /robots.txt Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/7.0 Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) —
2026-09-23 20:10:46.407 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 20:05:11.317 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-23 19:57:19.963 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-09-23 19:32:58.829 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 19:16:11.147 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-23 19:03:52.321 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 18:42:17.500 UTC /robots.txt Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 —
2026-09-23 18:21:49.913 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 18:11:19.281 UTC /robots.txt Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/) —
2026-09-23 18:10:24.620 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-23 17:54:36.472 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 17:15:04.122 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 16:53:34.550 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 16:35:41.566 UTC /robots.txt Polon/1.0 (+robots) —
2026-09-23 16:06:26.879 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 15:49:02.904 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 15:16:36.023 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-09-23 15:07:24.582 UTC /robots.txt YisouSpider —
2026-09-23 14:53:33.722 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 14:29:01.937 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36 pzom9CWJ (+6.0s)
2026-09-23 14:10:11.794 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-23 14:08:20.633 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-23 13:49:38.192 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-09-23 13:49:21.934 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Reflectionbot/1.0; +https://reflection.ai/bot) Chrome/151.0.0.0 Safari/537.36 —
2026-09-23 13:49:08.331 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 13:36:40.926 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 13:19:32.294 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-23 13:14:52.332 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-23 12:33:26.337 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/111.0.0.0 Safari/537.36 9JRbbPNU (+9.8s)
2026-09-23 12:32:33.103 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 12:25:31.950 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 11:31:47.176 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 11:20:09.791 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 11:20:06.189 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-23 10:40:29.754 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-23 10:31:34.063 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 10:22:44.227 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-23 10:14:03.001 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 09:35:30.192 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot —
2026-09-23 09:26:10.210 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-23 09:13:44.470 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 09:12:45.427 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-23 09:02:37.563 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 09:00:12.247 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-23 08:44:15.289 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot —
2026-09-23 08:43:32.343 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot —
2026-09-23 08:30:46.598 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Reflectionbot/1.0; +https://reflection.ai/bot) Chrome/151.0.0.0 Safari/537.36 —
2026-09-23 08:24:10.023 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-23 08:05:25.647 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 08:01:14.121 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 07:59:11.964 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-23 07:52:28.323 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot —
2026-09-23 07:51:54.624 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot —
2026-09-23 07:50:52.506 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-23 07:02:41.097 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 07:00:07.779 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot —
2026-09-23 06:58:47.018 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 05:57:52.152 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 05:47:13.439 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-23 05:41:45.814 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 04:57:01.067 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 04:41:32.943 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-23 04:38:52.960 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 04:03:32.477 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-23 03:56:43.335 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 03:53:25.887 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-23 03:45:06.653 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-23 03:27:42.230 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 02:55:56.671 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 02:49:31.631 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-23 02:49:26.712 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-23 02:47:26.603 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-23 02:26:51.631 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 02:04:49.385 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-23 01:46:17.164 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-09-23 01:45:53.023 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 01:20:27.101 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-23 00:57:34.016 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-23 00:45:30.000 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-23 00:14:58.983 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-23 00:04:54.212 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —

← back to the live tracer (mints a new trace)