ua-tracer by Paul Kinlan

recent traces · ua-tracer

ua-tracer

what does a user agent actually fetch, follow & run?

All recent homepage requests, newest first. This page does not mint a new trace (unlike /), so you can browse the log without adding noise.

Recent homepage requests

Filter by user agent and the matching requests appear right below.

TimestampUser AgentAssets
2026-08-19 11:34:10.183 UTC
(no user-agent)
 0
no JS—
2026-08-19 11:31:36.832 UTC
Chrome/124.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
 15
JS ranCSSJSmoduleimgcss-bgcss-fontpreloadprefetchiframe@importCSP reportreport-api
2026-08-19 11:31:30.464 UTC
Chrome/124.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
 0
no JS—
2026-08-19 11:10:49.335 UTC
Chrome/120.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 0
no JS—
2026-08-19 11:04:12.996 UTC
(no user-agent)
 0
no JS—
2026-08-19 10:54:43.052 UTC
RecordedFuture
RecordedFuture Global Inventory Crawler
 0
no JS—
2026-08-19 10:47:17.830 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 10:34:15.775 UTC
(no user-agent)
 0
no JS—
2026-08-19 10:06:06.190 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 10:04:10.253 UTC
(no user-agent)
 0
no JS—
2026-08-19 09:56:10.326 UTC
Chrome/120.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 0
no JS—
2026-08-19 09:48:36.951 UTC
Twitterbot/1.0
Twitterbot/1.0
 2
no JSog-imgtwitter-img
2026-08-19 09:34:09.525 UTC
(no user-agent)
 0
no JS—
2026-08-19 09:33:29.187 UTC
Chrome/73.0.2290
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/557.39 (KHTML, like Gecko) Chrome/73.0.2290 Safari/537.36
 3
no JSJSmodulefavicon
2026-08-19 09:28:37.588 UTC
AffsignalCrawler/1.0
Mozilla/5.0 (compatible; AffsignalCrawler/1.0; +https://affsignal.com/bot)
 0
no JS—
2026-08-19 09:11:12.778 UTC
SeznamBot/4.0
Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/)
 0
no JS—
2026-08-19 09:04:09.745 UTC
(no user-agent)
 0
no JS—
2026-08-19 08:34:10.256 UTC
(no user-agent)
 0
no JS—
2026-08-19 08:20:27.342 UTC
(no user-agent)
 0
no JS—
2026-08-19 08:20:20.460 UTC
(no user-agent)
 0
no JS—
2026-08-19 08:12:15.484 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 08:04:10.241 UTC
(no user-agent)
 0
no JS—
2026-08-19 08:02:09.630 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 07:34:09.431 UTC
(no user-agent)
 0
no JS—
2026-08-19 07:15:43.204 UTC
Chrome/89.0.4389.114
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.114 Safari/537.36
 0
no JS—
2026-08-19 07:04:10.013 UTC
(no user-agent)
 0
no JS—
2026-08-19 06:34:28.514 UTC
Chrome/124.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
 0
no JS—
2026-08-19 06:34:10.260 UTC
(no user-agent)
 0
no JS—
2026-08-19 06:32:37.030 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 06:13:14.151 UTC
Version/17.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.1 Safari/605.1.15
 0
no JS—
2026-08-19 06:04:09.206 UTC
(no user-agent)
 0
no JS—
2026-08-19 05:58:46.868 UTC
Chrome/83.0.4103.61
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36
 0
no JS—
2026-08-19 05:36:50.798 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-08-19 05:36:50.256 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-08-19 05:34:09.317 UTC
(no user-agent)
 0
no JS—
2026-08-19 05:10:45.473 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 05:04:09.148 UTC
(no user-agent)
 0
no JS—
2026-08-19 04:47:58.948 UTC
Amazonbot/0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
 2
no JSimgog-img
2026-08-19 04:34:09.249 UTC
(no user-agent)
 0
no JS—
2026-08-19 04:13:20.445 UTC
Chrome/120.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 0
no JS—
2026-08-19 04:08:29.493 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-08-19 04:04:09.981 UTC
(no user-agent)
 0
no JS—
2026-08-19 03:34:09.371 UTC
(no user-agent)
 0
no JS—
2026-08-19 03:05:29.137 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 03:04:10.732 UTC
(no user-agent)
 0
no JS—
2026-08-19 02:40:21.993 UTC
Firefox/132.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:132.0) Gecko/20100101 Firefox/132.0
 2
no JSJSmodule
2026-08-19 02:34:09.283 UTC
(no user-agent)
 0
no JS—
2026-08-19 02:14:47.051 UTC
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 0
no JS—
2026-08-19 02:04:09.951 UTC
(no user-agent)
 0
no JS—
2026-08-19 01:42:21.249 UTC
Chrome/126.0.0.0
visionheight.com/scan Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) Chrome/126.0.0.0 Safari/537.36
 0
no JS—
← prev1–50 of 200next →

By user agent

Running counts across all 8116 homepage requests (1445 distinct agents). Click one to set the filter above.

User AgentRequestsJS ran
(no user-agent)
 2063 0
Version/13.0.3
Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1
 720 1
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 132 0
Chrome/78.0.3904.108
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36
 108 0
Chrome/149.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.0.0 Safari/537.36
 95 88
Feedbox/1.0
Feedbox/1.0 (+https://github.com/feedbox)
 93 0
Chrome/131.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36
 76 2
YandexBot/3.0
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
 60 0
curl/8.20.0
curl/8.20.0
 57 0
SeznamBot/4.0
Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/)
 52 0
Chrome/133.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36
 51 0
Chrome/120.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 51 2
Drupalbot
Mozilla/5.0 (compatible; Drupalbot; +https://www.drupal.org)
 49 0
Chrome/150.0.0.0
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.0.0 Mobile Safari/537.36
 49 40
Chrome/89.0.4389.114
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.114 Safari/537.36
 44 0
OhDear.app
OhDear.app (+https://ohdear.app/docs/features/broken-links-detection)
 42 0
argus-rss/1
argus-rss/1
 41 0
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
 41 0
Amazonbot/0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
 40 0
Chrome/120.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
 37 1
Go-http-client/1.1
Go-http-client/1.1
 35 0
intel-collector/0.1.0
Mozilla/5.0 (compatible; intel-collector/0.1.0; +https://github.com/enterprise-playbook)
 33 0
Chrome/66.0.3359.181
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.181 Safari/537.36
 32 0
Chrome/120.0.0.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36 Edg/120.0.0.0
 32 0
Version/17.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.1 Safari/605.1.15
 32 0
← prev1–25 of 1445next →

Unsolicited / well-known requests

Paths a user agent fetched on its own that ua-tracer never links to: robots.txt, sitemap.xml, /.well-known/*, llms.txt, the root favicon, and similar. Reveals what an agent probes on its own initiative.

Filtered to path /robots.txt. clear filters

By path

Each unsolicited path with its request count and how many distinct user agents hit it. Click a path to see the individual requests; click a user agent below to reverse-look-up everything that UA did.

PathRequestsDistinct UAs
/robots.txt 319 37
/sitemap.xml 66 11
/favicon.ico 9 6
/.well-known/traffic-advice 2 1
/.well-known/bbf-not-found-8b7ae7e88f88ec9d 1 1
/.well-known/security.txt 1 1
/sitemap_index.xml 1 1
/llms.txt 1 1

Requests (319 shown)

The Related trace column links a probe to a homepage trace from the same user agent and IP within 30 minutes (the same crawler that fetched a well-known file usually also loaded /). The offset shows how long before/after the probe that trace was minted.

TimestampPathUser Agent (click for reverse lookup)Related trace
2026-08-19 11:31:36.544 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-19 11:19:02.985 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 10:45:45.063 UTC /robots.txt CCBot/2.0 (https://commoncrawl.org/faq/) —
2026-08-19 10:03:18.432 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 09:56:05.209 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 09:55:35.559 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 09:48:36.814 UTC /robots.txt Twitterbot/1.0 9Ly2rAP8 (+137ms)
2026-08-19 09:48:36.303 UTC /robots.txt Twitterbot/1.0 —
2026-08-19 09:36:55.024 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-19 09:36:44.194 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-08-19 09:33:51.160 UTC /robots.txt Go-http-client/1.1 —
2026-08-19 09:33:43.364 UTC /robots.txt Go-http-client/1.1 —
2026-08-19 09:28:35.887 UTC /robots.txt Mozilla/5.0 (compatible; AffsignalCrawler/1.0; +https://affsignal.com/bot) —
2026-08-19 09:03:17.144 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 08:53:10.916 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) —
2026-08-19 08:36:21.729 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-19 07:57:50.029 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 07:38:51.092 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-19 07:37:37.697 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-19 07:24:22.502 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 07:23:48.167 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 07:13:50.586 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-08-19 06:37:22.012 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 06:30:27.931 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 05:58:39.846 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36 ttL7pBWt (+7.0s)
2026-08-19 05:39:48.359 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-19 05:33:42.775 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 04:27:46.074 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 03:34:45.798 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-19 03:23:31.817 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 02:42:39.701 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-08-19 02:25:41.986 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 02:25:19.693 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-19 02:19:10.778 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 01:48:36.856 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-19 01:12:50.635 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 00:09:48.448 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-19 00:01:52.217 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 —
2026-08-18 23:24:09.998 UTC /robots.txt Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) —
2026-08-18 23:22:04.362 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 23:06:25.373 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 22:51:18.866 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-18 22:04:54.015 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 22:04:44.406 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 22:04:15.626 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 22:03:30.208 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 21:48:30.916 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-18 21:34:01.677 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) —
2026-08-18 21:33:18.114 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 21:04:08.319 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 20:03:34.748 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 19:38:51.897 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 19:18:43.723 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 19:07:18.374 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-18 18:59:34.092 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 17:57:41.590 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 17:19:21.467 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 16:47:23.506 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 16:37:09.687 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 16:36:58.122 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 16:16:47.548 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-08-18 16:09:29.215 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 15:39:29.183 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-08-18 15:35:57.549 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 15:29:48.479 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 14:34:17.490 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 14:21:02.212 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-18 13:37:48.609 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 13:37:08.911 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 13:29:22.984 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 13:17:43.322 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 13:02:44.581 UTC /robots.txt Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/7.0 Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) —
2026-08-18 12:46:22.782 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 12:19:09.162 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-08-18 12:15:25.407 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 11:22:57.865 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 11:20:23.836 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 11:09:16.196 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 10:58:34.815 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-18 10:51:32.638 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 10:41:02.257 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 10:40:42.116 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 10:36:12.760 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-08-18 10:17:52.191 UTC /robots.txt Mozilla/5.0 (compatible; IbouBot/1.0; +bot@ibou.io; +https://ibou.io/iboubot.html) —
2026-08-18 10:01:32.060 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 09:48:45.757 UTC /robots.txt Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) —
2026-08-18 09:37:27.801 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 09:34:06.654 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 09:01:47.359 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 08:35:49.488 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 08:30:23.353 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) EUZ2ewCm (+17m)
2026-08-18 08:12:19.665 UTC /robots.txt Mozilla/5.0 (compatible; AffsignalCrawler/1.0; +https://affsignal.com/bot) —
2026-08-18 07:36:34.743 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-18 07:32:06.400 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 07:28:32.653 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 07:22:30.466 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) —
2026-08-18 07:19:54.639 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 07:14:39.858 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-08-18 06:32:54.629 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 06:32:08.037 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 06:26:14.325 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 06:24:35.882 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-08-18 05:33:28.938 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 05:33:27.736 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 05:03:28.535 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 04:39:20.051 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-18 04:14:19.116 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-18 04:02:35.428 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 03:49:13.995 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 03:40:06.095 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 03:32:11.853 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 03:31:43.625 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-18 03:15:26.035 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-18 02:55:11.039 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 02:36:09.019 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 01:41:57.844 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 01:39:36.635 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-18 01:21:05.896 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 00:39:53.638 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-18 00:20:45.063 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 00:18:15.034 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 00:15:47.706 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 00:13:19.995 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-18 00:10:52.421 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 23:58:49.776 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 23:58:23.276 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 23:58:17.691 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 23:54:58.857 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 —
2026-08-17 23:47:08.705 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 23:38:00.261 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 23:20:32.301 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-08-17 23:10:50.829 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 22:49:30.013 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 —
2026-08-17 22:43:34.824 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-08-17 22:32:32.179 UTC /robots.txt WorldIndexerBot/0.1 (+https://test.com/bot; test@gmail.com) fn9BMNjp (+473ms)
2026-08-17 22:30:05.308 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 21:47:43.169 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-08-17 21:44:18.878 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 21:25:13.519 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 20:27:14.932 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 20:26:12.283 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 20:22:37.561 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 20:14:05.281 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-08-17 20:10:55.908 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-17 19:57:01.420 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 19:44:45.048 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 19:34:33.654 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 19:28:44.530 UTC /robots.txt Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) —
2026-08-17 19:19:31.784 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 19:04:06.676 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-17 18:55:51.088 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 18:15:46.331 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 17:50:23.213 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 17:47:16.677 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 17:30:38.107 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-08-17 16:27:12.532 UTC /robots.txt amazon-Quick-on-behalf-of-ce868a0f —
2026-08-17 15:53:50.912 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 15:53:42.559 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 15:51:21.947 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 15:34:02.194 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 15:13:10.549 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 14:53:41.442 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-08-17 14:48:04.408 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 14:20:34.603 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-08-17 14:11:39.167 UTC /robots.txt Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 —
2026-08-17 13:47:19.411 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 13:46:28.931 UTC /robots.txt Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/7.0 Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) —
2026-08-17 12:06:11.754 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 11:50:47.023 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 11:50:41.564 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 11:46:36.715 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-17 11:35:26.001 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 11:34:41.627 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 11:34:03.770 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 11:17:27.442 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-08-17 11:14:57.398 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-08-17 10:48:34.004 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 10:45:09.932 UTC /robots.txt facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) —
2026-08-17 10:07:56.192 UTC /robots.txt Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) —
2026-08-17 10:04:37.387 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 10:02:42.698 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-17 09:50:21.205 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 09:45:22.587 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 09:40:16.183 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 09:18:48.209 UTC /robots.txt Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) —
2026-08-17 08:34:14.212 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 08:29:34.517 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) —
2026-08-17 08:19:57.645 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Gort) —
2026-08-17 07:56:29.400 UTC /robots.txt Mozilla/5.0 (compatible; AffsignalCrawler/1.0; +https://affsignal.com/bot) —
2026-08-17 07:40:37.974 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-08-17 07:34:33.674 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-08-17 07:27:12.927 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 07:24:47.583 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 06:51:33.797 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 06:51:20.272 UTC /robots.txt Python/3.14 aiohttp/3.14.1 —
2026-08-17 06:41:20.430 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 06:23:36.003 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-08-17 06:20:21.984 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-08-17 06:17:57.875 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-08-17 06:14:11.027 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —

← back to the live tracer (mints a new trace)