ua-tracer by Paul Kinlan

recent traces · ua-tracer

ua-tracer

what does a user agent actually fetch, follow & run?

All recent homepage requests, newest first. This page does not mint a new trace (unlike /), so you can browse the log without adding noise.

Recent homepage requests

Filter by user agent and the matching requests appear right below. Showing requests whose user agent contains bot.

clear
TimestampUser AgentAssets
2026-07-15 13:01:59.531 UTC
PurityBot/1.0
PurityBot/1.0 (+https://puri.li/bot)
 0
no JS—
2026-07-15 07:43:58.985 UTC
SEOJuice-SearchBot/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchBot/1.0; +https://seojuice.io/bot
 0
no JS—
2026-07-14 22:56:25.084 UTC
OAI-SearchBot/1.4
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot
 21
no JS✓ OAI-SearchBotCSSJSmoduleimgfontcss-bgcss-fontfaviconapple-iconmanifestpreloadprefetchiframeiframe-img@import
2026-07-14 15:52:51.944 UTC
AwarioBot/1.0
Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)
 0
no JS—
2026-07-14 13:23:11.498 UTC
AIWebIndex/2.0
AIWebIndex/2.0 (+https://lyrenth.com/bot; AI-readable web index)
 0
no JS—
2026-07-14 10:31:47.309 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-14 10:16:48.929 UTC
Googlebot/2.1
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.84 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
 9
no JS✓ GooglebotCSSJSmodulefaviconapple-iconprefetchiframe@import
2026-07-14 10:16:48.810 UTC
Googlebot/2.1
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
 9
no JS✓ GooglebotCSSJSmodulefaviconapple-iconprefetchiframe@import
2026-07-14 10:04:35.249 UTC
Googlebot/2.1
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.46 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
 6
no JS✓ GooglebotCSSJSmoduleprefetchiframe@import
2026-07-14 07:30:58.834 UTC
Version/9.0.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
 3
no JSfaviconapple-iconog-img
2026-07-14 06:36:21.327 UTC
Amazonbot/0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
 1
no JSog-img
2026-07-14 06:20:44.576 UTC
Version/9.0.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
 0
no JS—
2026-07-14 03:21:32.972 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-14 00:27:30.774 UTC
Version/9.0.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
 1
no JSog-img
2026-07-14 00:27:30.438 UTC
Version/9.0.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
 0
no JS—
2026-07-13 23:18:18.508 UTC
archive.org_bot +http://archive.org/details/archive.org_bot
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/d3712ae warc/v0.8.99
 13
no JSJSmoduleimgfontcss-bgcss-fontapple-iconmanifestpreloadprefetchog-imgtwitter-img@import
2026-07-13 21:32:29.929 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-13 21:32:29.923 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-13 21:22:54.741 UTC
OAI-SearchBot/1.4
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot
 19
no JS✓ OAI-SearchBotCSSJSmoduleimgfontcss-bgcss-fontfaviconapple-iconmanifestpreloadprefetchiframeiframe-img@import
2026-07-13 18:54:52.218 UTC
Amazonbot/0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
 7
no JSJSmoduleprefetchtwitter-imgiframeCSP reportreport-api
2026-07-13 15:23:01.743 UTC
YandexBot/3.0
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
 0
no JS—
2026-07-13 15:18:55.516 UTC
YandexBot/3.0
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
 0
no JS—
2026-07-13 15:06:11.925 UTC
YandexBot/3.0
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
 0
no JS—
2026-07-13 15:01:53.338 UTC
YandexUserproxy
Mozilla/5.0 (compatible; YandexUserproxy; robot; +http://yandex.com/bots)
 0
no JS—
2026-07-13 14:56:39.215 UTC
YandexBot/3.0
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
 0
no JS—
2026-07-13 14:05:51.353 UTC
Version/9.0.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
 3
no JSfaviconapple-iconog-img
2026-07-13 13:28:07.887 UTC
Googlebot-Image/1.0
Googlebot-Image/1.0
 0
no JS⚠ fake Googlebot?—
2026-07-13 10:53:06.433 UTC
Version/9.0.1
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
 3
no JSfaviconapple-iconog-img
2026-07-13 05:15:22.281 UTC
Googlebot/2.1
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.46 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
 6
no JS✓ GooglebotCSSJSmoduleprefetchiframe@import
2026-07-13 02:56:36.528 UTC
GPTBot/1.4
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot)
 24
no JS✓ GPTBotCSSJSmoduleimgfontcss-bgcss-fontfaviconapple-iconmanifestpreloadprefetchiframeiframe-img@import
2026-07-13 00:41:51.075 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-12 22:49:27.507 UTC
DuckDuckBot/1.1
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)
 1
no JSfavicon
2026-07-12 22:29:03.792 UTC
ShapBot/0.1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0
 0
no JS—
2026-07-12 22:29:01.379 UTC
ShapBot/0.1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0
 0
no JS—
2026-07-12 22:07:04.117 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-12 20:29:54.472 UTC
http.rb/5.3.1
Mastodon/4.6.2 (http.rb/5.3.1; +https://social.klein.ruhr/) Bot
 1
no JSog-img
2026-07-12 14:38:22.757 UTC
AhrefsBot/7.0
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
 32
JS ranCSSJSmoduleimgfontcss-bgcss-fontpreloadprefetchog-imgiframeiframe-img@import
2026-07-12 11:40:47.922 UTC
Amazonbot/0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
 2
no JSog-imgtwitter-img
2026-07-12 09:18:11.763 UTC
MJ12bot/v2.0.5
Mozilla/5.0 (compatible; MJ12bot/v2.0.5; http://mj12bot.com/)
 1
no JSiframe
2026-07-12 09:07:18.258 UTC
SummalyBot/5.1.0
SummalyBot/5.1.0
 0
no JS—
2026-07-12 09:07:16.536 UTC
SummalyBot/5.1.0
SummalyBot/5.1.0
 0
no JS—
2026-07-12 06:04:45.923 UTC
http.rb/5.3.1
Mastodon/4.6.3+glitch (http.rb/5.3.1; +https://social.ngoding.id/) Bot
 1
no JSog-img
2026-07-11 18:09:58.932 UTC
http.rb/5.3.1
Mastodon/4.6.2 (http.rb/5.3.1; +https://m.ipoac.nl/) Bot
 1
no JSog-img
2026-07-11 17:12:12.659 UTC
MJ12bot/v2.0.5
Mozilla/5.0 (compatible; MJ12bot/v2.0.5; http://mj12bot.com/)
 1
no JSiframe
2026-07-10 21:22:45.587 UTC
HackerLangsBot/1.0
HackerLangsBot/1.0 (+link preview)
 9
no JSog-img
2026-07-10 20:53:10.405 UTC
ChatGPT-User/1.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
 0
no JS? ChatGPT-User (no ranges)—
2026-07-10 18:55:37.244 UTC
OAI-SearchBot/1.4
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot
 20
no JS✓ OAI-SearchBotCSSJSmoduleimgfontcss-bgcss-fontfaviconapple-iconmanifestpreloadprefetchiframeiframe-img@import
2026-07-10 17:52:49.286 UTC
GPTBot/1.4
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot)
 25
no JS✓ GPTBotCSSJSmoduleimgfontcss-bgcss-fontfaviconapple-iconmanifestpreloadprefetchiframeiframe-img@import
2026-07-10 17:43:23.958 UTC
SummalyBot/5.1.0
SummalyBot/5.1.0
 0
no JS—
2026-07-10 17:43:22.111 UTC
SummalyBot/5.1.0
SummalyBot/5.1.0
 0
no JS—
← prev1151–1200 of 1907next →

By user agent

Running counts across all 12595 homepage requests (566 distinct agents). Click one to set the filter above.

User AgentRequestsJS ran
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.green/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.ie/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.lebenswert.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.org.uk/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.radio/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.uno/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mastodon.wurzelmann.at/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://mazaska.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://newsie.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://norden.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://opalstack.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://oslo.town/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://phpc.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://rstokes.uk/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://ruby.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://social.anoxinon.de/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://social.ffmuc.net/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://social.linux.pizza/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://social.tchncs.de/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://social.thepixelspulse.com/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://strangeminds.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://swiss.social/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://theblower.au/) Bot
 1 0
http.rb/5.3.1
Mastodon/4.6.3 (http.rb/5.3.1; +https://toot.community/) Bot
 1 0
← prev451–475 of 566next →

Unsolicited / well-known requests

Paths a user agent fetched on its own that ua-tracer never links to: robots.txt, sitemap.xml, /.well-known/*, llms.txt, the root favicon, and similar. Reveals what an agent probes on its own initiative.

Filtered to user agent bot. clear filters

By path

Each unsolicited path with its request count and how many distinct user agents hit it. Click a path to see the individual requests; click a user agent below to reverse-look-up everything that UA did.

PathRequestsDistinct UAs
/robots.txt 159 19
/sitemap.xml 44 6
/favicon.ico 2 1
/.well-known/ai-plugin.json 1 1
/ai.txt 1 1
/llms.txt 1 1

Requests (208 shown)

The Related trace column links a probe to a homepage trace from the same user agent and IP within 30 minutes (the same crawler that fetched a well-known file usually also loaded /). The offset shows how long before/after the probe that trace was minted.

TimestampPathUser Agent (click for reverse lookup)Related trace
2026-09-26 12:23:48.940 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 12:20:17.473 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 12:17:30.571 UTC /favicon.ico Mozilla/5.0 (compatible; YandexRenderResourcesBot/1.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 —
2026-09-26 12:17:26.683 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-26 12:05:56.330 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 11:47:48.526 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 11:38:49.328 UTC /sitemap.xml Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-26 11:38:48.159 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-26 11:38:16.944 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-26 11:11:14.593 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 11:03:18.679 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 10:38:46.100 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 10:26:56.617 UTC /robots.txt Mozilla/5.0 (compatible; wpbot/1.4; +https://forms.gle/ajBaxygz9jSR8p8G9) —
2026-09-26 10:02:22.567 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 09:55:20.773 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-26 09:46:05.518 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 09:38:47.354 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-26 09:32:16.969 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 09:28:18.834 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot) —
2026-09-26 09:25:01.880 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 09:06:03.347 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-26 08:42:48.571 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 08:31:51.924 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-09-26 08:25:38.295 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 08:16:11.866 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 08:14:51.121 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 08:11:22.722 UTC /sitemap.xml Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) Q7D2rn76 (+22m)
2026-09-26 07:42:38.069 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 07:27:53.191 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 06:42:14.059 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 06:40:47.927 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 06:34:09.621 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 06:17:49.911 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 06:15:15.931 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 06:11:57.953 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 05:49:07.095 UTC /favicon.ico Mozilla/5.0 (compatible; YandexRenderResourcesBot/1.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 —
2026-09-26 05:49:05.102 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-26 05:37:44.329 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 05:34:48.144 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 05:31:55.649 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-09-26 05:22:38.667 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 05:11:44.513 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 05:05:07.122 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 04:35:28.060 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 04:31:38.910 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 04:11:30.098 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 04:02:33.483 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 04:00:44.421 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 03:30:34.639 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 03:30:34.584 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 02:59:58.920 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-26 02:47:01.789 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-26 02:44:08.571 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-26 02:22:06.205 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 02:13:35.383 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-26 02:12:01.154 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 01:40:25.851 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 01:30:53.813 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-26 01:19:30.681 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-26 01:17:16.709 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-26 01:02:13.251 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-26 00:58:12.314 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-09-26 00:47:32.274 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-26 00:37:48.874 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 23:47:49.353 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 23:45:00.205 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-25 23:33:24.522 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 23:19:40.213 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-25 23:03:33.487 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-25 22:42:13.810 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-25 22:41:15.940 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 22:32:44.119 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 22:27:18.975 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 22:22:53.635 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) Km9cpdsS (+5m)
2026-09-25 22:22:53.627 UTC /sitemap.xml Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) Km9cpdsS (+5m)
2026-09-25 21:59:09.485 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 21:42:30.913 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 21:40:48.622 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 21:10:48.035 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 20:56:07.170 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-25 20:34:30.553 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 20:33:32.570 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 20:12:38.850 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 19:57:51.880 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 19:32:48.690 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 19:32:07.809 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 18:53:19.585 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 18:28:05.114 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 18:25:43.817 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 17:41:56.668 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 17:41:25.537 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 17:19:00.642 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 16:30:10.868 UTC /sitemap.xml Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-25 16:29:51.322 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-25 16:13:27.602 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 16:07:01.319 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 15:51:33.748 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-09-25 15:34:49.552 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-25 15:32:36.335 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 15:16:29.256 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 15:12:04.895 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 14:53:13.024 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 14:35:04.114 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 13:56:28.440 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 13:49:59.314 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 13:37:28.640 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 13:37:28.493 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 13:24:52.011 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot) —
2026-09-25 13:24:51.982 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-25 13:05:08.506 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Reflectionbot/1.0; +https://reflection.ai/bot) Chrome/151.0.0.0 Safari/537.36 —
2026-09-25 12:47:07.100 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 12:39:25.689 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 12:21:11.357 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 12:12:04.715 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 11:50:23.415 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 11:36:52.561 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 11:31:23.168 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Reflectionbot/1.0; +https://reflection.ai/bot) Chrome/151.0.0.0 Safari/537.36 —
2026-09-25 11:15:13.264 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 10:43:45.618 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-25 10:39:30.451 UTC /.well-known/ai-plugin.json UmaiBot/1.0 (+https://umai.entelijan.com/methodology) —
2026-09-25 10:39:30.360 UTC /ai.txt UmaiBot/1.0 (+https://umai.entelijan.com/methodology) —
2026-09-25 10:39:30.247 UTC /llms.txt UmaiBot/1.0 (+https://umai.entelijan.com/methodology) —
2026-09-25 10:39:30.151 UTC /robots.txt UmaiBot/1.0 (+https://umai.entelijan.com/methodology) —
2026-09-25 10:39:30.072 UTC /robots.txt UmaiBot/1.0 (+https://umai.entelijan.com/methodology) —
2026-09-25 10:30:43.021 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 10:24:04.713 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 10:16:05.526 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 10:12:19.611 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 09:38:50.608 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-25 09:32:34.727 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 09:18:49.363 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-25 09:17:01.349 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-25 09:17:01.343 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot) —
2026-09-25 09:15:55.970 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 09:11:53.746 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 09:08:23.085 UTC /robots.txt GazetteerBot/0.2 1pwhT3ug (+88ms)
2026-09-25 09:08:09.945 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 08:59:38.743 UTC /robots.txt Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) —
2026-09-25 08:59:38.712 UTC /sitemap.xml Mozilla/5.0 (compatible; SeznamBot/4.0; +https://o-seznam.cz/napoveda/vyhledavani/en/seznambot-crawler/) —
2026-09-25 08:48:02.103 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-25 08:28:17.110 UTC /sitemap.xml Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-25 08:24:53.225 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 08:13:06.632 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 08:03:54.296 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 07:31:42.349 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 07:31:42.295 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 06:53:26.472 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 06:49:58.492 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 06:45:07.230 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 06:44:57.511 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) —
2026-09-25 06:28:46.490 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 06:22:10.830 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 —
2026-09-25 06:13:50.587 UTC /robots.txt ScraperBot/1.0 (+https://example.com/bot) rDE3c7yp (+841ms)
2026-09-25 06:09:28.293 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-25 05:46:31.614 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 05:36:50.642 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 05:27:22.445 UTC /robots.txt Mozilla/5.0 (compatible; MJ12bot/v2.0.7; http://mj12bot.com/) muG5C02E (+195ms)
2026-09-25 05:09:04.324 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 04:56:30.705 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot —
2026-09-25 04:45:23.803 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 04:28:20.347 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 04:02:33.370 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 03:40:46.418 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 03:24:18.566 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 03:02:25.823 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 02:43:40.041 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-25 02:40:10.398 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 02:36:35.112 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 02:08:09.179 UTC /robots.txt Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) —
2026-09-25 01:59:41.733 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-25 01:37:00.986 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 01:36:28.565 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 01:35:16.783 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 00:57:15.112 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-25 00:43:37.914 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-25 00:36:13.960 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-25 00:35:59.739 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-25 00:31:09.709 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) —
2026-09-24 23:47:35.159 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 23:46:06.652 UTC /sitemap.xml Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 23:43:14.061 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 23:34:58.518 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) —
2026-09-24 23:08:13.166 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 23:04:30.597 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-24 22:38:16.357 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) —
2026-09-24 22:33:41.514 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 21:58:51.088 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 21:52:32.877 UTC /robots.txt Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) m61oOY7V (+36ms)
2026-09-24 21:20:26.422 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —
2026-09-24 20:56:18.632 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 20:45:53.392 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 19:55:52.354 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 19:45:45.937 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 18:51:43.303 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 18:43:21.330 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-24 18:27:03.649 UTC /robots.txt Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot) —
2026-09-24 17:50:51.501 UTC /robots.txt Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) —
2026-09-24 17:45:23.843 UTC /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) —
2026-09-24 17:17:54.617 UTC /robots.txt Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot —
2026-09-24 17:14:37.213 UTC /robots.txt Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) —

← back to the live tracer (mints a new trace)