wtf reads llms.txt?

'Everyone' says put a llms.txt on your site so AI systems know what to do with your content.
We're tracking whether any of them actually bother to read it — across multiple websites.

Tracking since 26 March 2026.

419
Total hits
2
Today
39
Last 7 days
334
Unique IPs
5
Known LLM bots

As John Mueller, Google, points out, there are numerous llms.txt directories out there, which make llms.txt files findable for any crawler. Also, it is easy to force an LLM to read any public file. AI bots turning up here in the logs doesn't mean llms.txt does anything for a website's visibility. — Sam

AI bot milestones

#1 ✓ Common Crawl 2026-07-22 15:10
#10 · not yet reached

Top user agents

User agentHits
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; SEOJuice-SearchB…
86
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like …
51
Mozilla/5.0 (compatible; Dataprovider.com)
30
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko;…
13
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
13
Mozilla/5.0 (iPhone; CPU iPhone OS 17_1_2 like Mac OS X) AppleWebKit/605.1.15 (K…
9
Mozilla/5.0 (iPhone; CPU iPhone OS 16_3 like Mac OS X) AppleWebKit/605.1.15 (KHT…
8
Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) …
8
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
8
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:123.0) Gecko/20100101 Firefox/123
8
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
8
Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:109.0) Gecko/20100101 Firefox/115
7
Mozilla/5.0 (Android 14; Mobile; rv:123.0) Gecko/123.0 Firefox/123
7
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
6
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, lik…
6
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
5
Mozilla/5.0 (compatible; SiteAuditBot/0.97; +http://www.semrush.com/bot.html)
5
Mozilla/5.0 (iPhone; CPU iPhone OS 17_3_1 like Mac OS X) AppleWebKit/605.1.15 (K…
5
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
5
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:109.0) Gecko/20100101 Firefox/115
5
llms.txt-crawler/1.0 (research)
4
llms.txt crawler bot (+https://llmstxtscan.org; opt-out@llmstxtscan.org)
4
PipericBot/1.0 (+https://piperic.com/bot)
4
Mozilla/5.0 (Linux; U; Android 13; sk-sk; Xiaomi 11T Pro Build/TKQ1.220829.002) …
4
Mozilla/5.0 (Linux; Android 12; SAMSUNG SM-A415F) AppleWebKit/537.36 (KHTML, lik…
4

Recent hits

Time User agent
2026-11-15 07:25 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-15 05:06 PoweredByBot/1.0 (+https://poweredby.keywordseverywhere.com/…
2026-11-14 18:05 Mozilla/5.0 (Linux; Android 14; SM-S901B) AppleWebKit/537.36…
2026-11-14 17:36 Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 …
2026-11-14 09:18 Mozilla/5.0 (iPhone; CPU iPhone OS 16_3 like Mac OS X) Apple…
2026-11-13 22:36 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, l…
2026-11-13 21:33 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, l…
2026-11-13 11:25 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36…
2026-11-12 19:41 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-12 19:35 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-12 19:27 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-12 18:26 problem-finder/1.0 (+https://triremes.com/about)
2026-11-12 17:09 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-12 16:20 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-12 16:12 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-12 04:08 ethicrawl/0.1 (Ethical crawler respecting robots and AI dire…
2026-11-12 00:29 Mozilla/5.0 (Linux; U; Android 13; sk-sk; Xiaomi 11T Pro Bui…
2026-11-11 21:16 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatib…
2026-11-11 20:18 ethicrawl/0.1 (Ethical crawler respecting robots and AI dire…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:159.0) Gecko/20…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:159.0) Gecko/20…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:159.0) Gecko/20…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:159.0) Gecko/20…
2026-11-11 16:13 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36…
2026-11-11 16:13 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/…
2026-11-11 16:13 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/…
2026-11-11 08:42 Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:123.0) Gecko/20…
2026-11-11 08:12 Mozilla/5.0 (Android 14; Mobile; rv:123.0) Gecko/123.0 Firef…