'Everyone' says put a llms.txt on your site so AI systems know what to do with your content.
We're tracking whether any of them actually bother to read it — across multiple websites.
Tracking since 26 March 2026.
As John Mueller, Google, points out,
there are numerous llms.txt directories out there, which make llms.txt files findable for any crawler.
Also, it is easy to force an LLM to read any public file.
AI bots turning up here in the logs doesn't mean llms.txt does anything for a website's visibility.
— Sam
| User agent | Hits |
|---|---|
| Mozilla/5.0 (compatible; Dataprovider.com) | |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like … | |
| Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) … | |
| Mozilla/5.0 (compatible; ReconTool/1.0) | |
| Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/14… | |
| Mozilla/5.0 (Linux; Android 8.1.0; Moto G (4)) AppleWebKit/537.36 (KHTML, like G… | |
| Mozilla/5.0 (johnmu - the llms-whisperer - here to read your file - not a bot - … | |
| Panzilla/5.0 (hi, it's pantelis. came for the fame \o/) | |
| Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/14… | |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)… | |
| Godzilla/8.4 (Ghost of Bassic.ch ;) | |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like … | |
| Dean-Warwick/3.6 (SEO Specialist NZ; +https://deanwarwick.nz/humans.txt) | |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)… | |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like … | |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:123.0) Gecko/20100101 Firefox/123.0 | |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like … | |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)… | |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko;… | |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)… | |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 | |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like … |
| Time | User agent |
|---|---|
| 2026-05-10 20:02 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-05-09 20:26 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-05-06 17:51 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-05-05 20:10 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-05-04 11:59 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-05-02 20:49 | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36… |
| 2026-04-29 14:29 | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36… |
| 2026-04-29 00:48 | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36… |
| 2026-04-24 03:46 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-04-20 01:07 | Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:123.0) Gecko/20… |
| 2026-04-19 22:32 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-04-19 11:37 | Mozilla/5.0 (Linux; Android 8.1.0; Moto G (4)) AppleWebKit/5… |
| 2026-04-19 08:26 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-04-19 02:40 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-04-18 20:30 | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, l… |
| 2026-04-16 23:54 | Mozilla/5.0 (Linux; Android 8.1.0; Moto G (4)) AppleWebKit/5… |
| 2026-04-16 07:10 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-04-16 04:31 | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, l… |
| 2026-04-13 02:26 | Mozilla/5.0 (compatible; ReconTool/1.0) |
| 2026-04-12 17:15 | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36… |
| 2026-04-11 12:22 | Dean-Warwick/3.6 (SEO Specialist NZ; +https://deanwarwick.nz… |
| 2026-04-10 12:26 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-04-10 09:27 | Mozilla/5.0 (compatible; ReconTool/1.0) |
| 2026-04-09 12:50 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/… |
| 2026-04-09 11:26 | Godzilla/8.4 (Ghost of Bassic.ch ;) |
| 2026-04-09 05:05 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-04-06 08:57 | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36… |
| 2026-04-05 11:10 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-04-04 00:48 | Mozilla/5.0 (compatible; Dataprovider.com) |
| 2026-03-28 08:08 | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, l… |