What is llms.txt, and does your site need one?
What is llms.txt?
llms.txt is a plain text file at the root of a website. It is written in Markdown and tells AI tools what the site is and which pages matter. Jeremy Howard proposed it in 2024. It is optional. Google says it will neither help nor harm your site in Google Search. [1][2]
Who actually reads llms.txt?
Almost no one. Ahrefs looked at 137,210 sites in its web analytics data in May 2026. About 38,000 of them had an llms.txt file. 97% of those files got no requests at all that month. [3]
Of the requests that did come, 96% were from bots. The named AI bot that fetched llms.txt most was GPTBot, OpenAI’s training crawler. Claude Code, Anthropic’s coding agent, fetched it more than any AI search bot. [3]
Ahrefs says its customers are more technical than most site owners. So it treats the 28% of sites that had the file as an upper bound for the web at large. [3]
What do Google and the AI companies say?
Google is direct about it. You do not need machine-readable files, AI text files, markup or Markdown to appear in Google Search or its AI features, because Google Search does not use them. Making an llms.txt for other services is fine, and Google says it will neither help nor harm your site in Google Search. [2]
OpenAI’s and Anthropic’s crawler guides do not ask sites for an llms.txt. Both point to robots.txt instead. Both companies do publish one for their own developer docs: OpenAI’s llms.txt and Anthropic’s llms.txt. [4][5][6][7]
Does llms.txt help SEO?
No. Google says the file will neither help nor harm your visibility or rankings in Google Search. It sits next to your pages and changes nothing about them. [2]
Why we still make one
Our own site has an llms.txt. It costs nothing to keep and carries no risk. A few AI tools do fetch it, coding agents above all, according to the Ahrefs data. [3]
Our free check marks llms.txt as optional and never counts a missing file among your top problems. If your time is short, spend it elsewhere first. Make sure AI crawlers are not blocked in robots.txt, and answer your customers’ questions in plain words on your pages.
For what does move AI answers, start with the AI search optimization guide, then how to get your business recommended by ChatGPT and GEO vs SEO.
How do you write an llms.txt file?
Keep it short and true. The proposal at llmstxt.org asks for these parts, in this order. [1]
- A heading line (# in Markdown) with the name of your site or business. It is the only required part.
- A short summary in a blockquote (>): what you do, for whom, and where.
- Optional paragraphs with key facts, like your hours or the areas you serve.
- Sections under smaller headings (##) that list your most useful pages, each as a Markdown link with a short note.
- If you like, a last section called “Optional” for pages an AI tool can skip when it is short on space.
# Example Dental
> Family dental clinic in Austin, Texas. Open Saturdays. Most insurance accepted.
## Services
- [Teeth cleaning](https://www.example.com/cleaning): checkups and cleaning for adults and children
- [Emergency care](https://www.example.com/emergency): same-day visits for pain or a broken tooth
## Optional
- [About us](https://www.example.com/about): the team and the clinicSave it as llms.txt at the root of your site, so it opens at yoursite.com/llms.txt. Keep it in line with your pages. A file that says one thing while your site says another helps nobody.
The proposal also suggests clean Markdown copies of key pages, at the same address with .md added. Some sites publish llms-full.txt, a longer file with the full text of their pages. That is a common habit, but the proposal does not mention it. [1]
How do you check if a site has one?
Add /llms.txt to the address, for example example.com/llms.txt. If you see text, the file exists. If you see a “page not found” error, it does not. Our free check looks for it too, and labels it optional.
Questions people ask
What does LLM mean in llms.txt?
LLM stands for large language model, the kind of AI behind ChatGPT, Claude and Gemini. The file is meant mainly for those tools.
Is llms.txt mandatory?
No. It is an optional proposal, not a web standard. Google says you need no AI text files to appear in Google Search or its AI features. [1][2]
Is llms.txt actually used?
Rarely. In May 2026, 97% of about 38,000 llms.txt files that Ahrefs could see got no requests. Most of the requests that did come were from bots, and few were from AI search. [3]
Will llms.txt get me into ChatGPT?
We know of no evidence that it does. To appear in ChatGPT search, OpenAI asks sites not to block its OAI-SearchBot crawler. That lives in robots.txt, not in llms.txt. [4]
What is the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they may and may not fetch, and most major crawlers follow it. llms.txt only describes your site and points to pages. Nothing has to read it.
Can llms.txt hurt my site?
Not in Google. Google says the file neither helps nor harms your visibility or rankings in Google Search. The only risk is a file that says something your pages do not, so keep its facts in line. [2]
Should I use an llms.txt generator?
You can, but read what it writes. A generator turns your pages into a list. You still need to check that the summary is true and that the pages listed are the ones you want found.
Sources
- llmstxt.org, the llms.txt proposal by Jeremy Howard (read )
- Google Search Central, Optimizing your website for generative AI features on Google Search (updated 10 Jul 2026) (read )
- Ahrefs, Louise Linehan, 15 Jun 2026: llms.txt usage across 137,210 sites (read )
- OpenAI, Overview of OpenAI crawlers (read )
- Anthropic, Does Anthropic crawl data from the web, and how can site owners block the crawler? (read )
- OpenAI’s own llms.txt, for its developer docs (read )
- Anthropic’s own llms.txt, for its developer docs (read )