What is llms.txt, and does your site need one?
In short
llms.txt is a plain-text map of your site for AI tools. Here is what goes in it, how it differs from robots.txt, and what it can and cannot do.
llms.txt is a plain-text file at the root of your site, at yoursite.com/llms.txt, that gives AI tools a short map of what matters: who you are, your key pages and a one-line summary of each.
Where does it come from?
It was proposed in 2024 as a simple convention. It is a proposal, not an official web standard, and AI providers have adopted it unevenly. Treat it as a low-cost signal, not a guarantee.
How is it different from robots.txt and a sitemap?
- robots.txt says who may crawl what.
- A sitemap lists every address for search engines.
- llms.txt explains, in words, what the site is and which pages are worth reading.
What goes in it?
A title with your name, a one-paragraph summary, then sections of links with short descriptions, written in markdown. A longer companion file, llms-full.txt, can hold the text of the pages themselves.
Does your site need one?
It takes minutes to add and cannot hurt. It helps most on sites with a lot of pages or with content that is hard to read from the HTML. Keep it current: a stale map is worse than none. AEOMCP generates both files from your site and rebuilds them with every scan.