What is llms.txt, and does your site need one?

In short

llms.txt is a plain-text map of your site for AI tools. Here is what goes in it, how it differs from robots.txt, and what it can and cannot do.

llms.txt is a plain-text file at the root of your site, at yoursite.com/llms.txt, that gives AI tools a short map of what matters: who you are, your key pages and a one-line summary of each.

Where does it come from?

It was proposed in 2024 as a simple convention. It is a proposal, not an official web standard, and AI providers have adopted it unevenly. Treat it as a low-cost signal, not a guarantee.

How is it different from robots.txt and a sitemap?

  • robots.txt says who may crawl what.
  • A sitemap lists every address for search engines.
  • llms.txt explains, in words, what the site is and which pages are worth reading.

What goes in it?

A title with your name, a one-paragraph summary, then sections of links with short descriptions, written in markdown. A longer companion file, llms-full.txt, can hold the text of the pages themselves.

Does your site need one?

It takes minutes to add and cannot hurt. It helps most on sites with a lot of pages or with content that is hard to read from the HTML. Keep it current: a stale map is worse than none. AEOMCP generates both files from your site and rebuilds them with every scan.

Tarek Riman
Tarek Riman is the founder of Riman Agency and AEOMCP. He works on SEO, AEO and AI search, and teaches digital marketing and AI at Canadian universities. About

All guides

Can AI read your site? Check it for free.

Enter your domain. In a few seconds you see what AI crawlers can read, and what to fix first.