GlossaryWhat is llms.txt and does my site need one?

What is llms.txt and does my site need one?

What an llms.txt file is, who actually reads it, and why most businesses should not expect it to change how answer engines describe them.

llms.txt is a plain text file at the root of a website that gives AI tools a short summary of the site and links to its most useful pages. Most businesses do not need one to be named by answer engines, because none of the major answer engines has said it reads them for that purpose.

It is a sensible idea with a narrow real use today. The gap between how it is marketed and how it is actually used is wide.

What llms.txt is

llms.txt was proposed in 2024 by Jeremy Howard of Answer.AI. It is a proposal, not an agreed standard.

The file lives at yourdomain.com/llms.txt and is written in Markdown. It usually contains the site's name, a one line summary, and a list of links to key pages, each with a short note on what the page covers.

A simple example:

# Example Roofing Co

> Commercial roofing contractor serving Dallas and Fort Worth.

## Services

- [Roof replacement](https://example.com/roof-replacement): Timelines, warranties and what is included
- [Roof repair](https://example.com/roof-repair): Emergency and scheduled repairs

The idea is that an AI tool can read this one small file and know where to look, instead of working through a whole website built for people.

How it differs from robots.txt and a sitemap

FileWhat it doesWho reads it
robots.txtTells crawlers what they may and may not accessSearch engines and the major AI crawlers
sitemap.xmlLists the pages on your site for indexingSearch engines
llms.txtSummarises your site and points to key pagesMostly AI coding tools reading documentation

robots.txt controls access. llms.txt only offers a guide. Adding one does not let any crawler in or keep any crawler out.

Who actually reads it

AI coding tools. This is where llms.txt is genuinely used. Coding assistants fetch it to find their way around software documentation, which is why OpenAI, Anthropic and Google all publish one for their own developer docs.

Google Search. Google says you do not need new machine readable files or AI text files to appear in AI Overviews or AI Mode.

The major answer engines. None of ChatGPT, Claude, Perplexity or Gemini has said it uses llms.txt to decide what to cite. Studies of server logs in 2026 found that the major AI crawlers rarely request the file at all, even on sites that publish one.

If someone tells you llms.txt is the key to AI visibility, ask which answer engine has said it reads the file. As of today, the honest answer is none of the major ones.

Does your site need one?

For being named in answers, probably not. The answer engines your buyers use read your pages, not your llms.txt. Time spent on readable pages and direct answers to buyer questions will do far more.

If your platform makes one automatically, there is no harm in keeping it. Some website platforms and SEO plugins now generate llms.txt for you. It costs nothing to leave it on.

If you publish technical documentation, yes. Developers increasingly use AI coding tools that look for llms.txt, so documentation sites and software products have a real reason to maintain one. This help centre publishes one for that reason.

If you do have one, keep it accurate. A summary that describes services you no longer offer, or links to pages that have moved, is worse than no file at all.

What llms.txt does not do

It does not fix pages that answer engines cannot read. If your content only appears after JavaScript runs, a list of links to those pages does not change what crawlers see when they follow them.

It does not replace content. Pointing to a page is not the same as the page answering the question a buyer asked.

It does not control access. To allow or block AI crawlers, use robots.txt and check your security settings.

Where Appear fits

Appear works on the pages answer engines actually read. Adaptive rendering serves them a machine readable version of your real content, and the content work fills the gaps where your site has no answer. An llms.txt file can sit alongside that, but it is not what changes the answer.