AI search

llms.txt

llms.txt

Definition

llms.txt is a proposed plain-text file at the site root that tells large-language-model crawlers which pages to prefer, in the spirit of robots.txt. It is not a standard Google ranking factor. It is not a switch that puts you in ChatGPT. Some products and crawlers look for it; many ignore it.

Treat it as a courtesy map: a short index of canonical, well-sourced URLs. Do not put secrets in it. Do not expect it to override robots.txt.

How it works

If you ship one, list the newsroom, the docs, the methods pages, and the about/entity page. Keep URLs live. Mention it in the newsroom footer if you want journalists to see the same map.

Worked example

A payments company adds /llms.txt pointing at /docs, /status, and /newsroom/incident-2026-03. Perplexity still cites the incident post because the post is indexed and specific. The file did not create the citation. The post did.

How it differs

robots.txt is the crawl control that major engines honor. Schema describes objects on a page. llms.txt is an unofficial hint. GEO work is still content and corroboration.

Common errors

Selling “llms.txt optimization.” Blocking the newsroom in robots.txt and listing it in llms.txt. 400-line keyword dumps.

Sources