---
title: llms.txt: what it is, who reads it, and whether you need one
description: A plain-text map of your site for AI assistants, proposed in 2024. What the format looks like, what the evidence says about adoption, and our honest recommendation.
url: https://ironhelmsuite.com/blog/llms-txt-explained/
---

# llms.txt: what it is, who reads it, and whether you need one

A plain-text map of your site for AI assistants, proposed in 2024. What the format looks like, what the evidence says about adoption, and our honest recommendation.

Published 2026-09-23 in SEO & AI.

Every few months a new file is supposed to be essential for AI search. llms.txt is the one people ask us about most, so here is what it is, where it came from, and how much weight to give it.

## Where it came from

Jeremy Howard of Answer.AI proposed llms.txt on 3 September 2024. His argument was simple: web pages are built for people, full of navigation, scripts and layout, and a language model reading a site has to dig through all of that to find the parts that matter. A short Markdown file at a predictable address, `/llms.txt`, could give it a clean starting point.

The format is plain Markdown:

- an H1 with the site or product name,
- a short summary in a blockquote,
- sections with lists of links to the most useful pages, each with a one-line note.

A companion file, `llms-full.txt`, can contain the full text of the important pages in one place. The proposal also suggests offering Markdown versions of pages at the same address plus `.md`.

## Who actually reads it

This is where honesty matters. llms.txt is a community proposal, not a standard from any search engine or AI company. Documentation-heavy companies, including developer tool makers and some AI providers, publish one for their own docs, and coding assistants are a natural fit: a developer tool can fetch it to understand a library.

What we have not seen is clear, public confirmation from the large AI assistants that their crawlers use llms.txt when deciding what to cite. Google's documentation says there are no extra requirements for appearing in its AI features beyond normal search best practices. Treat any claim that llms.txt will "get you into ChatGPT" with the same scepticism you would give a meta keywords tag in 2010.

## So should you have one?

Our view: yes, if it costs you almost nothing, and no, if it costs you real effort that would be better spent elsewhere.

It is worth having when:

- your site has documentation, guides or a knowledge base that an assistant might be asked about;
- it is generated automatically, so it never goes stale;
- it points to pages that are already good and clearly written.

It is not a substitute for:

- pages that answer questions plainly, with clear headings;
- accurate structured data about who you are and what you sell;
- letting the AI crawlers you want to be cited by actually read the site.

A stale, hand-written llms.txt pointing at pages that no longer exist is worse than none.

## In Ironhelm

Crawlers and AI can publish an llms.txt generated from your site's main pages and keep it current as you publish. The same screen decides which AI crawlers may read the site at all, which matters far more.

## Sources

- Answer.AI, [/llms.txt: a proposal to provide information to help LLMs use websites](https://www.answer.ai/posts/2024-09-03-llmstxt) (September 2024)
- [llmstxt.org](https://llmstxt.org/), the proposal and format
- Google Search Central, [AI features and your website](https://developers.google.com/search/docs/appearance/ai-features)
