Guide

What is llms.txt?

The proposed standard that makes your site legible to AI assistants — and how to generate one from any live site in about a minute.

A README for the AI reading your site

llms.txt is a plain Markdown file served at /llms.txt that gives large language models a concise, curated index of a website: what the site is, and where its most important content lives. It was proposed in 2024 and has been adopted quickly across developer tools and docs sites.

The analogy writes itself: robots.txt tells crawlers what they may access, sitemap.xml tells them what URLs exist, and llms.txt tells AI systems what your site means. HTML pages are full of nav bars, cookie banners, and scripts that waste context window; llms.txt hands an assistant the signal without the noise.

Why it matters for discoverability: more and more traffic to your product starts as a question to an AI assistant. When an assistant can read a clean index of your site, it can cite you accurately, quote current details, and route users to the right page — instead of guessing from stale training data.

llms.txt vs llms-full.txt

llms.txt

The index. A title, a one-paragraph summary, then sections of links with one-line descriptions. Small, curated, cheap to read — an assistant scans it and fetches only what it needs.

llms-full.txt

The whole meal. The complete content of every page, concatenated into one Markdown file — made to be dropped wholesale into a model’s context or an embedding pipeline.

We generate both from any live site

You do not have to write these files by hand or keep them in sync as your site changes:

1 We crawl your live site and convert every page to clean Markdown.
2 llms.txt is assembled from your real page titles and descriptions, organized to mirror the site.
3 llms-full.txt concatenates the full converted content. Both land in every ZIP, on every plan — publish them at your site root and you are done.

What one looks like

llms.txt auto-generated

# Acme Docs

> Acme helps teams ship widgets faster. This file lists our most useful pages for LLMs and AI assistants.

## Docs

- [Getting started](https://acme.com/docs/getting-started): Install, configure, and deploy in five minutes
- [Authentication](https://acme.com/docs/api/auth): API keys, OAuth flows, and scopes
- [CLI reference](https://acme.com/docs/cli): Every command and flag

## Optional

- [Changelog](https://acme.com/changelog): Release history
- [Pricing](https://acme.com/pricing): Plans and limits

Generate your llms.txt Try one page in the demo

Your llms.txt, generated in about a minute

Crawl your live site once and get llms.txt, llms-full.txt, and the whole site as Markdown.

Start free

25 pages free · no credit card required