Is the llms.txt generator free?

Yes. No sign-up, no watermark in the file, and we don't save the sites you check.

Do ChatGPT and Claude read llms.txt?

Not as an official standard yet. llms.txt is a proposal that AI coding tools and agents already use, and it takes minutes to add, so ship it alongside crawlable pages and a sitemap, which assistants rely on either way.

Does Google use llms.txt?

No. Google has said Search, including its AI features, ignores the file. It neither helps nor harms your rankings.

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers what they may fetch. llms.txt suggests what's worth reading. Blocking a crawler in robots.txt isn't undone by listing pages in llms.txt.

How many pages should it list?

10 to 50 for most sites: your most useful pages, not all of them. The generator lists up to 40 and spreads them across your sections.

My site has no sitemap. Can I still use it?

Yes. Without a sitemap, the generator lists the pages your homepage links to. Publishing a sitemap is still worth doing, because crawlers use it to find every page.

Can I generate it from a specific sitemap?

Yes. Paste the sitemap's address, for example yoursite.com/sitemap-products.xml, instead of your domain.

What is the Optional section?

A section the proposal reserves for links an AI tool can skip when it needs a shorter summary. The generator puts privacy, terms and other policy pages there.

How often should I update it?

Whenever a key page is added, renamed or removed, and at least every few months. Stale links make the file less useful than none.

Free tool

Free llms.txt generator

Give AI tools a clean map of your best pages in under a minute. Enter your site or sitemap and we'll draft an llms.txt: your name and summary, then your most useful pages grouped into sections, each with its own description. Edit it here, check it against the format as you type, then upload it to your site root.

No sign-up
Reads your live site
Tells you what to fix

What llms.txt is

llms.txt is a proposed standard: a Markdown file at the root of your site that gives AI tools a short, curated map of your most useful pages. Jeremy Howard of Answer.AI proposed it in September 2024. It starts with an H1 of your site's name, a one-line summary in a blockquote, then sections of links with a short description each.

# Acme

> Acme makes quiet, fast-boiling kettles for offices and cafés.

Prices are in GBP and include delivery in the UK.

## Products
- [Office kettle](https://acme.com/office-kettle): 10-litre urn for teams of 20+
- [Café kettle](https://acme.com/cafe-kettle): commercial kettle with a two-year warranty

## Help
- [Delivery and returns](https://acme.com/delivery): delivery times and how to return

## Optional
- [Privacy policy](https://acme.com/privacy)

A small llms.txt. Only the H1 is required; everything else is recommended.

One H1, first, naming the site or project.
A blockquote summary straight after it.
Optional notes in paragraphs or lists, but no other headings.
H2 sections of Markdown links, each written "- Name: what it covers".
A section called "Optional" for links an assistant can skip when it's short of space.

How the generator builds your file

Reads robots.txt for your sitemap, or tries /sitemap.xml and /sitemap_index.xml. You can also paste a sitemap address directly.
Follows sitemap indexes to collect your URLs. With no sitemap, it uses the pages your homepage links to.
Skips pagination, tag archives, carts, logins, search pages, files and translated copies of the same pages.
Takes pages from each section in turn, so a large blog doesn't crowd out your product and pricing pages.
Reads the title and meta description of every page it lists, falling back to the social description or the first paragraph.
Groups pages by their first path segment, so /blog, /docs and /products become sections, and puts privacy, terms and other policy pages under Optional.

Validate an llms.txt you already have

When you generate a draft, we also fetch the llms.txt already on your site and check it: whether it's Markdown or an HTML page your server sends by mistake, whether it's served as plain text, and whether it follows the format. The Validate tab checks any file you paste, and the draft is checked live as you edit it.

llms.txt, robots.txt and sitemap.xml

File	What it does	Who reads it
robots.txt	Tells crawlers what they may fetch	Every well-behaved crawler, before it fetches anything
sitemap.xml	Lists every page you want indexed, with when it changed	Search engines and AI crawlers finding pages
llms.txt	Points AI tools at your most useful pages, in Markdown they can read directly	AI coding assistants and agents; no major search engine commits to it

Three files at your site root, three different jobs.

Listing a page in llms.txt doesn't unblock it in robots.txt. If a crawler is blocked there, fix that first: our AI visibility checker tests both.

Which pages to include

Pages that explain what you do and who it's for: home, product or service pages, about.
What it costs and how to buy: pricing, plans, delivery.
How it works: documentation, guides and your most useful articles.
Policies and archives go under Optional, or leave them out.

10 to 50 links suits most sites. It's a guide for a newcomer, not a second sitemap.

Where to upload llms.txt

Platform	Where it goes
Any web server or static host	The web root, next to robots.txt
Next.js	public/llms.txt, or a route handler at app/llms.txt/route.ts if you want to build it from your content
WordPress	The folder that holds wp-config.php, via SFTP or your host's file manager. Some SEO plugins, including Yoast, can generate one
Cloudflare Pages or Workers	Your static assets folder, so it's deployed at the root
Shopify, Webflow, Wix, Squarespace	These builders limit files at the root. Use the platform's own llms.txt setting or an app if there is one, or a redirect from /llms.txt to the file hosted elsewhere

The file has to load at yourdomain.com/llms.txt, served as plain text.

What about llms-full.txt?

Some documentation platforms also generate llms-full.txt, a single file holding the full text of every page. It isn't part of the proposal, which instead suggests offering a clean Markdown copy of individual pages at the same URL with .md appended. For most business sites, a short llms.txt is enough.

Does llms.txt help you rank?

No. Google has said Search ignores it, and ChatGPT, Claude and Perplexity haven't said they use it. It's still worth the ten minutes: AI coding tools and agents do read it, and choosing the pages forces you to decide which ones really explain your business. More in llms.txt: what it does, and what it doesn't.

Edit before you upload

The draft is a starting point. The file is most useful when it's short and chosen by someone who knows the site: keep the pages that explain what you do, what it costs and how it works, rewrite the summary in plain words, and remove anything a newcomer wouldn't need.

Upload the finished file so it loads at yourdomain.com/llms.txt, served as text/plain or text/markdown in UTF-8.

Check how accessible your site is to AI crawlers

Check your site's robots rules, homepage signals and llms.txt. These checks do not measure citations in AI answers.

Start your 3-day trial See pricing

3-day trial · Cancel any time