01
Tool

Free llms.txt Generator

Generate an llms.txt file following the llmstxt.org spec. Tell AI crawlers what your site is about, which pages matter most, and which to skip.

Site details

Enter your site name and a one-sentence description for AI crawlers.

0/120
0/500

Key pages

Add the pages you want AI crawlers to index. Each entry needs a title, URL, and short description.

URL entry 1

Your robots.txt is ready - but it's one of 99+ SEO signals.

Run a free audit

What is llms.txt?

llms.txt is a plain-text Markdown file that helps AI crawlers and language models understand your website. Published at the root of your site, it provides structured context that AI systems use to accurately represent your content in summaries, answers, and recommendations.

The llmstxt.org spec defines a simple format:

  • A # Site Name heading
  • A > one-sentence description blockquote
  • Optional ## Section headings with bulleted links

Each link follows the format: - [Page Title](https://yoursite.com/page): Short description of what the page covers.

How it works

When an AI crawler or language model visits your site, it checks for /llms.txt in addition to robots.txt and sitemap.xml. Unlike a sitemap — which only lists URLs — llms.txt tells AI systems what each page is about and which pages are most important. This helps AI-powered search engines and assistants like ChatGPT, Perplexity, and Google's AI Overviews give accurate answers about your site.

Use this generator to:

  1. Enter your site name and a one-sentence description
  2. Add your key pages with titles and descriptions
  3. Copy the generated file and publish it at https://yoursite.com/llms.txt

Best practices

Keep descriptions concise. One sentence per page is enough. AI systems use these descriptions to decide what to read next — clarity beats length.

Prioritize your most important pages. Link to your documentation, product pages, and key landing pages. Skip internal-only pages, login pages, and admin sections.

Update it when your site changes. If you add major new sections or change your primary offering, update llms.txt to reflect the change. Some AI crawlers cache the file for days or weeks.

Consider an llms-full.txt for deeper context. If your site has complex documentation or technical content, an llms-full.txt can include expanded descriptions or full page content. Most sites only need llms.txt.

Do not block it in robots.txt. Ensure llms.txt is accessible to all crawlers — it should never appear under a Disallow rule.

Related tools