AEOSurge

llms.txt generator · free

Give AI crawlers a map of your best content.

llms.txt is the emerging standard for the agent era: a small markdown file at your site root with an H1, a blockquote summary, and curated file lists. Build one that follows the spec exactly — or let Forge crawl your site, read the sitemap, and prefill every section for you.

Prefill from your website

Forge

We crawl your site with full-tier extraction, discover pages via sitemap, and draft the sections for you.

Becomes the H1 — the only required section of llms.txt.

Renders as a blockquote — key info for understanding the site.

Sections

H2

Optional section

Renders last as ## Optional — secondary links agents can skip.

1 issue to fix
llms.txt

Spec checklist

  • Missing H1 — the `# Site name` line is the only required section of llms.txt.
  • No blockquote summary — the `> …` line right under the H1 carries the key info for understanding the site.
  • No H2 section with links yet — add at least one file list so agents can jump straight to key pages.
  • 0 B — fits easily in context.

Next steps

  1. 1.Save the file as llms.txt at your site root and serve it with text/markdown.
  2. 2.Keep it small and point links at markdown content where you can — GPTBot, Claude and PerplexityBot all read it.
  3. 3.Run a Forge audit to see how AI crawlers experience the rest of your site.
Let agents keep your llms.txt in sync with your site