FlagshipURL-first
A fast, categorized index of links only (llms.txt).
Blocked or private site? Paste the sitemap XML or a URL list
How to use
01
Paste your site URL
Enter the domain and the tool requests /sitemap.xml from it automatically. If the sitemap is missing or empty you'll see an error, so publish one first.
02
Add name and description
Fill the optional Site name and Short description fields. The name becomes the H1 of the file and the description appears as a blockquote right under it.
03
Generate and upload
Click Generate llms.txt, review the grouped Markdown in the preview, then copy the output and save it at your domain root, right beside robots.txt.
Why llms.txt Generator
- Paste your site URL and this llms.txt generator reads your sitemap.xml, then auto-categorizes every page into Blog, Docs, Products, and more.
- No manual list needed. It discovers your URLs from the sitemap and groups them for you.
- Follows the emerging llms.txt spec, sometimes written llms txt, that AI crawlers use to understand your site.
- Runs URL-first, so the whole llms txt generator flow is paste, generate, and download.
- One of the few tools that does this end-to-end, free and with no sign up.
Common questions
What exactly goes into a generated llms.txt file?
Markdown, by design. An H1 with your site name, an optional blockquote description, then H2 category sections such as Blog or Documentation, each holding a list of links with paths as anchor text. The format stays readable for humans and trivially parseable for models.
How does the llms txt generator decide which category a page belongs to?
By URL patterns. Paths containing /blog, /post, or /news file under Blog; /docs, /guide, and /help under Documentation; /product, /tools, and /shop under Products; /about and /team under Company. Anything unmatched goes to Other.
Is llms.txt a replacement for robots.txt?
No, they're complements. robots.txt tells crawlers what they may fetch; the newer file tells AI systems what your site contains and which pages represent it best. One is access control, the other is a curated table of contents. Plenty of sites now publish both at the root.
Does my site need a sitemap before generating llms.txt?
Yes. The tool discovers your pages by reading /sitemap.xml, so without one there's nothing to categorize. If you haven't got one yet, build it with the XML Sitemap Generator first, upload it, then come back.
Will AI crawlers actually respect an llms txt file?
Adoption is growing but uneven. The spec emerged in late 2024 and several AI companies fetch the file today, while others still ignore it. Publishing costs you one static file, so the downside of adding it early is close to zero.
What limits each llms.txt category to 50 links?
The generator caps every category at 50 entries on purpose. The file works best as a highlight reel rather than a full mirror of your sitemap, and models handle a short curated list far better than ten thousand URLs.
Am I supposed to edit the generated llms.txt before publishing?
You should. The output is plain Markdown, so reorder sections, delete pages you'd rather not have quoted, or rewrite the description before uploading. Treat what comes out as a strong first draft, not a final answer.