Free llms.txt Generator

Create a short, human-editable guide to the important public pages on your website. Enter a starting URL and this free generator will crawl a small sample of the site, then draft the file for you.

What is llms.txt?

llms.txt is a proposed convention for placing a concise Markdown guide at the root of a website. It can describe the site and point an AI system toward useful pages.

It is not a search-ranking guarantee, and support varies between AI crawlers and tools. It does not replace your normal HTML pages, sitemap.xml, or robots.txt.

Crawl and generate

Enter a public page, usually your homepage. The tool reads that page and follows its first internal links until it has up to 10 URLs, then drafts a clean llms.txt.

Before you submit: Public page text from the URLs this tool visits is sent through the AI provider configured for this generator. Only submit a site you own or have permission to crawl. Do not submit private or sensitive URLs. This version discovers links from the starting page; it does not use robots.txt or sitemap.xml to find URLs.

Discovering and crawling URLs
Starting.
Takes 1 to 2 minutes depending on the site.

How this llms.txt generator works

  1. Fetch the starting page. The URL must be publicly reachable without a login.
  2. Discover a small set of pages. The crawler follows internal links found in that page's HTML, stopping at 10 public pages total.
  3. Read public page text. Scripts and styles are removed, and the remaining text is prepared for the configured AI provider.
  4. Draft the Markdown file. The AI returns a title, short description, sections, and selected links for you to review.

Know the limit: This is a quick starting draft, not a complete site audit. The crawler does not read your sitemap or use robots.txt for discovery, and the first links it finds may not be the pages you would choose. Check every link and edit the result before publishing it.

A valid short llms.txt example

The file is plain Markdown. A small service-business file could look like this:

# Example Service Company

> Home repair and maintenance information for local property owners.

## Services

- [Emergency repairs](https://example.com/emergency-repairs/): How to request urgent help.
- [Maintenance plans](https://example.com/maintenance/): Recurring service options.

## Contact

- [Contact us](https://example.com/contact/): Phone, hours, and request form.

How to install the file

  1. Review the generated text. Remove wrong claims and keep only useful, public links.
  2. Save it as a plain-text file named exactly llms.txt.
  3. Upload it to the public web root for the same domain, using your host's file manager, SFTP, deployment process, or site framework.
  4. Open https://example.com/llms.txt in a private browser window and confirm it loads without a login or redirect.

Need broader help organizing or improving a WordPress site? See our WordPress website services.

llms.txt generator FAQs

Will AI crawlers use llms.txt, and will it improve rankings?

There is no universal support or ranking promise. llms.txt is a proposed convention, so an AI crawler may read it, ignore it, or change its support later. Publishing the file does not guarantee crawling, indexing, citations, search rankings, or AI visibility.

How is llms.txt different from robots.txt and sitemap.xml?

robots.txt gives crawler access instructions. sitemap.xml lists URLs for discovery. llms.txt is a proposed, curated Markdown guide to a site's purpose and useful pages. Keep the established files working; do not replace them with llms.txt.

Where does llms.txt go?

Put it at the root of the domain so the public address is https://example.com/llms.txt. A file placed only in a theme, media folder, or private dashboard is not at the expected address.

What content is processed, and what permission do I need?

The tool fetches the starting page and up to nine internal links that it finds there. Extracted public page text is sent through the configured AI provider to create the draft. The form does not ask for a site login. Only use it for a site you own or are allowed to crawl, and never submit a URL that exposes private or sensitive information.

More website help

Browse our other free website tools, or contact Building Better Software if you need help reviewing the result or installing it on your site.

We use a small amount of analytics and storage to improve this site. Review settings in the cookie policy.