Generate Your LLMs.txt File Instantly

Create an `/llms.txt` file for your website. This proposed standard helps Large Language Models (LLMs) like ChatGPT, Gemini, and Claude understand and use your site's content more effectively, especially during inference time.

Enter your website URL:

We'll use this to suggest a base for your LLMs.txt.

Generated LLMs.txt Content (Example):

# Placeholder Title

> Placeholder description.

## Core Content
- [Example Page 1](https://example.com/page1): Description for page 1.
- [Example Page 2](https://example.com/page2): Description for page 2.

## Optional
- [About Us](https://example.com/about): Optional details about the company.

This is a basic example based on the llms.txt format. Customize it with your actual content and structure.

Next Steps:

Place this file named `llms.txt` in the root directory of your website (e.g., `https://example.com/llms.txt`).
Consider creating `.md` versions of your key pages for better AI consumption.
Optionally, update your `robots.txt` to point AI crawlers to this file (e.g., `LLM-Content: /llms.txt`).

Understanding LLMs.txt

What is LLMs.txt?

Proposed by Jeremy Howard (Sept 2024), `llms.txt` is a standardized Markdown file placed in your site's root directory. It acts as a "map" or guide, providing concise, structured information to help LLMs understand your website's key content and structure efficiently.

Why is it Needed?

LLMs have limited context windows and struggle with complex HTML/JavaScript. `llms.txt` offers an LLM-friendly format, improving content discoverability in the AI era, ensuring accurate representation, and allowing websites to guide AI interaction, primarily during inference.

Benefits & Purpose

By defining key pages and summaries, `llms.txt` helps AI accurately understand and potentially feature your content. It complements `robots.txt` (access control) and differs from `sitemap.xml` (full human-readable index) by offering a curated, AI-optimized view.

Coexisting with Web Standards

`llms.txt` is designed to work alongside existing standards. While `robots.txt` tells bots what they *can access*, `llms.txt` helps them *understand* the allowed content better. `Sitemap.xml` lists all pages for traditional search engines, whereas `llms.txt` provides a curated, structured summary specifically for LLMs.

Optionally, you can reference your `llms.txt` file within your `robots.txt` using directives like `LLM-Content: /llms.txt` to guide compliant AI crawlers.

The LLMs.txt Format

`llms.txt` uses Markdown for human and machine readability. It follows a specific structure placed in the root (`/llms.txt`) or subpath of your website:

An H1 (#) heading with the project or site name (the only required section).
A blockquote (>) with a short summary of the project/site.
Optional: Zero or more paragraphs, lists, etc. (no headings) with more details.
Zero or more H2 (##) sections containing "file lists".
Each file list contains Markdown links [Link Title](URL), optionally followed by : and notes.
An optional H2 section named ## Optional indicates secondary information that can be skipped for shorter contexts.

Example Structure:

# My Awesome Website

> This website provides information about awesome things.

This section contains more detailed background info about the site.

## Core Pages
- [Homepage](https://example.com/index.html.md): Main entry point.
- [Products](https://example.com/products.md): List of awesome products.
- [Blog](https://example.com/blog/index.html.md): Latest news and articles.

## Resources
- [FAQ](https://example.com/faq.md): Frequently Asked Questions.
- [Contact](https://example.com/contact.md): How to reach us.

## Optional
- [About Us](https://example.com/about.md): Learn more about the team.

Note: It's recommended to link to .md versions of your pages where possible, providing clean text for LLMs.

Generator Features

Completely Free

No cost, no sign-up required to generate.

Simple to Use

Enter your URL, get a basic structure.

Instant Output

Get your starter LLMs.txt immediately.

Standard Format

Generates output following the proposed spec.

Improve Your AI Discoverability

As AI systems like ChatGPT and Gemini become primary sources for information, ensuring they can accurately understand and represent your content is crucial. `llms.txt` provides a direct line of communication.

By structuring key information in a way LLMs can easily process, you enhance your site's visibility and control how it's interpreted in the evolving AI-driven web landscape. Start guiding AI interaction today.