/llms.txt

LLMs.txt is a new web standard that makes website content easier for Large Language Models (LLMs) to understand. Unlike older web standards like robots.txt and sitemap.xml, which are made for search engines, LLMs.txt is designed for reasoning engines. It gives information about a website in a way that LLMs can easily process.

Key Features

LLMs.txt has two types:

llms.txt This version gives a simple view of the documentation navigation. It helps AI systems quickly understand the site''s structure.

llms-full.txt This version is a big file with all the documentation in one place.

The llms.txt file starts with a project name as the main heading. It then has a short summary. The next parts use smaller headings to organize documentation links. The "Optional" part lists less important resources.

Benefits

LLMs.txt files can be used for many things, like software libraries, company websites, personal portfolios, online shops, and schools. They give a clear overview of documentation. This makes it easier for LLMs to find specific information and improve development environments.

Use Cases

LLMs.txt became popular when Mintlify added support for it on their docs platform. This change made thousands of developer tools'' documentation LLM-friendly, including Anthropic and Cursor. Soon, community sites and tools like directory.llmstxt.cloud and llmstxt.directory started to list LLM-friendly technical docs.

Cost/Price

The article does not talk about the cost or price of using LLMs.txt.

Funding

The article does not talk about the funding details of LLMs.txt.