50% OFF every package · ends in 0d00h00m00s

What Is llms.txt and Does Your Website Need One?

What Is llms.txt and Does Your Website Need One?

llms.txt is a plain text file in Markdown, placed at yourdomain.com/llms.txt, that gives AI tools a short summary of your website and links to its most important pages. It was proposed in 2024 as a simple way to help large language models understand a site without wading through menus, scripts and design. It is optional, not an official web standard, and support from AI companies is still limited, but it is quick to add.

The structure of an llms.txt file: business name, short summary, key details and sections of links

What goes in an llms.txt file

  • A heading with your business or website name
  • A one-paragraph summary of who you are and what you do
  • Key facts such as location, services and contact details
  • Sections of links to your main pages, products and best articles, each with a short description

Keep it factual and short. It is a curated guide, not a copy of your whole website.

How it differs from robots.txt and sitemaps

Comparison of robots.txt, sitemap.xml and llms.txt and what each file does

robots.txt tells crawlers what they may access. A sitemap lists every URL for search engines. llms.txt is a short, human-readable summary aimed at AI tools. It does not replace either of the others.

Does Google use llms.txt?

Google has said it does not use llms.txt for search, and there is no evidence it affects rankings. Some AI tools and developer platforms do read it. Think of it as a low-cost extra, not a priority over good content, schema and a crawlable site.

How to add llms.txt

On WordPress, you can upload a static file to the root of your site, or generate it automatically with a plugin or a small code snippet so new products and articles are added as you publish. This website generates its llms.txt automatically. On Shopify, you can serve it through a page and redirect, or use an app.

More important than llms.txt

  • Do not block AI search crawlers such as OAI-SearchBot in robots.txt if you want to appear in AI answers
  • Write clear pages that answer questions directly
  • Add schema markup with accurate business details
  • Keep your Google Business Profile complete
  • Earn mentions and reviews on other trusted websites

See the AI search visibility guide and how to get your business recommended by ChatGPT.

llms.txt checklist: correct location, Markdown, summary, contact details, key links, current information and crawler access

An example llms.txt

A simple file for a local business might start with a heading for the business name, a one-paragraph summary such as Sydney plumber offering emergency, hot water and drainage services across the Inner West, then a Contact line with phone and email. Below that come sections such as Services, Pages and Articles, each a list of links with a short description of what the page covers.

Keep it accurate

The biggest risk with llms.txt is that it goes out of date. If prices, services or contact details change and the file does not, AI tools may repeat old information. Generating the file automatically from your website, rather than writing it by hand, avoids this.

Want your site ready for AI search?

The Keyword Planning, Schema and AI Search Visibility package includes llms.txt, schema and crawler checks.

Get help with SEO and AI search →

Frequently asked questions

What is llms.txt?

A Markdown file at the root of your website that summarises your site for AI tools and links to its most important pages.

Is llms.txt an official standard?

No. It is a proposal from 2024 that some tools support, but it is not an official web standard.

Does llms.txt help SEO?

There is no evidence it affects Google rankings. It is a small, optional extra for AI tools.

Where does llms.txt go?

At the root of your domain, for example yourdomain.com.au/llms.txt.

Can WordPress create llms.txt automatically?

Yes, with a plugin or code snippet that builds the file from your pages, products and posts.

Should I block AI crawlers?

If you want to appear in AI search answers, do not block AI search crawlers. You can block training crawlers separately if you prefer.

Back to blog
Get in touch

Have a project in mind?

Tell me about your idea. I'll get back to you with honest advice and a clear quote.

  • Talk directly to the developer
  • Clear quotes before any work starts
  • Sydney CBD based