R Ranklance
Features Agents How It Works Learn Pricing Get Started Free
Home / Learn / llms.txt for WordPress

How to Add an llms.txt File to WordPress

By Rishabh Jha & Anuj Kamble, WisdmLabs · Updated 16 October 2026 · 6 min read

An llms.txt file is a Markdown file at /llms.txt that gives AI tools a short, curated list of your most important pages. To add an llms.txt file to WordPress, switch it on in Yoast SEO or Rank Math (both free), or upload one by hand. It’s cheap, but few AI systems read it yet.

“Does any of the LLM providers actually use llms.txt?” That question, asked on Hacker News in June 2026, is the right place to start. Short answer: rarely, so far. Here’s what llms.txt is, what llms.txt for WordPress involves, how to add it in a few minutes, and what to expect from it.

What is llms.txt?

llms.txt is a proposal by Jeremy Howard, first published in September 2024 and updated in August 2026 (llmstxt.org). Web pages are full of menus, ads and scripts that waste a language model’s limited reading space. An llms.txt file skips all that and lists the pages that matter, in plain Markdown.

It’s a proposal, not an adopted standard. The same site also suggests offering a clean Markdown copy of each page, such as page.md, but most WordPress setups don’t do that yet.

llms.txt is a reading guide, not an access control. It can’t block anyone. To allow or block AI crawlers, use robots.txt, as covered in Block AI crawlers on WordPress.

Does llms.txt do anything for AI search?

Not much, on current evidence. Google says plainly that “you don’t need to create new machine readable files, AI text files, or markup” to appear in AI Overviews or AI Mode (Google Search Central).

The log data agrees. Ahrefs studied 137,210 sites in May 2026: 97% of llms.txt files got no requests at all. AI search bots made up just 1.1% of the requests that did arrive. The biggest readers were GPTBot and coding agents such as Claude Code.

One site’s own logs tell the same story. In a crawler census published in August 2026, Google, Anthropic and OpenAI crawlers fetched dejan.ai’s robots.txt 1,150 times and its llms.txt 4 times.

Who reads llms.txt todayEvidence
Coding agents and AI tools working from docsYes: the largest named AI readers in Ahrefs’ data
SEO and audit tools, including Chrome LighthouseYes: they check it exists and is valid
AI search and answer botsRarely: 1.1% of requests in Ahrefs’ study
Google Search and AI OverviewsNo: Google says it isn’t needed

Adoption is still thin. A crawl of 1,500 e-commerce and SaaS sites shared on Hacker News found a valid llms.txt on just 0.2% of them. People do use the files, though: one commenter reads Cloudflare’s llms.txt in a text browser because it’s faster than the docs site.

Add llms.txt because it’s cheap and helps tools and agents, not because it will raise your AI search visibility. For what does move that, see what answer engine optimization is.

What goes in an llms.txt file?

The format is ordinary Markdown in a fixed order. Only the H1 is required:

  1. An H1 with the site or project name.
  2. A blockquote with a one-line summary.
  3. Optional paragraphs with key details.
  4. H2 sections that list links, each with an optional note after a colon.
  5. An Optional section for links a tool can skip when it’s short on space.
# Example Ceramics
> Handmade ceramic tableware, shipped across the US.

## Products
- [Dinner plates](https://example.com/plates/): Sizes, glazes and care
- [Mugs](https://example.com/mugs/): Capacities and dishwasher safety

## Guides
- [Shipping and returns](https://example.com/shipping/): Costs, times, 30-day returns

## Optional
- [About us](https://example.com/about/)

Write every link as [text](url). Chrome’s Lighthouse checks llms.txt in its Agentic Browsing audits, added in version 13.3.0, and fails a file whose links are bare URLs (DebugBear). Ranklance’s own file is a live example: ranklanceai.com/llms.txt.

How to add llms.txt to WordPress: three ways

If you already use Yoast SEO or Rank Math, start there: both include llms.txt in their free versions. If you use neither, upload a file by hand.

MethodCostHow it picks pagesStays current?
Upload a file by handFreeYou chooseNo, you edit it
Yoast SEO: Yoast SEO → Settings → Site features → AI tools → LLMS.txtFreeCornerstone content first, then the 5 latest updated posts and pages, or your manual page selectionYes, weekly. Writes a real file. Not available on multisite
Rank Math: Rank Math SEO → Dashboard → LLMS Txt, then General Settings → Edit llms.txtFreeThe post types and taxonomies you choose, up to 100 entries by defaultYes. Empty until you configure it
Ranklance llms.txt ManagerSolo plan and upPosts, pages and WooCommerce products, ranked by Ranklance’s page score, newest first when there’s no scoreYes: weekly, on publish or on demand. Also writes llms-full.txt. Each change waits in the approval queue

Comparing SEO plugins more broadly? Our Ranklance vs Yoast page covers the rest.

Adding llms.txt by hand

  1. Write the file in a plain text editor, following the format above, and save it as llms.txt.
  2. Back up first: if your site already has an llms.txt, download a copy before you replace it.
  3. Upload the file to your site root, the folder that holds wp-config.php, using SFTP or your host’s file manager.
  4. Check it works, using the steps in the next section.

Use only one method. A real llms.txt file in your site root is served before WordPress loads, so it hides any plugin that generates the file on the fly. That includes a file Yoast wrote. Yoast also won’t overwrite a file that’s already there.

Request for /llms.txt
  1. 1. Real file in the site root?→ Served as is (uploaded or Yoast)
  2. 2. A plugin generates it?→ Rank Math or Ranklance version
  3. 3. Neither→ 404, or your theme’s page
Why two llms.txt methods clash: the first one that answers wins.

How to check your llms.txt works

  1. Open https://yoursite.com/llms.txt in a browser. It should show plain text, not your theme.
  2. Run curl -I https://yoursite.com/llms.txt. Look for a 200 status and content-type: text/plain.
  3. Run Lighthouse with the Agentic Browsing category in Chrome DevTools. It checks for an H1, a minimum length and Markdown links.
  4. If a plugin-generated file returns 404, go to Settings → Permalinks, click Save Changes to refresh WordPress’s rewrite rules, then clear your cache.
  5. Click every link in the file. Each should load and point to the page’s canonical URL.

Don’t trust the status code alone. As one developer pointed out on Hacker News, sites that send every unknown URL to one page return 200 for files that don’t exist, so tools think they’re there. If you see your homepage at /llms.txt, you don’t have an llms.txt.

Keep your llms.txt short and current

List the pages that best explain your site: products or services, pricing, docs, key guides and comparison pages. Skip tag archives, thin posts and anything you’d rather not have quoted. A short, curated file is the whole point.

Review it whenever those pages change.

Since the file points tools at your best pages, make sure those pages answer questions clearly. Ranklance’s free plugin shows an AEO score for each page in the WordPress editor; it’s Ranklance’s own rubric, not something AI engines use.

To see whether AI tools send visits at all, track AI traffic in GA4. The pages behind the links matter far more than the file itself.

llms.txt setup checklist

  1. Pick one method: Yoast, Rank Math, a hand-written file or Ranklance.
  2. Back up any existing /llms.txt before replacing it.
  3. Include an H1, a one-line summary and Markdown links.
  4. Confirm /llms.txt shows plain text with a 200 status.
  5. Run Lighthouse’s Agentic Browsing check.
  6. Review the list whenever your key pages change.

FAQ

Does Google use llms.txt?

Google says you don't need new machine readable files, AI text files or markup to appear in AI Overviews or AI Mode, which covers llms.txt. Pages need to be indexed and eligible for a snippet in Google Search.

Should llms.txt list every page?

No. List the pages that best explain your site, such as products, pricing, docs and key guides. A short, curated file is the point.

Can I block AI crawlers in llms.txt?

No. llms.txt is a reading guide, not an access control. Use robots.txt to allow or block specific AI crawlers.

What is llms-full.txt?

It's a companion file with the full text of your key pages in Markdown, so a tool can read them in one request. It isn't part of the core llms.txt proposal. Ranklance's llms.txt Manager writes one alongside llms.txt; Yoast and Rank Math generate llms.txt only.

Sources

  • llmstxt.org: the llms.txt proposal
  • Google Search Central: AI features and your website
  • Ahrefs: 97% of llms.txt files never get read (June 2026)
  • dejan.ai: crawler census of robots.txt and llms.txt (August 2026)
  • DebugBear: Lighthouse’s llms.txt audit
  • Yoast: how to enable llms.txt
  • Yoast: llms.txt functional specification
  • Rank Math: how to use llms.txt

All sources checked 16 October 2026. Spot something wrong? Email support@wisdmlabs.com and we’ll fix it.

Related

  • AI crawlers on WordPress: allow, block or both?
  • What is answer engine optimization?
  • How to track AI search traffic in GA4
  • The AEO score explained

Listing your best pages in llms.txt? Make sure they answer questions clearly, with a free AEO score in the WordPress editor.

Install Ranklance free
R Ranklance

The WordPress SEO plugin that executes, not just diagnoses.

Product

Features Agents AEO Score Pricing How It Works

Resources

Docs Learn Compare WordPress.org Changelog Support Forum

Company

About Contact Privacy Terms

© 2026 WisdmLabs. Ranklance is a WisdmLabs product, built for WordPress.