Last month, I noticed crawlers from companies like OpenAI and Google in my website analytics. My initial reaction was concern: Was my content being scraped without my permission? I also worried that too many requests from AI or search crawlers might slow down my site for visitors.
But then I started thinking: What if I could actually turn this into an opportunity? What if I could guide AI tools—like ChatGPT—to the content I want them to see?
That’s when I discovered something called llms.txt. It’s a new file format designed to help large language models (LLMs) understand which pages on your site are most useful. This can improve how your content shows up in AI-generated answers and even help your site get mentioned as a source.
In this guide, I’ll show you how to create an llms.txt file using a plugin or a manual method. Whether you want more AI visibility or simply more control, this is a great way to start shaping how AI interacts with your content.
What Is an llms.txt File and Why Do You Need One?
An llms.txt file is a new proposed standard that gives AI tools like ChatGPT or Claude a structured list of the website content you want them to use when generating answers.
This file lets you point to your most helpful posts, tutorials, or landing pages—content that’s clear, trustworthy, and AI-friendly.
Think of it like a welcome mat for AI. You’re saying: “If you’re going to use my site in your answers, here’s what I recommend you look at first.”
The file itself lives at the root of your site (like example.com/llms.txt) and is written in plain Markdown. It can include links to your sitemap, cornerstone content, or anything else you’d want cited.
Including your sitemap ensures AI tools can find a complete index of your site—even if they don’t follow every link listed individually.
This is part of a broader approach called Generative Engine Optimization (GEO). You might also hear it called AI content optimization or AI search visibility. The idea is to help AI models give better answers—and increase the chances of your site being linked as a source.
Just keep in mind that llms.txt is still an emerging format. Not all AI companies support it yet, but it’s a smart step if you’re looking to
