Every few weeks a new SEO tool emails Indian D2C founders with the same pitch: "AI search is exploding — add an llms.txt file or get left behind." It sounds urgent, technical and easy to act on, which is exactly why it spreads. But before you assign a developer or pay for a generator, it's worth asking the boring question nobody selling the file wants you to ask: does anything actually read it?
In 2026 the honest answer is no — not yet, and not in any way that moves your traffic or your AI citations. Google's own search team has said as much, on the record. That doesn't make llms.txt a scam; it makes it a proposal that got ahead of reality. This piece explains what the file is, what Google actually said, and where your AI-visibility effort belongs instead if you're a D2C brand trying to show up in ChatGPT, Gemini and Google's AI answers.
What llms.txt actually is
llms.txt is a plain-text file, written in Markdown, that sits at the root of your domain — yourbrand.com/llms.txt. The concept, floated in 2024, was simple and reasonable: large language models struggle to parse messy HTML full of navigation, pop-ups and scripts, so give them a clean, curated file that points to your most important pages and summarises what your site is about. A skincare brand might list its product range, its ingredient guides and its shipping policy in tidy Markdown, so an AI model could grasp the site in one read.
As an idea, it's tidy. The problem is the gap between "here's a helpful file" and "the AI systems have agreed to use it." That second half never happened.
It is not robots.txt — don't confuse the two
This is the mix-up that trips up busy teams. robots.txt is an established, respected standard: it tells crawlers which parts of your site they may access, and when you block a bot there, it genuinely stays out. llms.txt is a different animal. It's a suggestion about which content matters, and no major AI engine currently reads or obeys it. One is a rule the machines follow; the other is a note they haven't opened. Treating llms.txt as if it controls anything is where brands go wrong.
What Google actually said in 2026
Here's the part the marketing emails leave out. On 2 June 2026, Google's John Mueller addressed llms.txt directly, and Search Engine Journal reported his words. He called it "purely speculative for now," adding the line that should end most of the debate: "the file has existed for years, yet none of the AI systems use it — what does it mean?"
He also poked at the logic of the whole approach: "If you use an LLM to create the file for you, doesn't that mean the LLM could just … create it for itself too?" It's a fair jab. If a model is smart enough to summarise your site into an llms.txt, it's smart enough to read your site directly — which is what the crawlers already do.
The alternative Google is pointing at
Rather than a static summary file, Mueller pointed toward WebMCP — a Model Context Protocol approach where AI agents discover and use a site's actual functionality, like adding an item to a cart or completing a form, instead of reading a hand-written map. Whether WebMCP becomes the standard is its own open question, but the direction matters: Google's attention is on agents doing things on live sites, not on brands maintaining a parallel text file.
Should a D2C brand bother? A straight cost-benefit
Let's make the decision concrete instead of theoretical. Here's how llms.txt stacks up against the things that genuinely affect whether AI engines can read and cite your D2C store.
| Tactic | Read by AI engines today? | Effort | Real 2026 payoff |
|---|---|---|---|
| llms.txt file | No (per Google, none use it) | Low (once) | Roughly zero |
| Unblocked AI crawlers in robots.txt | Yes | Low | High — access is the baseline |
| Clear buying-intent content | Yes | Ongoing | High — AI lifts plain answers |
| Product / FAQ / review schema | Yes | Medium | High — machines parse you cleanly |
| Fast, clean, mobile pages | Yes | Ongoing | Medium-high |
The table makes the trade-off obvious. llms.txt is the one row where the machines aren't even reading the input. Everything above and below it is doing work today.
The case for adding it anyway
There's a mild, defensible version of "just add one." It's cheap, it's a single file, and if the convention ever does get adopted, you're early. If your team can produce a clean llms.txt in ten minutes and forget about it, there's no harm done. The trap is treating it as a priority — pulling a developer off checkout fixes or feed work to craft and maintain a file no engine reads. That's effort spent on hope.
Where your AI-visibility effort actually belongs
If the goal is getting your brand surfaced inside ChatGPT, Gemini, Perplexity and Google's AI answers, three moves carry almost all the weight — and none of them is a speculative file.
Don't block the AI crawlers
The most common own-goal is accidental. Some brands, spooked by "AI scraping," block GPTBot, Google-Extended or similar in robots.txt, then wonder why they never appear in AI answers. Access is the baseline; you can't be cited from content a model was never allowed to read. Check your robots.txt first — Mueller's own emphasis was that not blocking AI agents matters more than any new file you could add.
Publish content that answers real buying questions
AI engines pull clear, specific, well-structured answers. For a D2C brand that means genuinely useful pages: how to choose the right size, what an ingredient does, whether a product suits Indian weather or water, how returns and COD work. Vague, keyword-stuffed filler gets skipped; a crisp answer to a question your customers actually type gets lifted. This is the same discipline behind answer-engine optimisation, and it's where organic visibility now compounds. Building that content engine — mapping buying questions to pages a model wants to quote — is exactly the kind of work our growth marketing team sets up for D2C brands.
Ship clean structured data
Structured data (product, FAQ and review schema) lets machines parse your pages without guessing at price, availability, rating or answer. It won't force a citation, but it removes ambiguity, and in a world where AI engines are stitching answers from many sources, being the cleanest, most machine-readable source in your category is a quiet advantage that keeps paying off.
The takeaway
llms.txt is a reasonable idea that reality hasn't caught up to. Google's John Mueller called it "purely speculative" in June 2026 and pointed out the obvious — the file has existed for years and no AI system uses it (per Search Engine Journal). So don't let a tool vendor sell you urgency where none exists. If you want to add the file because it's cheap and you're feeling optimistic, go ahead, but hold zero expectations. The visibility you're actually after in 2026 comes from letting AI crawlers in, publishing content that answers real buying questions, and shipping structured data machines can trust. Spend your ten minutes on llms.txt if you like — then spend the rest of your week on the three things that actually get you cited.
Sources: Search Engine Journal, reporting John Mueller's remarks on llms.txt (2 June 2026): "purely speculative for now," "the file has existed for years, yet none of the AI systems use it," and his comment on using an LLM to generate the file; his reference to WebMCP as an agent-focused alternative and his emphasis on not blocking AI crawlers. llms.txt described as a proposed Markdown convention (introduced 2024) placed at a site's root to summarise key content for language models.
Frequently asked questions
What is llms.txt in simple terms?
Is llms.txt the same as robots.txt?
Should my D2C brand add an llms.txt file in 2026?
What actually helps me show up in AI answers instead?
Ready to put this into action?
Digistex4u runs performance, CRM, CRO and growth as one engine for D2C brands. Book a free 20-minute call and we'll map your fastest path to scale.
Get the D2C growth playbook
One practical teardown a week — the Meta, Google, SEO, CRM and retention tactics we run on real D2C brands. No fluff, no spam.
