LLM SEO (SEO for AI): what changes, what stays the same, and what to do first
SEO for AI, also called LLM SEO, AI SEO or SEO for ChatGPT, in three layers: technical, content and authority. Plus how to measure whether it works, engine by engine and country by country.
Short answer
LLM SEO is SEO with a different way of measuring the result. The foundation doesn’t change: crawlable, indexed, useful pages. Three things do. On the technical side, AI crawlers have to be able to read your content in the HTML the server returns (several don’t run JavaScript) without your CDN blocking them. On content, you have to answer the specific sub-questions of your market, not just the main phrase. And on authority, what other sites say about you carries more weight: in Refractia’s data, a brand’s own website accounts for between 0.5% and 2.8% of what AI cites when it talks about that brand.
What LLM SEO is, and why it has so many names
LLM SEO is the work of getting your website and your brand into the answers of ChatGPT, Claude, Gemini, Meta AI and Google’s AI Overviews, as well as into the classic results. People search for it as “LLM SEO”, “AI SEO”, “SEO for AI” or “SEO for ChatGPT”, and the industry also calls it GEO or AEO. They are different names for the same field; the nuances are in AEO vs SEO vs GEO.
The underlying question is usually whether traditional SEO is dead. It isn’t. Google says in its guide to generative AI features that, from Google Search’s perspective, optimizing for generative AI search is still SEO, and that the only requirement to appear in those features is that the page be indexed and eligible to be shown with a snippet. What changed is the outcome: measuring a ranking is no longer enough, because the answer is a paragraph that names some brands and cites some sources.
What stays the same and what changes
| Classic SEO | SEO for AI | |
|---|---|---|
| Result | An ordered list of links | A written answer that names some brands and cites some sources |
| Success | Ranking and click | Being named, how you’re described and whether you’re cited |
| Technical foundation | Crawling, indexing, speed | The same, plus AI crawlers and content that is readable without JavaScript |
| Content | One page per search intent | Answers to the sub-questions each query gets broken into |
| Authority | Inbound links | Mentions and citations in the sources AI uses, with or without a link |
| Measurement | Search Console and rank tracking | Questions to the engines, by country, with the sample size |
What stays the same is almost everything you were already doing well: indexing, internal links, clear titles, good page experience, original content. If your SEO has foundational problems, fix them first; no AI tactic makes up for a page that isn’t indexed.
The technical layer: letting AI read you
The first step is knowing which crawler does what, because blocking one is not the same as blocking another. The main ones:
| Crawler | Owner | What it’s used for |
|---|---|---|
| Googlebot | Indexes the web for Search. AI Overviews and AI Mode are built from that index. | |
| Google-Extended | Not a separate crawler: a robots.txt token that controls whether your content is used to train Gemini. It doesn’t affect your inclusion in Search. | |
| OAI-SearchBot | OpenAI | Shows sites in ChatGPT’s search answers. If you block it, OpenAI says you won’t appear in those answers. |
| GPTBot | OpenAI | Collects content to train models. Blocking it doesn’t remove you from ChatGPT search. |
| Claude-SearchBot | Anthropic | Crawls the web to improve Claude’s search answers. Anthropic warns that blocking it may reduce your visibility in those answers. |
| ClaudeBot | Anthropic | Collects content that may be used to train models. Blocking it excludes your future content from training. |
Sources: the crawler documentation from OpenAI and Anthropic. OpenAI also says ChatGPT search shares queries with third-party search providers and names Bing among them, so it makes sense to have your site in Bing Webmaster Tools.
robots.txt isn’t the only door. A CDN or web application firewall (Cloudflare, Imperva and others) can block or challenge AI crawlers even when your robots.txt allows them. And a JavaScript challenge usually responds with a 200 status code, so your logs look fine while the bot receives a verification page instead of your content. No robots.txt check can see that: you have to request the page the way the bot does and compare it with what a browser gets. Keep in mind that some CDNs let the real, verified bot through by IP range and stop anyone who only copies its user agent, so the final confirmation is in your CDN logs.
Content has to be in the server’s HTML. Several AI crawlers read the HTML as it arrives and don’t run JavaScript. If your prices, products or descriptions load in the browser, the page is empty to them. Googlebot does render JavaScript, but it’s better not to rely on that for the others. The same goes for structured data: if a script or a client-side tag manager injects it, a bot that doesn’t run JavaScript won’t see it. Put it in the HTML, and make sure it matches what’s visible on the page.
Indexing in both indexes. Check Google Search Console and Bing Webmaster Tools. A page marked “Crawled - currently not indexed” doesn’t exist for AI Overviews, and a page Bing doesn’t have gives up one of the ways ChatGPT search can find it. IndexNow lets you tell Bing the moment you publish or change something.
How Refractia checks it
The Technical Workshop runs 56 crawlability and extraction checks for AI, and each one carries an evidence grade: A (documented by Google or mechanically verifiable), B (backed by an independent study) or C (convention: shown as an observation with no weight on the score). It detects when a CDN or firewall blocks AI crawlers even though robots.txt allows them, and exports the backlog to PDF and Excel.
The content layer: answering what the engine goes looking for
Engines with search don’t run one query but several. Google calls this query fan-out: the model generates related, simultaneous queries to complete the answer. A question about car insurance in Guadalajara, Mexico can trigger separate searches for coverage, prices in Mexican pesos, requirements and reviews. Your content competes on each of those sub-questions, not just on the main phrase. What works:
- Answer first. The first sentence of each section states the point, with the fact. What follows explains it. A model summarizing your page takes what’s at the top.
- One page per group of real questions, not per variant. Google warns that creating content for every possible way of searching, in order to manipulate rankings, violates its scaled content abuse policy.
- Local facts, in writing. Country, cities, currency, timelines, coverage, requirements. If your page says “nationwide shipping” without saying which nation, the engine can’t use it for a question that names Mexico or Spain.
- Honest comparisons. A page that explains when your option makes sense and when another one is better is easier to cite for an “X or Y?” question than a brochure.
- First-hand experience. Google asks for original, useful content with first-hand experience. Your own data, cases and real prices: what isn’t on any other site.
What you don’t need, according to the same Google guide: breaking content into tiny chunks, writing in a special way for AI, or creating AI text files or special markup; Google says no llms.txt file is needed either.
How to measure LLM SEO
Search Console folds the traffic from Google’s AI features into the rest, and it doesn’t tell you what the answer says about your brand, whom it recommends instead of you, or how you do in ChatGPT or Meta AI. For that you have to ask the engines, under these conditions:
- Category, comparison and purchase questions, written in the market’s language with the country named in full.
- Several engines: ChatGPT, Claude, Gemini, Google’s AI Overviews (queried from each country) and Meta AI.
- Every rate with its sample, “k of n”, and an engine that didn’t answer counted as “not measured”, not as zero.
- Chat and AI search reported separately: what the model knows and what the web ranks move with different levers.
- Beyond whether you’re named, how you’re described: sentiment, adjectives, attributes.
That is what Refractia does. On the site side, GEO Optimization calculates a GEO Score for every page from six pillars (understanding, retrieval, citation, recommendation, semantic coverage and coherence across engines), analyzes up to 500 pages in full-site mode and builds a content plan. On the answers side, it measures the five surfaces with the rules above. A person starts each scan, and we don’t measure Perplexity, Copilot or Grok.
Frequently asked questions
What is LLM SEO?
It’s the work of getting your website and your brand into the answers of AI engines such as ChatGPT, Claude, Gemini, Meta AI and Google’s AI Overviews. It starts from the same foundation as classic SEO and adds three things: access for AI crawlers, content that answers sub-questions, and presence in third-party sources.
Does traditional SEO still work for AI search?
Yes. Google says optimizing for its AI features is still SEO, and a page has to be indexed to appear in them. What isn’t enough is measuring rankings alone: you have to check whether the answer names you, and how.
What is the difference between LLM SEO, AI SEO and GEO?
In practice they are the same field under different names. GEO comes from a 2023 academic paper; “LLM SEO” and “AI SEO” are the terms teams that already do SEO tend to use for it.
Should I block or allow GPTBot?
It depends on whether you want your content used to train OpenAI’s models. Blocking GPTBot doesn’t remove you from ChatGPT search; blocking OAI-SearchBot does. They are separate decisions.
How do I know if Cloudflare is blocking AI bots on my site?
Check your CDN’s bot settings and firewall rules, and compare what a browser receives with what a request using the bot’s user agent receives. Because a challenge usually returns a 200 status code, your logs can look healthy even when the bot isn’t reading your content.
Keep reading
Is your site ready for AI to read and cite it?
We show you what ChatGPT, Claude, Gemini, Google and Meta AI say about your brand and your competitors, in your language and your country. It’s free, with no commitment, and we reply within one business day.