When an AI answer appears and your page does not, it is tempting to blame the final generation step. That diagnosis starts too late. Your page first has to be fresh enough to trust, relevant enough to retrieve, and competitive enough to survive several ranking passes.
The practical question is not simply, “How do we rank in AI Search?” It is, “At which gate are we losing visibility, and what can our reporting actually prove?” Once you separate those questions, Google Search Console becomes more useful and your optimization backlog becomes much less speculative.
Key takeaways
- Google’s AI output sits on top of retrieval and ranking. Crawling, indexing, freshness, relevance, and ranking remain prerequisites for consideration.
- Search can match a query to the meaning of a page or passage without requiring identical wording, so complete topic coverage matters more than repeated exact-match phrases.
- Search Console’s AI-powered configuration builds reports from existing metrics, filters, and comparisons. It does not create an AI citation metric or reveal Google’s internal candidate set.
- Clicks, impressions, CTR, and average position can narrow your diagnosis, but none of them alone proves why an AI answer did or did not use your content.
- Use the AI configuration as a report builder, then inspect every generated setting before acting on the result.
AI visibility is a pipeline, not a single ranking
Google does not send an unrestricted model across the entire web every time someone enters a query. It reduces the problem in stages. Google’s Jeff Dean has described examples that begin with roughly 30,000 candidate documents and narrow the working material dramatically before the most capable model performs the final task. One LLM-oriented example ended with about 117 documents.
Those figures are explanatory examples, not fixed quotas you can optimize against. Their value is architectural: the expensive reasoning step operates on a selected subset. If your content is absent from that subset, improving the polish of an answer paragraph will not solve the earlier failure by itself.
- Crawl and refresh: Google needs an accessible, current version of the page in its systems.
- Retrieve: lightweight methods identify a broad set of documents that could satisfy the query.
- Rerank: more sophisticated signals reduce that set and determine which candidates deserve deeper processing.
- Synthesize: an LLM reasons over a much smaller collection and constructs the response or result experience.
This model changes how you prioritize SEO work. A page with weak crawl eligibility has a stage-one problem. A page that appears for irrelevant queries has a matching problem. A page with relevant impressions but poor competitive positions has a reranking problem. Only after those gates are reasonably healthy does synthesis readiness become the main editorial question.
Matching is also broader than literal keyword overlap. LLM-based representations can assess the topical relationship between a query and an entire page or an individual paragraph. That gives Google room to connect different phrasings of the same intent. It does not make terminology irrelevant; it makes mechanical repetition a poor substitute for answering the full question.
Semantic expansion is not an AI-era invention. When Google moved its index into memory across machines in 2001, it became practical to expand short searches into far richer query representations, including examples with around 50 terms. Modern models make the representations more capable, but meaning-based retrieval has deep roots in the search infrastructure. A reporting plan that tracks only one exact phrase therefore sees too little of the query space.
Freshness belongs in the same pipeline. Google can refresh some material in under a minute, while crawl scheduling weighs how likely a page is to change and how valuable a newer version would be. Even an important page that changes infrequently may merit frequent checking. The actionable lesson is not to alter timestamps on a schedule. It is to identify pages where changed facts would alter the answer and maintain those pages when the underlying information actually changes.
Read Search Console as evidence, not an AI visibility score
Search Console gives you evidence about observed search performance. Its familiar metrics answer four different questions: did a result receive impressions, where did it tend to appear, how often did users click it, and what share of impressions became clicks? They do not expose the broad retrieval pool, the intermediate reranking passes, or the documents an LLM considered during synthesis.
The AI-powered configuration does not change that boundary. It translates a plain-language request into a report by selecting clicks, impressions, average CTR, and average position; applying query, page, country, device, or date filters; and setting comparisons. That is valuable automation, but it is automation of report setup rather than a new source of AI-specific measurements.
Use metric combinations to form a hypothesis, then segment until competing explanations become less plausible. The patterns below are diagnostic starting points, not causal conclusions.
| Pattern in a filtered view | What it can support | What it does not prove | Next report to run |
|---|---|---|---|
| Impressions fall and average position worsens | The selected cohort has lost search exposure or appears lower within its current query mix. | It does not prove that an LLM rejected the pages. | Split the cohort by page group and query theme, then compare countries and devices. |
| Impressions remain stable while clicks and CTR fall | The pages are still appearing, but user response or the result environment may have changed. | It does not prove that AI answers took the clicks. | Hold the page and query filters constant, then separate device and country views. |
| Impressions rise while average position worsens | The pages may be entering a broader or lower-ranking query mix. | It does not automatically mean that established rankings declined. | Find the query themes responsible for the new impressions and review their positions separately. |
| Clicks and impressions rise with little movement in average position | Demand, eligibility, or the mix of queries may have expanded. | It does not demonstrate increased inclusion in generated answers. | Identify which pages and queries contributed the growth before assigning credit to a change. |
Average position needs particular care because it summarizes a changing mix. A page can gain many new impressions at lower positions while retaining its strongest rankings. The aggregate average then falls even though no established query deteriorated. Conversely, a stable sitewide average can hide a severe decline in one commercial directory if another directory improves at the same time.
Scope matters too. At rollout, AI-powered configuration was limited to the Performance report for Search results, rather than serving as a configuration layer for Discover and News. Where that remains the interface presented in your property, keep conclusions within the Search results dataset. Do not label a Search performance chart as total AI visibility.
Configure reports that isolate one failure mode

A useful report begins with a decision, not a metric. “Show our AI performance” is too vague because neither the desired cohort nor the possible action is defined. “Did our migration guides lose search exposure on mobile after the update?” tells you which pages, device, period, and metrics matter.
- State the decision. Decide whether the result will trigger a technical check, a content review, a freshness update, or no action.
- Define one cohort. Use a page directory, query theme, country, or device that represents a coherent set rather than the whole property.
- Select all four metrics for the first pass. Clicks and impressions show scale, CTR shows response, and average position adds ranking context.
- Use comparable periods. Equal-length ranges reduce one obvious source of distortion. If demand is seasonal, compare periods that represent the same part of the demand cycle.
- Change one dimension at a time. After establishing the cohort baseline, split it by query, page, device, or country rather than changing several filters together.
- Record the generated settings. Your analysis should be reproducible without relying on the wording of the original prompt.
The following requests are specific enough to produce an inspectable configuration:
- Directory baseline: Show clicks, impressions, average CTR, and average position for pages containing /guides/, comparing the last 28 days with the previous 28 days.
- Query-theme check: For mobile searches in Canada, show all four metrics for queries containing migration and compare the two specified date ranges.
- Page-level drill-down: Show the four metrics for pages containing /pricing/ within the selected country and date comparison.
- Device comparison: Compare mobile and desktop performance for queries containing the target topic within the same period.
The prompts are starting configurations, not completed analyses. Replace the sample directories, topic, market, and dates with groups that map to your site. Keep one unfiltered baseline beside every filtered report so you can see whether a change is local or property-wide.
Always inspect what Search Console generated. The configuration system may not interpret every request perfectly, so confirm that the intended metrics, filters, and comparison ranges are actually active. Check that a page filter was not substituted for a query filter, that the correct country and device remain selected, and that both periods use the same cohort. A fluent prompt response is not proof of a correct configuration.
For recurring reporting, keep a small measurement ledger with six fields: question, cohort, filters, comparison periods, observed pattern, and decision. Add the action and the date you plan to reassess it. This prevents a common reporting failure in which a team remembers the chart but cannot reconstruct the population behind it.
Turn the diagnosis into the right work queue

The pipeline is useful only if it changes what you do next. Route each finding to the earliest plausible failure point. Fixing a later stage while an earlier gate is broken creates activity without restoring eligibility.
Eligibility and freshness work
Start here when a coherent page group loses impressions broadly across its relevant queries, especially if the decline spans devices and countries. Confirm that important pages remain available for crawling and suitable for indexing. Then check whether the information on them still reflects the facts a searcher needs.
Prioritize freshness by consequence. A changed fact on a time-sensitive page can alter the answer, while a cosmetic rewrite on an evergreen definition may add no retrieval value. Google’s crawl systems consider both expected change and the value of obtaining a current version, and some pages can be refreshed extremely quickly when the system assigns sufficient value. Your publishing process should therefore flag meaningful changes early rather than rely on blanket update schedules.
- Maintain a list of pages whose answers depend on changing facts.
- Assign an owner to verify those facts when the underlying event, product, policy, or dataset changes.
- Update the affected answer, supporting context, and visible date together.
- Measure the page cohort separately from evergreen content so different update needs do not disappear inside one average.
Semantic retrieval work
Use this queue when a page appears for only a narrow slice of the intent it should satisfy, or when its impressions come from the wrong query themes. Audit the page around the reader’s task rather than a keyword count.
- Write down the primary question the page resolves and the decisions a reader must make after receiving the answer.
- Give each important subquestion a self-contained passage with enough local context to make sense on its own.
- Use the vocabulary readers, practitioners, and product interfaces naturally use, including genuine variations, without repeating a single phrase mechanically.
- Remove sections that broaden the page without helping the target task. More words do not automatically create stronger topical relevance.
- Separate materially different intents into different pages when combining them would force one page to give several competing answers.
Paragraph-level matching makes local clarity important. A passage headed “Requirements” should identify what is required, for whom, and under which conditions. A heading followed by several paragraphs of scene-setting makes the relevant passage harder to distinguish from surrounding material. This is an editorial implication of semantic retrieval, not a guaranteed citation formula.
Ranking and synthesis-readiness work
Move here when relevant pages receive impressions but consistently occupy weak positions within the intended query cohort. The page has cleared at least part of the retrieval problem; now it must compete within a smaller, stronger set.
Make the central answer easy to identify. State the conclusion, define its scope, and place qualifications beside the claim they limit. Where the reader must choose, name the deciding criterion rather than listing options without guidance. Where the answer depends on a version, market, date, or audience, carry that condition into the relevant paragraph.
This structure helps a human reader and gives downstream systems less ambiguity to resolve, but it cannot guarantee selection in an AI response. The synthesis stage still operates after retrieval and reranking, and Search Console does not disclose its document-level choices. Report improvements as stronger search eligibility or engagement when that is what the data shows. Do not convert them into unsupported claims about citations.
Measurement work
Sometimes the right action is a better test. If a decline disappears when you hold the query theme constant, the original problem was probably mix rather than a universal ranking loss. If it exists only on one device, investigate that segment before rewriting every page. If one directory falls while the sitewide totals remain flat, keep the work scoped to that directory until another report supports a wider response.
At your next review, choose one business-critical directory and run four views: an unfiltered baseline, the directory cohort, its main query theme, and its device split. Validate every AI-generated setting, write down the earliest plausible pipeline failure, and assign only the work queue supported by the evidence. That is how you turn an opaque AI Search concern into a diagnosis you can test and improve.
References
- CrushPress.AI — Unveiling Google’s AI Search: Classic Methods Meet Modern AI
- CrushPress.AI — Unlock the Power of AI: New Google Search Console Features

Leave a Reply