I do not measure AI search the same way I measure traditional search, because the user journey is no longer built around one query, one ranking page, and one click.
A prospect might ask ChatGPT for the best CRM for manufacturing companies, compare options in Google AI Mode, refine the requirements across several follow-up questions, and build a shortlist without ever visiting a website.
If my company appears in those conversations, I have influenced the buying process. The hard part is proving that influence with a measurement system I can trust.
Prompt-level visibility has become one of the fastest-growing areas of AI search optimization. It is also one of the easiest to misunderstand. I see plenty of promises about complete visibility into AI conversations, but the reality is far more complicated.
Here is how I think about what can be measured today, what cannot be measured reliably, and how I would build useful reporting despite the current limits.
A 5-step framework I use to track AI visibility
1. I accept that AI does not have traditional rankings
The first mistake I avoid is trying to recreate an old SEO ranking report. There is no universal position one inside ChatGPT.
The same prompt can produce different responses depending on conversation history, user location, personalization, follow-up questions, model version, web retrieval availability, and timing.
That means visibility is probabilistic rather than deterministic. Instead of asking, "Do we rank?" I ask, "How often are we included across the conversations that matter?"
That shift changes the entire measurement model.
2. I build a prompt library instead of only a keyword list
Keywords still matter, but I no longer treat them as enough on their own.
Instead of tracking only individual search terms, I build a library of prompts that reflects how real buyers research, compare, validate, and challenge their options.
I usually organize those prompts by intent. Discovery prompts ask for the best platforms in a category. Comparison prompts put vendors side by side. Evaluation prompts focus on specific use cases. Validation prompts ask whether a company is worth the cost. Objection prompts explore disadvantages. Alternative prompts ask what to use instead. Implementation prompts test how difficult a product may be to adopt.
Instead of monitoring 10 keywords, I may monitor 200 to 500 prompts across the full buying journey. That gives me a much more realistic view of AI visibility.
3. I measure prompt clusters, not isolated questions
One prompt rarely tells me enough to make a decision.
For example, "best CRM software" might not mention my company, while "best CRM for manufacturing companies" might. A more specific prompt, such as "CRM for manufacturers with field sales teams," could return a different set of recommendations altogether.
That is why I group similar prompts into clusters. A category cluster might include best project management software, best PM platform, and project management tools. An industry cluster might include best CRM for healthcare, manufacturing, and finance. A feature cluster might include CRM with AI automation, forecasting, or enterprise sales support.
The patterns across those clusters are more reliable than the result from any single prompt.
4. I combine synthetic prompts with real customer questions
This is where measurement becomes more difficult.
Most organizations do not know exactly what customers are typing into AI assistants, so I often start by generating synthetic prompts. That may include expanding keyword research into conversational questions, creating AI-generated prompt variations, and building comparison, objection, and follow-up prompts.
Synthetic prompts are useful because they are repeatable, but I do not treat them as perfect. Generated prompts often sound cleaner and more structured than real user behavior.
A real buyer might ask something much richer, such as: "We are a 250-person SaaS company with a small HR team. We already use Workday but need something better for payroll. Budget is not a huge issue. What would you recommend?"
That is much more useful than a short phrase like "best payroll software."
For the strongest measurement program, I use synthetic prompts for consistent benchmarking and then supplement them with real questions from sales calls, customer interviews, support conversations, community discussions, internal search logs, on-site search, and AI transcripts that customers voluntarily share.
I also assume the prompt library will need to change. Customer language evolves, and the measurement set has to evolve with it.
5. I measure multi-turn conversations
Most AI-assisted buying journeys do not happen in a single prompt. A buyer may start by asking for the best cybersecurity vendors, narrow the list to companies strong in healthcare, ask which ones integrate with CrowdStrike, and then compare pricing.
My company may not appear in the first answer, but it may become highly recommended by the third response.
If I only measure the opening prompt, I miss a large share of meaningful visibility.
That is why I want prompt tracking to evaluate full conversation paths, not just one-shot questions. Multi-turn testing often reveals patterns that single prompts hide.
The AI visibility metrics I care about most
Many traditional SEO metrics do not translate neatly to AI search. Rankings, clicks, and impressions still have value, but they no longer tell the whole story.
I focus on measurements that show whether a brand appears, how it is positioned, and how consistently it is recommended inside AI-generated responses.
Inclusion rate
If I could track only one AI visibility metric, I would start here.
Inclusion rate measures the percentage of tracked prompts where my brand appears in the AI response. If I monitor 500 prompts and my company appears in 185 of them, the inclusion rate is 37%.
That number is useful as a benchmark, but it becomes more valuable when I segment it by buying stage, product category, industry, geography, or AI model. Those slices often reveal opportunities that a single overall average would hide.
Position within the response
Being mentioned is not the same as being recommended.
I want to know whether my brand appears as the first recommendation, one of the first few options, a late mention, or merely an alternative. If the AI response includes a comparison table, I also want to know where my company appears there.
AI answers do not have traditional rankings, but prominence still matters. A top recommendation is more likely to shape a buyer’s perception than a passing mention several paragraphs later.
Brand framing
Visibility tells me whether my brand is included. Brand framing tells me how it is described.
There is a meaningful difference between an AI system describing a company as "widely considered an enterprise leader" and describing it as "best suited for smaller teams." Both may sound positive, but they position the brand very differently.
I look for recurring themes around strengths, weaknesses, differentiators, pricing, ideal customer profile, and competitive comparisons. Over time, those patterns can expose messaging gaps in my own content or show how the broader web is shaping AI’s understanding of the brand.
Sentiment and confidence
Sentiment is more than a simple positive-or-negative label. I also want to know how confidently the AI system presents my brand.
"Company A is generally considered the strongest option" carries a very different level of conviction than "Company A may be worth considering."
Neither statement is negative, but they do not create the same buyer impression. Tracking confidence, uncertainty, caution, skepticism, and strong endorsement gives me a more nuanced view of how AI systems present the company to prospective customers.
Competitive share of voice
My own visibility is only part of the picture. I also need to know how often competitors appear alongside me or instead of me.
If my inclusion rate stays at 40% month after month, that may look disappointing. But if every major competitor dropped by 20 percentage points after a model update, the story changes.
On the other hand, if one competitor jumps from 35% inclusion to 70% while everyone else stays flat, I would want to investigate what changed.
Competitive share of voice helps me separate category-wide movement from changes that are specific to my brand.
How I view the AI visibility tool landscape
The market for AI visibility platforms has grown quickly. Each product approaches the problem differently, but most are trying to answer the same core questions: does my brand appear, how often does it appear, which AI models include it, which competitors show up, and how is the brand described?
Many platforms now include prompt libraries, competitive benchmarking, citation tracking, answer monitoring, and trend reporting. These features can reduce the manual work required to test hundreds or thousands of prompts on a recurring basis.
Still, I have to be clear about what these tools are and are not measuring.
No tool has access to every AI conversation happening in the wild. Most rely on controlled prompt libraries, repeatable testing environments, or sampled interactions to create a representative view of visibility.
That is useful, but it is not the same as observing every real user interaction.
What I still cannot reliably track
This is the part I do not want to gloss over.
Even though AI measurement is improving quickly, some data is still not observable. I cannot comprehensively track every prompt where my brand appeared, every conversation that influenced a purchase, every recommendation made inside ChatGPT, every citation shown to every individual user, or exactly how personalization changed a response.
I also cannot see every multi-turn conversation across every AI platform or know how often someone acted on an AI recommendation without clicking a link.
The underlying AI platforms do not expose that level of data. If a vendor claims it can see every AI conversation involving my brand, I would ask exactly how that information is being collected.
The practical framework I would build
Rather than chasing perfect attribution, I focus on building a repeatable measurement system that I can track consistently over time.
For visibility, I would track inclusion rate, competitive share of voice, prompt coverage, and model coverage.
For response quality, I would track position within the response, brand framing, sentiment, and message consistency.
For technical signals, I would track citation frequency, content retrieval success, entity consistency, and freshness.
For business outcomes, I would look at AI referral traffic, assisted conversions, branded search lift, direct traffic trends, and pipeline influenced by AI discovery.
No single metric tells the full story. Together, these signals give me a more complete picture of how the brand is showing up and how it is being perceived across AI-assisted research.
The goal is not perfect measurement
Prompt-level visibility is not as mature as keyword tracking became over the past two decades.
Some signals are still emerging. Others remain inaccessible because AI platforms do not expose the underlying data. At the same time, user behavior is changing almost as quickly as the technology itself.
That does not mean measurement is impossible. It means the objective has changed.
Instead of trying to reconstruct every AI conversation, I focus on building a representative prompt library, tracking visibility consistently, benchmarking against competitors, and understanding how my brand is being framed.
Those trends are far more actionable than chasing a level of precision the current ecosystem cannot support.
The organizations making the most progress in AI search are not waiting for perfect attribution. They are establishing baselines, watching for meaningful movement, and adapting as both AI models and user behavior continue to evolve.
Inspired by this post on Search Engine Land.
