Tag: Prompt Research

  • Why I Run Each Prompt Once Daily: The Data Behind It

    Why I Run Each Prompt Once Daily: The Data Behind It

    I often get asked why I “only” run each prompt one time per day.

    For me, the answer comes down to signal quality. Running a prompt once daily gives me enough consistent data to understand performance without overloading the process with unnecessary repetition.

    The statistics show that a single daily run is plenty. It gives me a reliable view of how prompts behave over time, while keeping the workflow focused, efficient, and easier to interpret.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • Prompt-Level AI Visibility: How I Measure What Matters

    Prompt-Level AI Visibility: How I Measure What Matters

    I do not measure AI search the same way I measure traditional search, because the user journey is no longer built around one query, one ranking page, and one click.

    A prospect might ask ChatGPT for the best CRM for manufacturing companies, compare options in Google AI Mode, refine the requirements across several follow-up questions, and build a shortlist without ever visiting a website.

    If my company appears in those conversations, I have influenced the buying process. The hard part is proving that influence with a measurement system I can trust.

    Prompt-level visibility has become one of the fastest-growing areas of AI search optimization. It is also one of the easiest to misunderstand. I see plenty of promises about complete visibility into AI conversations, but the reality is far more complicated.

    Here is how I think about what can be measured today, what cannot be measured reliably, and how I would build useful reporting despite the current limits.

    A 5-step framework I use to track AI visibility

    1. I accept that AI does not have traditional rankings

    The first mistake I avoid is trying to recreate an old SEO ranking report. There is no universal position one inside ChatGPT.

    The same prompt can produce different responses depending on conversation history, user location, personalization, follow-up questions, model version, web retrieval availability, and timing.

    That means visibility is probabilistic rather than deterministic. Instead of asking, "Do we rank?" I ask, "How often are we included across the conversations that matter?"

    That shift changes the entire measurement model.

    2. I build a prompt library instead of only a keyword list

    Keywords still matter, but I no longer treat them as enough on their own.

    Instead of tracking only individual search terms, I build a library of prompts that reflects how real buyers research, compare, validate, and challenge their options.

    I usually organize those prompts by intent. Discovery prompts ask for the best platforms in a category. Comparison prompts put vendors side by side. Evaluation prompts focus on specific use cases. Validation prompts ask whether a company is worth the cost. Objection prompts explore disadvantages. Alternative prompts ask what to use instead. Implementation prompts test how difficult a product may be to adopt.

    Instead of monitoring 10 keywords, I may monitor 200 to 500 prompts across the full buying journey. That gives me a much more realistic view of AI visibility.

    3. I measure prompt clusters, not isolated questions

    One prompt rarely tells me enough to make a decision.

    For example, "best CRM software" might not mention my company, while "best CRM for manufacturing companies" might. A more specific prompt, such as "CRM for manufacturers with field sales teams," could return a different set of recommendations altogether.

    That is why I group similar prompts into clusters. A category cluster might include best project management software, best PM platform, and project management tools. An industry cluster might include best CRM for healthcare, manufacturing, and finance. A feature cluster might include CRM with AI automation, forecasting, or enterprise sales support.

    The patterns across those clusters are more reliable than the result from any single prompt.

    4. I combine synthetic prompts with real customer questions

    This is where measurement becomes more difficult.

    Most organizations do not know exactly what customers are typing into AI assistants, so I often start by generating synthetic prompts. That may include expanding keyword research into conversational questions, creating AI-generated prompt variations, and building comparison, objection, and follow-up prompts.

    Synthetic prompts are useful because they are repeatable, but I do not treat them as perfect. Generated prompts often sound cleaner and more structured than real user behavior.

    A real buyer might ask something much richer, such as: "We are a 250-person SaaS company with a small HR team. We already use Workday but need something better for payroll. Budget is not a huge issue. What would you recommend?"

    That is much more useful than a short phrase like "best payroll software."

    For the strongest measurement program, I use synthetic prompts for consistent benchmarking and then supplement them with real questions from sales calls, customer interviews, support conversations, community discussions, internal search logs, on-site search, and AI transcripts that customers voluntarily share.

    I also assume the prompt library will need to change. Customer language evolves, and the measurement set has to evolve with it.

    5. I measure multi-turn conversations

    Most AI-assisted buying journeys do not happen in a single prompt. A buyer may start by asking for the best cybersecurity vendors, narrow the list to companies strong in healthcare, ask which ones integrate with CrowdStrike, and then compare pricing.

    My company may not appear in the first answer, but it may become highly recommended by the third response.

    If I only measure the opening prompt, I miss a large share of meaningful visibility.

    That is why I want prompt tracking to evaluate full conversation paths, not just one-shot questions. Multi-turn testing often reveals patterns that single prompts hide.

    The AI visibility metrics I care about most

    Many traditional SEO metrics do not translate neatly to AI search. Rankings, clicks, and impressions still have value, but they no longer tell the whole story.

    I focus on measurements that show whether a brand appears, how it is positioned, and how consistently it is recommended inside AI-generated responses.

    Inclusion rate

    If I could track only one AI visibility metric, I would start here.

    Inclusion rate measures the percentage of tracked prompts where my brand appears in the AI response. If I monitor 500 prompts and my company appears in 185 of them, the inclusion rate is 37%.

    That number is useful as a benchmark, but it becomes more valuable when I segment it by buying stage, product category, industry, geography, or AI model. Those slices often reveal opportunities that a single overall average would hide.

    Position within the response

    Being mentioned is not the same as being recommended.

    Futuristic SEO and AI search illustration showing old tools breaking apart as blue data streams lead to a glowing search platform and digital icons.
    Old search marketing tools give way to a faster, connected future, with data streams, AI icons, and a glowing search hub symbolizing SEO innovation and community growth.

    I want to know whether my brand appears as the first recommendation, one of the first few options, a late mention, or merely an alternative. If the AI response includes a comparison table, I also want to know where my company appears there.

    AI answers do not have traditional rankings, but prominence still matters. A top recommendation is more likely to shape a buyer’s perception than a passing mention several paragraphs later.

    Brand framing

    Visibility tells me whether my brand is included. Brand framing tells me how it is described.

    There is a meaningful difference between an AI system describing a company as "widely considered an enterprise leader" and describing it as "best suited for smaller teams." Both may sound positive, but they position the brand very differently.

    I look for recurring themes around strengths, weaknesses, differentiators, pricing, ideal customer profile, and competitive comparisons. Over time, those patterns can expose messaging gaps in my own content or show how the broader web is shaping AI’s understanding of the brand.

    Sentiment and confidence

    Sentiment is more than a simple positive-or-negative label. I also want to know how confidently the AI system presents my brand.

    "Company A is generally considered the strongest option" carries a very different level of conviction than "Company A may be worth considering."

    Neither statement is negative, but they do not create the same buyer impression. Tracking confidence, uncertainty, caution, skepticism, and strong endorsement gives me a more nuanced view of how AI systems present the company to prospective customers.

    Competitive share of voice

    My own visibility is only part of the picture. I also need to know how often competitors appear alongside me or instead of me.

    If my inclusion rate stays at 40% month after month, that may look disappointing. But if every major competitor dropped by 20 percentage points after a model update, the story changes.

    On the other hand, if one competitor jumps from 35% inclusion to 70% while everyone else stays flat, I would want to investigate what changed.

    Competitive share of voice helps me separate category-wide movement from changes that are specific to my brand.

    How I view the AI visibility tool landscape

    The market for AI visibility platforms has grown quickly. Each product approaches the problem differently, but most are trying to answer the same core questions: does my brand appear, how often does it appear, which AI models include it, which competitors show up, and how is the brand described?

    Many platforms now include prompt libraries, competitive benchmarking, citation tracking, answer monitoring, and trend reporting. These features can reduce the manual work required to test hundreds or thousands of prompts on a recurring basis.

    Still, I have to be clear about what these tools are and are not measuring.

    No tool has access to every AI conversation happening in the wild. Most rely on controlled prompt libraries, repeatable testing environments, or sampled interactions to create a representative view of visibility.

    That is useful, but it is not the same as observing every real user interaction.

    What I still cannot reliably track

    This is the part I do not want to gloss over.

    Even though AI measurement is improving quickly, some data is still not observable. I cannot comprehensively track every prompt where my brand appeared, every conversation that influenced a purchase, every recommendation made inside ChatGPT, every citation shown to every individual user, or exactly how personalization changed a response.

    I also cannot see every multi-turn conversation across every AI platform or know how often someone acted on an AI recommendation without clicking a link.

    The underlying AI platforms do not expose that level of data. If a vendor claims it can see every AI conversation involving my brand, I would ask exactly how that information is being collected.

    The practical framework I would build

    Rather than chasing perfect attribution, I focus on building a repeatable measurement system that I can track consistently over time.

    For visibility, I would track inclusion rate, competitive share of voice, prompt coverage, and model coverage.

    For response quality, I would track position within the response, brand framing, sentiment, and message consistency.

    For technical signals, I would track citation frequency, content retrieval success, entity consistency, and freshness.

    For business outcomes, I would look at AI referral traffic, assisted conversions, branded search lift, direct traffic trends, and pipeline influenced by AI discovery.

    No single metric tells the full story. Together, these signals give me a more complete picture of how the brand is showing up and how it is being perceived across AI-assisted research.

    The goal is not perfect measurement

    Prompt-level visibility is not as mature as keyword tracking became over the past two decades.

    Some signals are still emerging. Others remain inaccessible because AI platforms do not expose the underlying data. At the same time, user behavior is changing almost as quickly as the technology itself.

    That does not mean measurement is impossible. It means the objective has changed.

    Instead of trying to reconstruct every AI conversation, I focus on building a representative prompt library, tracking visibility consistently, benchmarking against competitors, and understanding how my brand is being framed.

    Those trends are far more actionable than chasing a level of precision the current ecosystem cannot support.

    The organizations making the most progress in AI search are not waiting for perfect attribution. They are establishing baselines, watching for meaningful movement, and adapting as both AI models and user behavior continue to evolve.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • AI Search Parrot Problem: Why Brands Get Misread

    AI Search Parrot Problem: Why Brands Get Misread

    AI search brand visibility analysis

    I believe your brand may already be getting misrepresented in AI search, and the hard part is that you might not even know it is happening.

    When I looked at how AI search responses behave, one pattern stood out immediately: nearly half of AI responses include unsolicited comparisons, opinions, and recommendations that the user never directly asked for.

    That creates a second dimension marketers cannot afford to ignore. It is not just whether AI systems mention your brand. It is how they frame your brand, what they compare it against, and which assumptions they repeat back to users.

    To understand the scale of the problem, I analyzed 50,000 prompts across seven industries. I wanted to see when AI search stays factual, when it adds its own judgment, and how often brands are pulled into recommendations or comparisons without the user asking for them.

    What I found shows why AI visibility is no longer only about being included in the answer. It is also about making sure the answer represents your brand accurately, fairly, and in the right context.

    In this article, I break down what I found, why this “parrot problem” matters for marketers, and what you can do to protect your brand as AI search becomes a bigger part of the customer journey.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • How I Analyze Query Fanouts in Profound for AEO Wins

    How I Analyze Query Fanouts in Profound for AEO Wins

    I use Query Fanouts in Profound to understand how Answer Engines turn a prompt into the search queries that shape AI-generated answers.

    In this guide, I walk through Profound’s new Query Fanouts page step by step, focusing on how prompts are interpreted, which queries carry the most weight, and how those queries influence visibility inside AI answers.

    For AEO teams, this view makes the optimization process clearer. I can see where an answer engine is looking for supporting information, identify the queries that matter most, and spot the strongest opportunities to improve content, authority, and brand visibility.

    By expanding my analysis beyond the original prompt, I get a more practical view of the full search pathway behind an AI response. That makes it easier to prioritize the work that can actually improve performance in answer engines.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • Mastering Prompt-Level SEO for AI Search: A Guide to Experiments

    Mastering Prompt-Level SEO for AI Search: A Guide to Experiments

    As someone deeply invested in the world of AI and SEO, I’ve seen firsthand how important it is to optimize brand visibility in AI-generated responses. More and more, people are leaning on these AI models to get answers, recommendations, and even travel tips.

    Imagine if your brand isn’t popping up in these responses? It’s a bit worrying, right? But here’s the big question—can we actually sway these outcomes? And, crucially, what strategies can improve your brand’s presence and visibility?

    This is where structured experimentation truly shines. Unlike haphazard strategies, prompt-level SEO demands repeatable testing frameworks to pinpoint what really drives those AI responses.

    Build prompt-level SEO tests with a hypothesis framework

    There are no shortages of tips on boosting your brand’s AI presence. However, experimentation is the only way to find what truly resonates with your industry and your brand.

    To this end, I use hypothesis-driven testing to structure experiments for my brands. It’s a systematic approach, one we can replicate across various tests and scenarios.

    This structure breaks down into three parts: if, then, because.

    • If: Establish your hypothesis: what action will be taken?
      • “If we include more granular product specifications in our content.”
    • Then: Predict the result of executing the hypothesis.
      • “Then we anticipate our brand appearing in more product-specific prompts.”
    • Because: Lay out why you believe this outcome will happen.
      • “Because AI models prioritize detailed and specific information in their responses.”

    By sticking to this framework, you not only think through each test carefully but can later verify if specific elements have been previously tested, what theories were applied, and what results emerged. It’s beneficial, especially as the AI landscape evolves.

    After all, as the AI model world changes, the validity of the test elements may merely shift—altering the “because” portion of our framework.

    Your customers search everywhere. Make sure your brand shows up.

    The SEO toolkit you know, plus the AI visibility data you need.

    Start Free Trial
    Get started with
    Semrush One Logo

    Key considerations before running prompt-level SEO tests

    Before jumping into best practices for testing, here are some essential considerations for running these experiments:

    • Model updates: AI models are frequently updated. As models transition from versions like 4.1 to 4.2, revisit your results—understand how these updates affect both inputs and outputs.
    • Prompt drift: Have you ever rerun an identical prompt twice on the same day? Often, the outcomes vary. Repeating prompts consecutively helps establish a real baseline. It’s quite similar to the variability seen in personalized search results. While brands adjust to this variance, certain averages become the benchmark, and prompt testing functions much the same way.

    With the framework in mind, let’s explore the core elements of tests applicable to prompt-specific scenarios.

    How to isolate variables: A methodological approach

    Creating reliable prompt-level SEO experiments involves isolating a single causal variable. This ensures that any changes in AI responses are confidently linked to a particular action.

    1. Content changes

    When you’re experimenting with content modifications, ensure the changes are precise. A common mistake is updating too much simultaneously (for example, changing a product description while altering the page’s schema).

    • Best practice — The single-paragraph swap: Focus on changing a single, specific piece of text on the page, such as a product description or an FAQ answer.
    • Methodology: For proper isolation, conduct A/B testing with a control page that holds the original content and a test page with the modified content. Design the prompt to target the changed information. Track the brand’s inclusion rate and response position over a set period, like seven days.
    ```json
{
  "alt": "The CapmatchOne logo with a gradient circle and bold text.",
  "caption": "Discover innovation with the CapmatchOne logo, featuring sleek typography and a modern gradient circle.",
  "description": "The CapmatchOne logo features bold, modern typography coupled with a gradient circle, symbolizing connection and innovation. The sleek design conveys a sense of progress and creativity. This image can be used for branding or promotional purposes, appealing to audiences interested in innovative solutions and forward-thinking designs."
}
```

    2. Structured data

    Structured data, or schema, delivers clear signals to search engines and AI models. Testing this means isolating the schema update as the only change to the page.

    • Variable isolation: Experiment by adding new properties (such as brand, model, or offer details) without changing the visible HTML text, isolating the machine-readable layer’s impact.
    • Specific experiment — FAQ schema: A highly successful strategy involves adding FAQ schema to pages that already have Q&A sections in HTML, indicating the explicit schema markup’s effect on AI ingestion.

    3. Before-and-after prompt testing

    This method establishes a strict baseline, introduces a change, and then repeats the prompt query. It functions as a critical control technique when true A/B testing on the AI model isn’t feasible.

    Protocol
    • Phase 1 (baseline): Execute 5-10 target prompts daily over seven consecutive days to develop a comprehensive average of inclusion and position-in-response, also accounting for prompt drift.
      • Action: Implement the isolated change, such as a content or schema update.
    • Phase 2 (measurement): Re-run the identical set of prompts daily over the next seven days.
      • Analysis: Compare the average inclusion rate and position from Phase 1 to Phase 2, a method essential for initial presence score analysis, such as using 25 keywords and prompts across three buckets totaling 75 queries.

    Encouraging reproducible experiments

    Given the rapid development of AI models and limited model insights, reproducibility can be a challenge. However, the aim is to transition from single successful experiments to constructing a durable methodology.

    Mandatory frameworks

    Ensure every test is meticulously documented using the “if, then, because” hypothesis structure. This process archives the premise, action, and expected result, enabling future teams to quickly assess a test’s ongoing relevance as AI models change and evolve.

    Technical integrity

    • Version control: Record the specific model and version used in tests (e.g., “Gemini 4.1.2”), which simplifies comparison following a model update.
    • Prompt libraries: Maintain a well-organized, time-stamped collection of exact prompt queries used during baseline and measurement stages, tracking inclusion rate, position-in-response, and sentiment/framing for each inquiry.

    Infrastructure consistency

    Clearly define the testing environment (e.g., clear browser cache, no login state) and, whenever possible, use APIs or synthetic testing platforms to control for personalization and location bias, similar to managing personalized search results in traditional SEO.

    See the complete picture of your search visibility.

    Track, optimize, and win in Google and AI search from one platform.

    Start Free Trial
    Get started with
    Semrush One Logo

    The essence of effective prompt-level SEO lies in its rigorous methodology. By embracing a hypothesis-driven mindset, precisely isolating variables, and establishing robust before-and-after testing protocols, you can leave speculation behind.

    Following these guidelines, we can pave a clear path toward significantly influencing AI model responses through controlled, thoroughly documented, and reproducible experiments.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Unleashing Data-Driven Insights with Profound’s Prompt Research Reports

    Unleashing Data-Driven Insights with Profound’s Prompt Research Reports

    I’m excited to introduce you to a game-changing development in the world of research and data analysis. With Profound’s Prompt Research Reports, I have the power to pull insights from a staggering 1.5+ billion real user prompts. This transformative tool utilizes a proprietary ranking and clustering model, paving the way for data-driven decision making. Now, I no longer have to rely on guesswork when choosing prompts.

    The system we use classifies and ranks user prompts, enabling me to access the most relevant data quickly and efficiently. This innovation not only optimizes my research process but also significantly enhances its accuracy and impact. By integrating such cutting-edge technology, I am able to stay ahead of the curve and meet my data needs with precision.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • Unlocking ChatGPT’s Shopping Trigger Secrets

    Unlocking ChatGPT’s Shopping Trigger Secrets

    I recently embarked on a fascinating journey to explore how ChatGPT’s Shopping feature is activated. It’s intriguing how product categories seem to play a more significant role compared to purchase intent language.

    In my analysis of 1.18 million prompts, supported by a detailed review of 7,500 labeled examples, I discovered a notable pattern. Prompts that specifically mention shippable consumer goods are highly likely to trigger Shopping cards. However, prompts about software, services, travel, and financial products almost never have the same effect.

    I noticed that adding specific constraints, like price, features, or intended use, boosted the chances of the Shopping trigger, though only within the confines of product categories.

    The process boils down to a straightforward rule: if the primary noun in your prompt is something you could easily buy on Amazon, there’s a good chance the Shopping feature will appear. Using this logic, I developed a classifier that can replicate ChatGPT’s Shopping behavior with an impressive accuracy of around 95–97%.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • Transforming SEO: The Shift from Keywords to Infinite Prompts

    Transforming SEO: The Shift from Keywords to Infinite Prompts

    The infinite tail- When search demand moves beyond keywords

    AI search expands the long tail into a multitude of prompt variations. Let me guide you through how fan-out queries, grounding, and task completion are reshaping SEO.

    When I speak naturally, my language flows. It’s often messy, incomplete, and not always coherent. In contrast, the Google search bar made me condense my needs into short-tail or long-tail queries.

    To navigate this, I would stack queries along a journey, refining them from A to B by stripping out personal nuances to suit what I thought the search engine could grasp. SEO experts built strategies around this, organizing queries by search volume and intent.

    That’s evolving now. With Google promoting Gemini and companies like Samsung highlight AI features as key selling points, the landscape is shifting. I’m encouraged to be more expressive and detailed with my searches.

    Long-tail query on Google search bar

    Moving from Keyword Research to Prompt Research

    We need to transition from keyword research to prompt research. Traditionally, keyword research involved quantifying demand and optimizing at a phrase level. The new AI-driven search environment calls for understanding demand as generative concepts, preserving needs across numerous prompt formats.

    This shift doesn’t render keyword research obsolete, but changes its scope. I’m learning to model user journeys, considering decision stages and user uncertainty, rather than just relying on search volume.

    What I get from this isn’t merely a keyword map, but a task map reflecting real audience constraints. This signifies a shift from short and long-tail keywords to an infinite tail of prompt research.

    ```json
{
  "alt": "Two people intimately close, one touching the other's face, overlaid with a search query on a sunset backdrop.",
  "caption": "A moment of intimate connection as one person gently touches another's face, set against the backdrop of dreams of adventure and techno beats.",
  "description": "The image features two individuals in a close, intimate pose, with one gently holding the other's face. Overlaid is a search query about a solo holiday in Asia, yoga meditation, and techno clubs, suggesting a desire for adventure and connection. The background is a serene sunset, enhancing the theme of longing and exploration."
}
```

    Dig deeper: Why AI optimization is just long-tail SEO done right

    @media (max-width: 768px) {.headline-responsive {font-size: 30px !important; line-height: 1.3 !important;}}

    The Infinite Tail as a Behavioral Shift

    The infinite tail is more than just an expansion of the long tail. It’s about personalization at each request. Users, like me, are layering contexts and preferences, creating unique prompt combinations.

    As Ai systems evaluate these prompts, they predict responses probabilistically, shifting away from exact-match keywords. Now, it’s not just about ranking for specific phrases but ensuring my content solves the user’s problems.

    In this journey, finding what users truly seek is as crucial as completing a task. With divergent user paths, flexibility replaces rigid step-by-step processes.

    Dig deeper: From search to answer engines: How to optimize for the next era of discovery


    Fan-out and Grounding Queries

    Query fan-out is crucial in AI search. It breaks complex prompts into subquestions, enabling a deeper evaluation framework.

    Content now needs to satisfy clusters of queries instead of single matches. Covering multiple dimensions of a task creates resilience in this network-centric world.

    ```json
{
  "alt": "The CapmatchOne logo with a gradient circle and bold text.",
  "caption": "Discover innovation with the CapmatchOne logo, featuring sleek typography and a modern gradient circle.",
  "description": "The CapmatchOne logo features bold, modern typography coupled with a gradient circle, symbolizing connection and innovation. The sleek design conveys a sense of progress and creativity. This image can be used for branding or promotional purposes, appealing to audiences interested in innovative solutions and forward-thinking designs."
}
```

    Grounding queries ensure AI answers are validated against the broader web, checking consistency and reputability across sources. For my content to be part of AI responses, it must seamlessly fit this network.

    This evolution redefines authority in how corroborated content appears over technically manipulated content. It emphasizes structure, data consistency, and external validation, significantly easing an AI system’s decision-making process by reducing uncertainty.

    Dig deeper: The authority era: How AI is reshaping what ranks in search

    Designing for Hybrid Search

    Organic search remains integral. It still dictates discovery and influences crawlability. However, AI now layers on top, impacting which brands feature in conversational responses. It’s a blend where organic visibility and AI selection coexist.

    In this hybrid mode, the infinite tail favors genuine audience understanding, where my content should be designed to satisfy users’ situations instead of merely matching keywords.

    This isn’t just a process renamed from keyword research to prompt research. It’s about understanding search motivations, decision-making, uncertainties, and evidential needs, fostering the infinite tail by prioritizing task completion over string matching.

    Dig deeper: How to use AI response patterns to build better content


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot