Tag: Methodology

  • Why My Original Data Gets Cited Only as Benchmarks

    Why My Original Data Gets Cited Only as Benchmarks

    In Part 1, I looked at the third-party citation signals that matter so much for AI visibility. In Part 2, I made the case for publishing original data, because it is the strongest single predictor of page originality, and the barrier to earning visibility and authority through this approach is still surprisingly low.

    Now I have more evidence for why proprietary data should be part of content creation.

    Publishing a number matters, but the number itself is not always what gets cited. I looked at Gauge’s citation data to understand what AI systems actually reward when brands publish first-party data. The answer is narrower, sharper, and more useful than simply saying, “original data wins.” Original data does win, but only when it is packaged in the right way.

    The format AI rewards most is the benchmark that answers a clear commercial question: which option is best?

    First-party research is scarce and punches above its weight

    I worked from Gauge’s cited-URL set: 301 live pages cited by AI systems across 316 unique prompts and 7 verticals. Together, those pages carried 1,075 citations.

    After auditing the URLs, I found that only 8 of the 301 pages qualified as primary research. To count, the page had to include the original source of the data and its methodology, rather than simply writing about someone else’s numbers.

    That means primary research made up just 2.7% of the cited set. But those same 8 pages earned 90 of the 1,075 citations, or 8.4% of the total citation volume. In other words, first-party research appeared rarely, but when it appeared, it over-indexed by roughly 3x on citation share.

    The cleaner way I see this is citation density.

    Primary research averaged 11.3 citations per page. Everything else averaged 3.4 citations per page. A primary-research page was 3.3x as citation-dense as a non-primary page.

    Bar chart showing primary research earns 11.3 citations per cited page versus 3.4 for other pages, a 3.3x citation advantage.
    Primary research is rare, but this Gauge analysis shows it punches above its weight: cited pages with original research averaged 3.3x more citations than everything else.

    That is the compounding effect of primary research.

    This mirrors the information gain finding I discussed in Part 2, but from the AI citation side rather than the classic 10 blue links side.

    There, original data correlated with page originality more strongly than any other trait. Here, original data correlates with citation density. Both findings point in the same direction: the number only you can produce is the lever.

    Original research wins when the question has a benchmark

    This is where the “original data wins” idea needs more precision.

    The 90 primary-research citations were not distributed evenly across the 8 pages. They were not distributed evenly across topics either.

    Of those 90 citations, 75 came from one cluster: cloud data warehouse benchmarks. Fivetran’s warehouse benchmark alone earned 44 citations, which was just under half of every primary-research citation in the set.

    Once I strip out the benchmark cluster, first-party research barely registers in the citation set. The win is not simply, “I published original data.”

    The real win is, “I published a benchmark that answers a buying comparison,” and almost nobody builds those well. By benchmark, I mean a page that measures a set of named things against each other on a specific yardstick and publishes the results as numbers.

    Bar chart showing data warehouse benchmark pages earned 75 of 90 primary research citations, led by Fivetran benchmark with 44 citations.
    A striking citation split: cloud data warehouse benchmarks dominated AI-cited primary research, with Fivetran’s benchmark alone pulling 44 citations from the 90-citation set.

    Original research is most powerful when it directly answers commercial comparison queries.

    This is also what Google is pushing toward with non-commodity content: new, helpful information that is hard to get elsewhere.

    The primary-research citations clustered where prompts asked AI to compare options on measurable specs such as speed, cost, latency, yield, or performance.

    That explains the warehouse benchmark spike. The “HR Tech / Compensation” label was noisy, but the citations inside that bucket mostly came from cloud data warehouse benchmark prompts. Fivetran, Estuary, and ClickHouse had numbers AI could use.

    Crypto / Solana showed the same pattern at a smaller scale. Marinade and Helius earned citations because staking and MEV questions need firsthand ecosystem data, not generic explainers.

    The pattern disappeared in topics without a clear benchmark. B2B SaaS / CRM, Education / TEFL, and Product Analytics returned listicles, product pages, explainers, and case studies. After cleaning the data, I found no cited primary-research page in those topics.

    A closer look at the content that held 44 citations

    Fivetran’s warehouse benchmark took 44 citations from this dataset on its own. Fivetran’s 2 benchmark pages together took 58 of the 90 primary-research citations. So I wanted to understand why.

    The page was published in 2022, but when I examine it, it is easy to see why LLMs still prefer it.

    Bar chart showing primary-research citation share by topic, led by HR Tech/Comp Mgmt at 24.1% and Crypto/Solana at 10.7%.
    Primary-source visibility is highly concentrated: benchmark-driven topics like HR tech and crypto attract far more AI citations than explainers or listicles.

    It answers a measurable comparison head-on. The page names BigQuery, Redshift, Snowflake, and Databricks, then ranks them on speed and cost. It is entity-rich and willing to name the major players directly.

    It runs on real first-party data. Fivetran tested against actual customer usage rather than relying on synthetic assumptions, and the page calls that choice out clearly.

    It shows the method step by step. The page walks through what data was queried, which queries were used, and how each warehouse was configured and tuned. A reader, or a model, can see how the numbers were produced.

    The structure is easy to lift. Descriptive headings such as “Results,” “How much did performance improve?,” and “Why are our results different from previous benchmarks?” help AI map a question to the exact passage that answers it.

    It links to raw data and sources. The page footnotes references, including the C-Store paper, and points to the underlying data. That makes the claims verifiable. Few brands put that much work into a data-backed content piece, and even fewer share the full dataset for transparency.

    It shows its limits. Dated correction notes from December 2022, named qualitative limitations, and an honest “performance floor” caveat make the claims more credible, not less. The corrections also show care.

    The URL never moved. A page from 2022 is still earning citations in 2026 because it stayed live at one canonical address.

    The data behind a page like this is easier to pull and analyze than it has ever been. The hard part is everything around the data: the clean method, linked sources, corrections, navigable structure, and willingness to say what the numbers do not prove. That is the craft, and that is the moat.

    Screenshot of Fivetran's Cloud Data Warehouse Benchmark article with author George Fraser and data warehouse graphic.
    Fivetran's 2022 benchmark page shows why clear, comparison-led research can become a lasting citation source for AI and search visibility.

    This kind of first-party data content is not a thin press release with a few loosely pulled numbers. It requires real work, and it can hold authority for years. My takeaway is simple: AI does not reward “original data” by default. It rewards first-party research when the page gives a clear answer to a measurable comparison and signals depth, expertise, and trust.

    The opportunity is to publish a retrievable dataset for a buyer question where AI does not yet have a clean benchmark source. That connects directly to the unanswered-questions finding from Part 2. The opening exists, but in many verticals, nobody has walked through it with a real dataset.

    Original data needs a citation-ready package

    Original data gives a page something AI cannot get from another explainer. But AI still has to retrieve it, parse it, and map it to the user’s question.

    That is where many brands lose the citation. They publish proprietary numbers, but bury them in narrative, gate them behind forms, move the URL, or skip the methodology. The data exists, but the citation never happens.

    The pages that won in this dataset had both ingredients: original numbers and a clean citation shape. They had stable URLs, clear methods, named comparisons, and results that answered buyer questions directly.

    Who wins: brands with proprietary product, usage, or pricing data that package it into a comparison a buyer can act on, especially one that can inform LLM-generated recommendations.

    Who loses: brands that publish original numbers inside dense narratives, on slow or unstable pages, with no clear comparison frame for AI to retrieve and reuse.

    When I think about a citation-ready research page, I look for four parts.

    Futuristic data archive with glowing server-like filing cabinets, stacked documents, and network lights symbolizing AI marketing data infrastructure.
    Rows of illuminated data cabinets and paper files stretch into the distance, capturing the pressure on marketers to turn fragmented customer data into a smarter performance engine.

    Lead with the comparison result. The headline finding, such as “X is fastest” or “Y is cheapest at scale,” should appear in the first 30% of the page. Lead with the result, then explain the method and nuance.

    Box the methodology. Show the sample, time window, what was measured, and how the measurement happened. Attribution confidence is part of what makes a number citable, so the method needs to be clear on the page.

    Frame the comparison explicitly. AI reaches for benchmarks when prompts ask “which is best.” A table comparing named options on named specs is the format most likely to be lifted.

    Keep the URL stable. Use one canonical page and keep it live. Do not migrate it or rename it every redesign. The citation earned this quarter only compounds if the page is still there next quarter. In this dataset, 64 of 365 cited URLs were dead, redirected, or otherwise broken, taking 203 citations down with them.

    This is the work behind a citable benchmark, and it is more involved than it looks.

    HockeyStack documented its own version in a playbook on launching research reports. The company published 18 original reports built entirely on anonymized first-party customer data, the kind of data no competitor could replicate.

    Its process includes the same steps the Fivetran page demonstrates: list the data points needed, have a teammate pull them with SQL, define and document the method so the numbers can withstand scrutiny, and structure the report around a real ICP question. HockeyStack calls methodology non-negotiable because without it, someone will always dispute the data.

    With AI analysis, pulling the data is often the easier part now. Building the content into something citable, trustworthy, and durable enough to keep earning visibility for commercial queries years later is where the harder work sits.

    What sites are already trusted for your topic? When a benchmark you did not publish is earning the citations in your category, the Citation Source Mapper can map that trusted set into a ranked, pitchable target list. It is available in the premium library.

    This post first appeared on the author’s website and is republished here with permission.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Why I Run Each Prompt Once Daily: The Data Behind It

    Why I Run Each Prompt Once Daily: The Data Behind It

    I often get asked why I “only” run each prompt one time per day.

    For me, the answer comes down to signal quality. Running a prompt once daily gives me enough consistent data to understand performance without overloading the process with unnecessary repetition.

    The statistics show that a single daily run is plenty. It gives me a reliable view of how prompts behave over time, while keeping the workflow focused, efficient, and easier to interpret.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • 3 Key Elements Your SEO Audits Can’t Succeed Without

    3 Key Elements Your SEO Audits Can’t Succeed Without

    AI can elevate SEO and GEO audits dramatically, but only if you equip it with the right data, methodology, and human oversight.

    As someone deeply involved in the world of B2B tech SEO, I find it fascinating how AI is reshaping our strategies. However, I’ve noticed a trend among clients who provide AI-generated audits—what I term ‘naive audits.’ While these reports often appear detailed, they miss crucial components. When I inquire about their basis, data sources, or methodology, they frequently crumble under scrutiny.

    ```json
{
  "alt": "Text discussion about the keyword intelligent data tiering and its search volume.",
  "caption": "A candid exchange on keyword research: Is 'intelligent data tiering' the right choice without knowing its search volume?",
  "description": "This image captures a dialogue about keyword research focus on 'intelligent data tiering.' The highlighted response reveals an admission of uncertainty about its search volume, emphasizing the importance of verifying keyword data before recommendation. This discussion highlights the dynamics of digital marketing and SEO strategies."
}
```

    This gap between expectation and delivery inspired me to propose a simple framework focusing on three critical elements—context, methodology, and human oversight—to ensure AI-driven audits provide genuine value.

    ```json
{
  "alt": "SEO blog analysis with a coffee-themed header and list of audit items.",
  "caption": "Grab a cup of coffee and dive into optimizing your blog’s SEO strategy with these tailored recommendations in the face of the Flash Storage Crisis.",
  "description": "This image features an SEO blog analysis themed around coffee time. The content outlines strategies for improving blog rankings, focusing on the Flash Storage Crisis. Key audit items include meta data, keyword placement, and content structure. The design includes elements like the Agile SEO toolbar and Opus 4.7 settings for adaptive layout adjustments, making it ideal for digital marketers looking for SEO insights."
}
```

    Imagine asking an advanced language model, like Claude or ChatGPT, to perform a simple SEO task, such as optimizing a blog post. The result? A 1,600-word detailed analysis filled with assumptions and errors, due to lack of access to the full content or appropriate keywords. Sounds familiar, right?

    ```json
{
  "alt": "Document outlining an SEO audit for a blog post on the flash storage crisis.",
  "caption": "Delve into an insightful SEO audit detailing strategies for enhancing a blog post on the flash storage crisis, set to gain traction by 2026.",
  "description": "This image displays an SEO audit for a blog post titled 'Flash Storage Crisis'. The audit highlights a narrative focused on the 2025-2026 anticipated price surge in NAND/flash due to AI demand. It examines competitive pressure from other companies and suggests improvements in keyword targeting, internal linking, and strengthening E-E-A-T signals. Key strategies include emphasizing 'intelligent data tiering' and addressing related secondary keywords like 'flash storage crisis' and 'enterprise SSD price increase 2026'."
}
```

    Despite the capabilities of models like Claude, I discovered severe limitations. For instance, it couldn’t read the original article, basing its recommendations on search snippets instead. Not only was the suggested keyword, ‘intelligent data tiering,’ void of search volume, but the analysis itself was flawed as well.

    ```json
{
  "alt": "Document on keyword placement with issues and a recommended map.",
  "caption": "Explore strategic keyword placement with this insightful analysis, highlighting key issues and offering a detailed recommendation map for effective SEO.",
  "description": "This image presents a document discussing keyword placement strategies. It identifies issues with keywords like 'Intelligent data tiering' and 'Flash storage crisis,' recommending strategic placement in titles, subheads, and body text. A map suggests using primary and secondary keywords in specific sections such as H1 and the first 100 words. Keywords include 'automated data tiering' and 'Flash and HDD hybrid storage architecture diagram.' Essential for improving article SEO."
}
```

    Ensuring an audit is grounded in reality requires agents that are self-sufficient and well-informed. They must include an understanding of content, an appropriate methodology, and concise, actionable recommendations. I believe in empowering busy writers by offering bite-sized guidance rather than overwhelming them with lengthy reports.

    ```json
{
  "alt": "Content structure and headings section detailing a strategic response to a flash storage crisis",
  "caption": "Revamp your content structure with strategic data tiering insights to tackle the flash storage crisis effectively. Dive into the intricacies of intelligent tiering.",
  "description": "This image presents a structured breakdown of content headings related to addressing the flash storage crisis through intelligent data tiering. It highlights the importance of organized H2 and H3 headings for SEO optimization. The recommended headings include topics such as flash storage crisis, all-flash architectures, and intelligent data tiering's relief strategies. Designed for content creators aiming for SEO-friendly and well-organized content strategies."
}
```

    When building a page audit agent, I follow these essential steps: pre-scraping webpage content, leveraging keyword tools, accessing top URLs for key queries, and aligning recommendations with structured content outlines—all while maintaining a human in the loop to ensure accuracy and practicality.

    ```json
{
  "alt": "Screenshot discussing issues in fetching the full text of a blog post, highlighting missing sections and errors due to robots.txt restrictions.",
  "caption": "A detailed account of challenges faced when retrieving a full blog post due to technical limitations, emphasizing the obstacles like robots.txt and missing metadata.",
  "description": "This image is a screenshot outlining difficulties encountered when attempting to access the complete text of a blog post. Key points include failed attempts due to robots.txt restrictions and reliance on incomplete search result snippets. The list highlights missing elements like the H2/H3 structure, full middle sections, and metadata. These gaps led to educated guesses rather than confirmed observations, as detailed in the subsequent text. The content reflects on the challenges of conducting an effective blog audit under such constraints."
}
```

    So, when asking AI to execute GEO/AEO audits, one must be cautious of potential pitfalls. The knowledge base for AI in these emerging fields is riddled with speculative insights and inconsistent data. That’s why partnering with experts actively engaged in experimentation remains invaluable.

    ```json
{
  "alt": "Text discussing the keyword 'intelligent data tiering' and its search volume.",
  "caption": "Exploring the search volume of 'intelligent data tiering' and why it might not be the best primary keyword choice.",
  "description": "This image captures a discussion about the keyword 'intelligent data tiering' lacking search volume data due to the absence of a keyword research tool. It's suspected to be a low-volume, vendor-coined phrase, unlikely to exceed 50 monthly searches in the US. The conversation suggests alternative keywords like 'data tiering' and 'storage tiering' which could have higher search volume."
}
```

    Ultimately, my CaML framework—short for Context, Methodology, and Human in the Loop—ensures that AI audits are comprehensive and substantial. Just as a camel is equipped to withstand the harsh desert environment, a well-prepared AI agent should be resilient to the challenges of digital landscapes.

    ```json
{
  "alt": "SEMrush keyword overview for 'intelligent data tiering' showing no available data.",
  "caption": "Discover the insights you need! This SEMrush screenshot attempts to provide keyword data for 'intelligent data tiering,' although no actionable stats are available.",
  "description": "This image is a screenshot from the SEMrush platform displaying a keyword overview for 'intelligent data tiering.' It shows the interface with fields such as Volume, Global Volume, Intent, CPC, and Keyword Difficulty, all marked as 'n/a' indicating no data is available. This tool is used for SEO analysis and keyword research, highlighting user-friendly elements like bulk analysis and export options. Ideal for understanding keyword performance metrics and trends."
}
```

    Envision a future where SEO roles are redefined, focusing on strategic guidance and unique insights rather than laborious manual tasks. Our agency’s transition to an agent-first model embodies this shift, and I’m excited to be on this transformative journey.

    ```json
{
  "alt": "Highlighted text discussing search queries and data tiering in SEO analysis.",
  "caption": "Diving into SEO strategies: An honest reflection on search method challenges and the nuances of data tiering.",
  "description": "The image showcases a text passage discussing SEO analysis strategies. Key phrases are highlighted, focusing on tactics for studying search engine results pages (SERP) without directly accessing Google’s top results. Instead, related queries are explored, but results lack Google's ranking order, reflecting a mix of insights for competitive analysis. Keywords such as 'intelligent data tiering' and 'search provider' emphasize the complexity of SEO work."
}
```

    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot