Author: shivamcrushpressai

  • Discover the Revamped Profound Index: AI Search Leaderboard

    Discover the Revamped Profound Index: AI Search Leaderboard

    I’ve got some exciting news to share! I’m thrilled to introduce the revamped Profound Index, your go-to leaderboard for AI Search. This update marks a new era in search, providing both clarity and authority in the rapidly evolving world of AI-driven solutions.

    In this rebuild, we focused on enhancing the user experience and performance metrics. Whether you’re an AI enthusiast or a professional seeking the latest insights, the improved Profound Index is designed with you in mind. Its comprehensive data sets and intuitive interface make it an indispensable tool for anyone looking to stay ahead in the realm of AI Search.


    Inspired by this post on Try Profound Blog.


    crushpress.ai community screenshot
  • How AI Blends Paid and Organic for Supreme Brand Visibility

    How AI Blends Paid and Organic for Supreme Brand Visibility

    When I think about how artificial intelligence is revolutionizing advertising, a common belief is that AI is killing advertising. But, in reality, AI is not the end of advertising; it’s merely transforming it into new dimensions. With AI seamlessly integrating into search, assistants, productivity tools, and beyond, it’s only natural for advertising to follow suit.

    I’ve noticed that while the density of ads may shift in AI-led experiences, the opportunities for advertising are actually broadening. There are new surfaces emerging continuously, and they all offer exciting chances for advancers and advertisers alike.

    ```json
{
  "alt": "Diagram illustrating three modes of user and agent control with corresponding ad densities: Search, Assistive, Agentic.",
  "caption": "Explore the control gradient: from user-driven search to AI-led decisions, see how ad density shifts across Search, Assistive, and Agentic modes.",
  "description": "This diagram showcases three control modes between users and AI agents: Search, Assistive, and Agentic. Accompanied by a gradient from high to low ad density, it illustrates the levels of control from user-centric searches to AI-determined outcomes. The 'Search' mode grants users full decision authority, 'Assistive' shares control between AI and users, and 'Agentic' relies on AI for decision-making, minimizing user intervention. Perfect for understanding how control dynamics affect ad placement."
}
```

    To me, the divide between paid and organic isn’t as clear-cut anymore. The same AI systems powering search experiences are also driving ad campaigns and influencing brand visibility across Google’s expansive ecosystem.

    ```json
{
  "alt": "Diagram illustrating how the same AI runs both organic and paid marketing strategies through a system called Gemini.",
  "caption": "Harness the power of Gemini: Train your AI once and optimize both your paid and organic marketing strategies seamlessly.",
  "description": "This image presents a diagram that demonstrates how the Gemini system integrates AI to manage both paid and organic marketing strategies. The AI uses explicit signals for paid data and implicit behavior signals for organic data. By training Gemini once on the paid side, the organic strategy automatically benefits. The image includes the tagline, 'Train it once, win twice,' underscoring the efficiency of this dual approach. Relevant keywords include AI, marketing, Gemini system, paid and organic strategies."
}
```

    This calls for a change in how we brands perceive visibility. Paid and organic aren’t just isolated competitors vying for clicks; instead, they’ve become alternative strategies influencing the same AI systems. As a result, the signals that shape organic visibility may also impact paid performance.

    ```json
{
  "alt": "Diagram illustrating AI's role in a marketing funnel: Awareness, Consideration, Decision stages, with paid acceleration.",
  "caption": "Unlock marketing success with AI-driven strategies, optimizing every funnel stage from awareness to decision-making with accelerated results.",
  "description": "This image presents a marketing funnel highlighting AI's impact on three key stages: Awareness, Consideration, and Decision. AI advocates for creating the right audience connection, recommends above competition, and closes deals effectively. The funnel is further enhanced by a 'Paid Acceleration' feature that speeds up results across all stages. The diagram is strategically designed to visually represent the benefits of integrating AI in marketing strategies, aiming for both organic reach and paid promotion."
}
```

    The traditional search engine results page (SERP) we once knew, consisting of 10 blue links, a handful of ad slots, and a side panel, no longer holds the same dominance. Back then, dedicated teams managed paid and organic strategies separately, each with its own set of tools and quarterly goals.

    ```json
{
  "alt": "Diagram illustrating taxes and discounts in paid AI search, highlighting mistrust and intent taxes, and confidence discount.",
  "caption": "Understanding Gemini: Navigate AI search costs by reducing mistrust and intent confusion to achieve confidence discounts.",
  "description": "This image depicts a flowchart on taxes and discounts in paid AI search. It outlines the costs of mistrust and intent confusion as 'CPC premium', 'Message distortion', 'Wasted spend', and 'Lost cohort training'. Aligning intent reduces these taxes, leading to a 'Confidence Discount' with benefits like 'Lower CPC' and 'Cleaner creative'. It's a visual guide to optimizing AI search strategies for better financial efficiency."
}
```

    Things changed for me when Dynamic Search Ads (DSA) appeared, using my website’s content to cleverly create ad titles and determine bids, merging the lines between our organic strategies and paid efforts.

    Stepping into the modern age, Performance Max (PMax) campaigns took the very logic of DSAs and applied it across every Google surface—importantly altering how ads are placed from Search and YouTube to Maps and more.

    Of course, it isn’t without its nuances. If Google’s Gemini doesn’t have a thorough understanding of our brand, the system has to fill the gaps with assumptions, which may not align with our intended brand narrative. It’s crucial to train these AI systems deliberately, or we risk losing control.

    Strategically, I’ve come to realize that paid campaigns help me discover which target audience-intent-profit combinations convert best. I can then build my organic content around these successful elements, creating a feedback loop where each strategy amplifies the other.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Enhance Your B2B Ads: Microsoft Adds LinkedIn Job Seniority Targeting

    Enhance Your B2B Ads: Microsoft Adds LinkedIn Job Seniority Targeting

    I recently discovered some exciting news from Microsoft Ads that could be a game-changer for advertisers like myself. They’ve expanded their LinkedIn targeting capabilities to include job seniority filters. This allows me to target audiences with more precision in both Search and Audience campaigns.

    This new feature means that I can now target users based on their job seniority, a wonderful addition for those of us focusing on B2B marketing. Thanks to LinkedIn data, I can reach audiences at various levels of seniority.

    What’s the scoop? According to Navah Hopkins, Microsoft Advertising has added job seniority targeting to its LinkedIn Profile targeting, allowing me to utilize it within Search and Audience campaigns.

    This update provides me the ability to choose from 10 different seniority levels, ranging from CXO to Volunteer. This flexibility is available at both the campaign and ad group levels, making it easier to segment my audiences effectively.

    Why is this vital for us? In the world of B2B marketing, it’s often challenging to separate decision-makers from operational staff in search campaigns. With this new job seniority targeting, I can better align my messaging and bidding strategies with the right audience segments, ultimately improving my campaign performance.

    Understanding who is interacting with my ads is crucial, especially in organizations with long sales cycles or multiple stakeholders. It’s not just about conversions; it’s about knowing who is behind them.

    A closer look: Unlike other platforms, Microsoft’s integration with LinkedIn provides a unique perspective of professional identity that allows me to better understand user interactions.

    Not only can I apply these filters directly within my campaign settings, but I can also utilize them in observation mode to gather insights without limiting my reach.

    ```json
{
  "alt": "Job seniority settings showing target options with bid adjustments.",
  "caption": "Explore job seniority targeting with adjustable bid settings for optimized results.",
  "description": "This image displays job seniority targeting settings used in digital marketing platforms. It lists various seniority levels like Owner, Partner, CXO, VP, Director, Manager, Senior, Entry, Training, and Volunteer, all with 'Targeted' status and bid adjustments set to 'Increase by 0%'. The interface allows users to adjust bidding for each seniority level to enhance campaign effectiveness. Keywords: job seniority, targeting, bid adjustment, digital marketing."
}
```

    How do I benefit?

    Customize messaging by seniority: I can create targeted ad groups for different audience levels, like executives or individual contributors, tailoring my messaging to each group’s expectations.

    An executive-focused strategy might highlight business growth, while campaigns targeting practitioners could focus on efficiency gains.

    Analyze conversions by seniority: Observation mode helps me assess conversion performance across different seniority levels, answering questions crucial to my strategy:

    Where are my conversions coming from? Are they decision-makers or influencers? Is my budget effectively spent? Which seniority levels bring in high-quality leads?

    Enhance audience testing: This feature offers an extra layer of reporting, helping me make informed optimization and expansion decisions. If I’m importing from other platforms, this insight is invaluable for discovering performance patterns unique to Microsoft Ads.

    Availability: This powerful tool is now accessible in select markets across the Americas, EMEA, and APAC regions, including countries like the United States, Canada, Brazil, and more.

    • Americas: Argentina, Brazil, Canada, Chile, Colombia, and others.
    • EMEA: Egypt, Nigeria, Saudi Arabia, and South Africa.
    • APAC: Australia, India, Japan, among others.

    The takeaway: Microsoft Ads continues to leverage its LinkedIn integration as a standout feature in B2B advertising. By aligning search intent with professional profiles, I gain deeper insights into not just what my audiences search for, but who the searchers are.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Google Ads Adopts CPM Billing for Discover’s Demand Gen Campaigns

    Google Ads Adopts CPM Billing for Discover’s Demand Gen Campaigns

    I recently came across some notable updates from Google Ads that could impact a number of advertisers like me. From July 15, Google is making a big shift in how it charges for Demand Gen campaigns on Discover, specifically those aimed at view-through conversions (VTC). Instead of the traditional cost-per-click (CPC) model, we’ll be billed on a cost-per-thousand impressions (CPM) basis.

    What happened. Google Ads informed me, along with other advertisers, that this shift will directly affect campaigns using VTC optimization. If you’re like me and use this optimization, be prepared for the billing change. This only impacts campaigns with VTC enabled, so if you’re not using it, you’re in the clear.

    Luckily, no action is required on my part for this transition to take place; it’s automatic.

    Why we care. For those of us focused on efficiency in Demand Gen campaigns, this switch could mean we’ll need to closely monitor changes in spend, impressions, and reporting metrics since the basis for billing is changing from clicks to impressions.

    This shift in billing might prompt some of us, who primarily look for click-driven performance, to reassess if VTC optimization aligns with our goals.

    Why Google is making the change. According to Google, aligning billing with campaign objectives is key. View-through conversions rely heavily on ad impressions. Thus, billing on a CPM basis could more accurately reflect the actual value generated from these campaigns.

    ```json
{
  "alt": "Google Ads billing update notice for view-through conversion optimization.",
  "caption": "Google Ads announces changes to billing for Demand Gen campaigns, transitioning to cost-per-thousand impressions for view-through conversions.",
  "description": "This image is an email from Google Ads detailing a billing update for Demand Gen campaigns using view-through conversion (VTC) optimization on the Discover platform. Effective July 15, 2026, the billing method will change from cost-per-click (CPC) to cost-per-thousand impressions (CPM). This update aims to better align billing with optimization goals. Advertisers who wish not to transition can opt-out. Keywords: Google Ads, billing update, VTC optimization, CPM billing."
}
```

    Moreover, Google believes this shift will enhance the system’s ability to optimize for VTC goals more effectively.

    Opt-out option. If the new billing structure doesn’t suit you, there’s an opt-out. Disabling VTC optimization in campaign settings will prevent this change from affecting your campaigns.

    The bottom line. With Google tying payments more closely to the behaviors Demand Gen campaigns are crafted to optimize, those of us leveraging VTC will now focus on impressions rather than clicks for billing and optimization on Discover.

    First spotted. This update first came to my attention through Adsquire founder, Anthony Higman, who shared details on X.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Preventing Google Penalties: The Costly Truth of Recovery

    Preventing Google Penalties: The Costly Truth of Recovery

    Recovering from a manual action is no quick fix; it can take months of rigorous cleanup and multiple reviews. I’ve learned that regular compliance audits are key to avoiding a crisis altogether.

    Google penalties—or manual spam actions—are those unpredictable disruptions that can shake up a thriving online business overnight.

    For businesses like mine that rely heavily on organic traffic, the impact is quite severe. It goes beyond just losing rankings; revenue takes a hit, customer acquisition costs spike, expansion plans are halted, and the effects linger long after the policy issues have been addressed.

    With Google’s consistent 90% market share, it remains my main source of traffic, much like it is for many publishers, e-commerce platforms, and lead generation companies.

    Unfortunately, direct traffic seldom makes up for significant visibility losses, and Bing isn’t enough to fill the gap. This means a manual spam action is not just an SEO risk but a grave operational concern.

    Manual Actions Aren’t Algorithm Updates

    It’s essential for me to clarify that manual spam actions and algorithmic updates are two different beasts. Manual penalties result from specific violations identified against Google Search Essentials and demand entirely different responses.

    Manual actions involve considerable internal review at Google. When violations are suspected and verified, these actions are taken, because proven policy breaches aren’t taken lightly by Google.

    ```json
{
  "alt": "Line graph showing total clicks and impressions over time, with clicks in blue and impressions in purple.",
  "caption": "An insightful line graph displays the trend of total clicks and impressions from February to July 2025, revealing a gradual decline in both metrics.",
  "description": "This line graph illustrates the total clicks in blue and total impressions in purple over several months, from February to July 2025. The graph highlights a significant downward trend in both metrics, with clicks starting at 15K and reducing steadily. The data points are marked daily, with key metrics showing 412K total clicks and 52.3M total impressions throughout the displayed period. This visualization aids in analyzing website performance over time."
}
```

    The real issue lies in recognizing accumulated policy violations over time, something I’ve seen many businesses fail to address adequately.

    How Penalties Develop

    The journey to a manual penalty often begins in non-obvious ways, with compliance erosion happening gradually.

    • An e-commerce company might start with aggressive link-building strategies that accumulate unchecked spam links over the years.
    • A publisher engages in commercial partnerships involving sponsored content, integrating these into their main site structure.
    • A SaaS business expands into new markets with low-quality location pages.
    • Lead generation companies scale supplemental SEO content without thorough editorial oversight, simply adhering to industry standards.

    Though these tactics might initially boost visibility and revenue, they often fall out of line with Google’s quality standards over time.

    Why Historical Violations Still Matter

    Manual spam actions are disruptive partly because old policy violations can persist without being flagged for years. Google doesn’t forget historical footprints in its search system, meaning unresolved past SEO practices can become today’s liabilities.

    Practices like paid placements, commercial guest posting, or directory spam from years ago can remain risks until they’re addressed, creating vulnerabilities that must not be ignored.

    Reputation Abuse and Publisher Liability

    When a trustworthy brand allows unsupervised content from third parties, the site’s credibility might suffer. Once a manual spam action hits, the entire site can lose visibility—even the genuinely valuable sections suffer.

    ```json
{
  "alt": "Line graph showing total clicks and impressions from February to July 2025, with a significant drop in May.",
  "caption": "A data-driven insight: this graph visualizes a sharp decline in clicks and impressions for a website from February to July 2025, highlighting a pivotal change in May.",
  "description": "This line graph represents website performance metrics from February 1, 2025, to July 31, 2025. The blue line shows total clicks, peaking around 3,000 in March, while the purple line displays total impressions, which reach up to 600,000. Both metrics drastically decline after May 2025. Key statistics include 152K total clicks, 18.6M total impressions, an average CTR of 0.8%, and an average position of 12.1, updated daily. Keywords: website analytics, performance metrics, data visualization."
}
```

    Recovery from such penalties is not simple or cheap. It often demands structural changes and more stringent editorial and technical controls, as I can attest from my own experiences.

    The Risks of Scaled Content

    Google is now more vigilant about large-scale publishing systems that lack originality and value. I’m aware of how easily businesses, unintentionally, slide into creating repetitive, low-value content.

    • Affiliate networks proliferating nearly identical comparison pages.
    • Local SEO operations using cookie-cutter service pages across numerous regions.
    • AI-driven workflows publishing large amounts of unfounded information.
    • Mass-produced travel destination content lacking unique insights.

    Most businesses don’t cross these lines deliberately. However, without ongoing reviews and updates, significant issues can fester under the radar.

    Compliance Requires Ongoing Oversight

    For me, regular compliance reviews are non-negotiable. It takes external expertise to assess true compliance comprehensively. Even powerful internal SEO teams can miss potential exposure points if left unchecked.

    I’ve found that organizations integrating compliance into governance see considerable advantages. Regular audits and assessments can preempt violations and protect critical search traffic, especially during pivotal business moments.

    In essence, prevention through regular audits is a more efficient and less painful approach than dealing with recovery after a penalty.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Discover Bing’s AI Reporting Revolution: Intents, Topics & More

    Discover Bing’s AI Reporting Revolution: Intents, Topics & More

    Today, as I explore updates from Microsoft, I’m excited to share that Bing Webmaster Tools is rolling out a preview of its new AI performance report enhancements. These include insights like Intents, Topics, Citation Share, and Compare, and they’re being introduced globally. After witnessing Microsoft’s demo in April, it’s thrilling to know these features are finally accessible to us.

    Reflecting on their past roll-outs, Bing officially launched its AI performance report earlier in February, a bold move ahead of Google’s similar feature which wasn’t available in Search Console until June. Google’s delayed release felt quite rushed to many of us.

    New Insights: Krishna Madhavan from Microsoft describes these updates as built to give publishers a clearer understanding of why their content surfaces, the broader subject areas they’re gaining visibility in, and how their presence compares with other sources over time.

    Intent: The Intents feature now classifies grounding queries into categories such as Informational, Commercial, Navigational, and more. This provides deeper insight into the intent behind user queries, moving beyond just triggering citations to understanding broader query contexts.

    ```json
{
  "alt": "Webmaster Tools dashboard showing AI Performance metrics for various grounding queries.",
  "caption": "Explore the AI Performance of different queries in the Webmaster Tools dashboard, showcasing data points like citations and intent for refined analysis.",
  "description": "This image displays the Microsoft Bing Webmaster Tools interface focusing on AI Performance metrics. The dashboard lists multiple grounding queries including 'hawaii flooding 2026' and 'El Nino 2026', along with their intent, topic, citations, and citation share. The layout provides a clear visual representation for users to analyze query performance. Key features include performance data columns and navigation options like 'Sitemaps' and 'IndexNow'. Ideal for users seeking detailed query insights for SEO optimization."
}
```

    An example given was an e-commerce publisher finding visibility in comparison-focused experiences or an educational publisher learning their content is popular in research-oriented interactions. These insights can guide us in refining content structure and depth.

    Topics: Topics group related queries into thematic clusters, offering us a more organized way to understand visibility, similar to modern AI’s reasoning across themes rather than isolated keywords.

    For instance, queries like “solar panels” and “solar energy efficiency” can all be part of a larger topic cluster such as Solar Energy. This thematic organization helps us align our content with how AI systems engage with our content.

    ```json
{
  "alt": "Dashboard of Microsoft Bing Webmaster Tools showing AI performance metrics with graphs and grounding queries list.",
  "caption": "Explore AI performance metrics on Bing Webmaster Tools, highlighting citations, cited pages, and popular search queries.",
  "description": "This image displays a dashboard from Microsoft Bing Webmaster Tools focusing on AI Performance metrics. It includes a graph showing citations and cited pages over time, alongside statistics for different time periods. The visible list showcases grounding queries with citation numbers. This interface aids users in analyzing search performance trends and understanding user interaction with content. Ideal for SEO professionals monitoring site performance and engagement in AI contexts."
}
```

    During this preview phase, some labels might remain broad, especially for niche domains, but meaningful patterns are already emerging.

    Citations: Citation Share now displays the percentage of citation visibility your site enjoys compared to others. It’s a directional metric to help us understand our evolving visibility over time, without ranking or quality scores.

    Compare: We can now compare citation changes over time. This feature overlays previous data onto current reports, helping us observe citation activity, which can be influenced by various factors like AI model updates, user demand shifts, and more.

    Why This Matters: Although we’re still awaiting click and click-through rate data, these growing AI performance insights are invaluable. I’m hopeful that such detailed data will become available to us from Microsoft or even Google one day.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Unlocking AI Search Power: Next-Question Intent Explained

    Unlocking AI Search Power: Next-Question Intent Explained

    I realized that many web pages effectively address initial search queries, but often fall short when it comes to guiding the user toward their final decision. This is where the concept of next-question intent becomes crucial. It’s a tool that not only aids users but also aligns with AI systems for enhanced content utility and visibility.

    In the world of GEO, much of the discussion revolves around how AI systems discover, extract, and suggest content. While these aspects are essential, I’ve learned that what truly determines visibility is the substantive content these systems find once they’ve reached my pages.

    Next-question intent isn’t just about answering the initial query. It’s about whether my page provides enough depth for the user to take their next step, be it selecting a product or making a decision.

    Often, a user’s first search is just a starting point. Key decisions hinge on follow-up questions and considerations that must be addressed.

    By crafting content that anticipates these subsequent inquiries, I equip AI systems with rich materials to synthesize, compare, and recommend.

    Traditional search was once about offering a suite of links for users to peruse and decipher. Now, AI search focuses on delivering synthesized responses, pulling information from multiple sources.

    This shift emphasizes the need for my content to provide comprehensive information that can help build AI-generated answers. Next-question intent is vital here.

    While search intent asks what the user wants to do, next-question intent goes further. It asks what the user will need to know next to trust, compare, or decide.

    In this AI-driven environment, content must support a complete answer pathway, far beyond the initial query.

    Be the brand AI recommends.

    See where your brand appears in AI search, where competitors are winning, and what it takes to become the answer AI recommends.

    See your AI visibility

    The First Query is Often Only the Doorway

    The initial search often serves as just the beginning, an entry point. True decision-making occurs through follow-ups and specific concerns that arise thereafter.

    Take the query “best CRM software for small business” as an example. It opens the door, but the true selection journey starts with follow-up questions.

    • Which platform is easiest for a two-person team?
    • Which integrates best with QuickBooks?
    • Which one works for a business without a formal sales department?
    • Which one is best for a local service company rather than a software startup?
    • Which one won’t frustrate owners or interns with tech complexity?

    These aren’t ancillary. They define the decision-making path.

    Otherwise well-structured content may falter if it fails to engage at this level, leaving AI systems with less context to assemble an answer, thereby reducing visibility.

    Next-Question Intent is Not Just a Writing Exercise

    As I’ve delved into content creation, it’s clear that next-question intent goes beyond simply writing better content—it ensures my pages support the next steps in a user’s decision-making process.

    Practically speaking, it means crafting answer-ready content that addresses initial user needs, foresees additional decision layers, and provides concrete, verifiable information.

    Visibility in AI search isn’t just about where I rank. It’s about citations and whether my brand becomes a trusted source in context-rich settings.

    To achieve this, my content must offer enough substance for systems to understand what my brand does, whom it serves, when it’s useful, why it’s trustworthy, and how it fares against alternatives.

    Where Good Content Goes Thin

    While I often find that brands have content that’s accurate and keyword-optimized, it still might not suffice in the AI search environment.

    AI systems require clarity and context to determine what I offer, who benefits from it, when it’s applicable, and why claims are valid.

    This depth is where many pages fall short.

    • A service claim like “customized marketing strategies” begs the question: customized how?
    • A product claim like “safe for families” prompts: safe for which family members?
    • A software claim like “built for small businesses” asks: which type of business?

    General claims offer little for people and even less for AI systems to utilize. Specific, structured, evidence-backed content serves a far better purpose.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • How AI Revolutionized My Hreflang XML Sitemap Creation

    How AI Revolutionized My Hreflang XML Sitemap Creation

    I’ve witnessed AI tools become indispensable in automating complex processes that traditionally demanded a lot of manual effort. However, I’ve also seen them used without any real benefit just because they are available.

    That’s why I prefer focusing on AI applications that save time and address genuine challenges.

    Recently, I was tasked with aligning the SEO architecture for over a dozen websites across three separate businesses, eight regional domains, and numerous languages, including three English dialects, Italian, Japanese, Spanish, Thai, French, and Korean.

    Mapping thousands of URLs to create seamless hreflang XML sitemaps traditionally required specialized software or extensive spreadsheet work. Instead, I used Google Gemini to develop a custom Python script to handle the heavy lifting.

    Here’s how an initial prompt evolved into a fully customized automation tool and what it taught me about utilizing AI for technical SEO.

    Where AI Delivers the Most Value

    I leverage AI primarily for practical, time-saving tasks, including:

    • Generating regex patterns when I need quick solutions without researching syntax from scratch.
    • Creating complex spreadsheet formulas for reporting workflows that depend on manual data exports.
    • Speeding up research and planning for projects requiring competitive analysis across business lines.
    • Building custom automation tools for recurring SEO and data-processing tasks.

    The hreflang project I discuss here fits perfectly into the last category.

    Mapping hreflang at Scale

    The challenge was straightforward: accurately map thousands of URLs across multiple multilingual websites into cohesive hreflang XML sitemaps.

    I chose not to tackle this manually. Instead, Google Gemini helped me build a custom Python solution.

    Here’s a walkthrough of how the process unfolded.

    Phase 1: Asking for an Approach, Not Just a Script

    One common pitfall of using generative AI for coding is asking it to sprint before understanding the course. Typing, “Write a Python script to create an hreflang sitemap,” will yield generic code prone to breaking with real-world data.

    Instead, I started by asking for an approach. I detailed the scenario: multiple regional domains, organic growth over several years leading to mismatched URL slugs, translated subfolders, and appended revision years.

    Gemini suggested a multi-step, data-driven approach:

    • Crawl the websites to collect live URLs and their metadata.
    • Use Python in Google Colab to process the raw data.
    • Run an exact match cluster to group identical slugs.
    • Use an advanced semantic AI model (like SentenceTransformers) to fuzzy match translated pages based on their titles and normalized URLs.

    Phase 2: Crawling and Data Collection

    Following the recommended strategy, I used a crawler to spider all regional websites to generate a unified CSV file with live URLs, status codes, title tags, and H1s. Screaming Frog proved ideal for this task.

    The quality of AI output relates directly to the quality of your crawl data, so make sure it’s robust.

    An AI script can miss an obvious “exact match” if a target URL is a 404 or a 301 redirect. Before feeding data into the script, filter your CSV to include only indexable content.

    Dig deeper: International SEO in 2026: What still works, what no longer does, and why

    Phase 3: The Google Colab Sandbox

    Google Colab offers a free, cloud-based Jupyter notebook environment for coding, bypassing local installations or environment variable issues. I used Google Drive to access it. The free version sufficed for this project.

    After uploading the CSV to Colab, Gemini provided an initial Python script that utilized a domain-mapping routine to assign language codes, clean the URLs, and generate an XML tree. The initial results required refinement.

    Phase 4: The Iteration (Where the Real Work Happens)

    If you expect AI to produce a flawless script on the first try, you’ll be disappointed. Like an intern, AI requires oversight. The true value lies in iteration.

    After running the initial script, several unmatched URLs left orphaned pages rather than grouping them with international counterparts. Here’s how I iteratively guided AI through the complexities of human-managed websites.

    The Directory Flattening Problem

    The U.S. site had recently reorganized its blog into topical folders, unlike the Mexican and Italian sites. I presented these mismatches to Gemini, leading to a script adjustment that flattened directories, allowing slugs to align.

    The Aggressive Semantic Trap

    Concept traps we implemented were initially strict. A UK article about manufacturing wouldn’t match its Italian counterpart due to a slightly different title. By loosening these traps for general industries and enforcing them for critical terms, the AI became adept at delivering better matches.

    The Translated Slug Epiphany

    The pivotal insight arrived when examining Mexican blog orphans. A Spanish URL /detras-de-escenas-historias... matched the English /behind-the-scenes-stories..., which I pointed out to Gemini. As a result, Gemini updated the script to create a “Combined Semantic Signature,” dynamically translating slugs and efficiently bridging language gaps.

    Dig deeper: Cultural SEO: A practical framework for Spanish markets in AI search

    Lessons from Building an AI-Assisted SEO Tool

    This project reinforced a simple truth: AI excels as a collaborator rather than a shortcut.

    • Be the strategist, let AI be the coder: Rather than demanding a finished product, discuss architecture and logic first, treating AI as a junior developer needing guidance.
    • Provide concrete examples: Don’t simply state, “It’s broken.” Give specific failed URL examples or mismatches to help AI refine its logic.
    • Embrace the iterative loop: Run the code, identify issues, and iterate. Each iteration enhances the tool’s intelligence.
    • Leverage Google Colab: You don’t need to be a Python guru to apply Python in SEO. Colab bridges the gap, providing access to complex data science libraries in your browser.

    In the end, I had a fully customized Python script capable of processing a massive CSV to generate a cross-referenced hreflang XML sitemap in minutes.

    Though AI isn’t replacing technical SEOs, those who collaborate with AI to build scalable tools will have a significant edge.

    Dig deeper: How AI search defines market relevance beyond hreflang


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot
  • Unlocking the Secrets of Google Discover Headline Formats

    Unlocking the Secrets of Google Discover Headline Formats

    I recently delved into a fascinating study on Google Discover headline formats, looking at a staggering 3.4 million articles. The results were eye-opening and showed that a simple headline rewrite often doesn’t yield the expected lift.

    You might have come across these bold statements before:

    ```json
{
  "alt": "Bar charts comparing mean hits per article by headline format for EN and FR languages.",
  "caption": "Discover how headline formats impact article engagement in English and French. Which format tops the list?",
  "description": "The image presents two bar charts showing the mean hits per article based on headline format for English (EN) and French (FR) languages. The formats include quote-led, quote inside, question, and statement. EN results show 'quote-led' headlines perform best with a mean of 13 hits, while 'statement' headlines have the lowest with 9.5. For FR, 'quote-led' also leads with 52.8 hits, and 'statement' headlines are at 35.7. This comparison highlights the engagement variance across different formats."
}
```
    • Quote-led headlines outperform plain declarative ones by nearly 29%.
    • Question headlines underperform both, sometimes by 24%.
    • Format drives the result: Rewrite a statement as a quote, or add that magic word, and you should expect a real lift.
    ```json
{
  "alt": "Bar chart showing the quote versus statement bonus in English and French publishers.",
  "caption": "The chart unveils a disparity in 'quote-led' bonuses, showcasing a significant difference between English and French publishers.",
  "description": "This bar chart illustrates the 'quote-led' bonuses, comparing English (EN) and French (FR) publishers. The vertical axis displays the bonus percentage, while the bars for English and French show a +37% and +48% raw aggregate view bonus respectively. Within the same publisher context, English displays a +3.1% and French a +5.5% bonus. A red dashed line indicates the commonly cited level of +~29%."
}
```

    To put these claims to the test, I examined 1,674,518 English articles and 1,690,295 French articles from the 1492.vision Discover corpus. That’s quite a hefty sample size!

    ```json
{
  "alt": "Bar chart comparing percentage of publishers where quotes beat statements, with EN and FR data.",
  "caption": "Exploring the impact of quotes vs. statements: EN and FR publishers' preferences revealed!",
  "description": "This bar chart illustrates the percentage of English (EN) and French (FR) publishers who report that quotes outperform statements at the same site. Data shows EN with 31.5% and 55.9% and FR with 47.6% and 57.4%, respectively, for median and mean hits per article. The chart analyzes 324 EN publishers and 439 FR publishers, indicating a higher tendency in FR publishers to favor quotes over statements."
}
```

    What I found was a deeper flaw than just numbers. It turns out that all three claims treat headline format as a leverage point for visibility. However, the data clearly shows that the impact of a headline’s format mainly reflects the publisher’s audience and the specific Discover surface used.

    ```json
{
  "alt": "Bar chart showing performance differences between various datasets and statement headlines.",
  "caption": "Analyzing performance: This bar chart reveals intriguing differences in question performance against statement headlines across datasets.",
  "description": "This image is a bar chart titled 'Questions: same Simpson, opposite direction.' It presents the performance of different datasets versus statement headlines, measured in percentage differences. The chart compares 'commonly cited level,' 'Our data EN raw,' 'Our data EN within-publisher,' 'Our data FR raw,' and 'Our data FR within-publisher,' showing variances ranging from -24% to +16%. Useful for understanding data evaluation and analysis discrepancies between mentioned categories."
}
```

    One striking analysis was Simpson’s paradox. An anomaly that, once noticed, appeared across the entire dataset.

    ```json
{
  "alt": "Two line graphs showing trends in publisher quote comparison and bonus from November 2025 to May 2026 for English and French.",
  "caption": "A comparative view of publisher quotes: English vs. French from 2025-2026. Discover how quote effectiveness and bonuses fluctuate over time!",
  "description": "This image features two line graphs comparing publisher data from November 2025 to May 2026. The left graph tracks the percentage of publishers where quotes outperform statements for English (EN) and French (FR). The right graph shows the median within-publisher quote bonus across the same timeframe. For both graphs, the English data is represented in orange squares, while French data is depicted in blue circles. The graphs reflect trends and variations in quote performance by language over time."
}
```

    Here’s what we’re really measuring:

    ```json
{
  "alt": "Bar charts showing top 10 publishers where quotes work best and hurt. BBC and IMDb lead the charts, respectively.",
  "caption": "Explore how quotes impact publishers: BBC benefits the most, while IMDb suffers, showcasing diverse media dynamics.",
  "description": "This image displays two horizontal bar charts, illustrating the effect of quotes on top publishers. On the left, BBC leads with an 85% increase in efficiency for quote usage, followed by Yahoo UK at 74%. The right side shows negative impacts, with IMDb experiencing a 54% decrease, indicating where quotes are less effective. The charts highlight the varying influence of quotes across different media platforms."
}
```

    Rather than clicks from Discover, our metric is hits per article: how often an article appears across the 1492.vision fleet. This serves as a proxy for visibility.

    ```json
{
  "alt": "Bar chart showing top 10 French publishers where quotes work best versus hurt the most.",
  "caption": "Explore how quotes impact articles: Discover which French publishers benefit the most from quotes and which suffer, with programmertv.ouest-france.fr leading positively and madeinfoot.ouest-france.fr negatively.",
  "description": "This dual bar chart illustrates the impact of using quotes in articles across various French publishers. The left chart (in green) lists the top 10 publishers where quotes enhance article performance, led by programmertv.ouest-france.fr at +163%. The right chart (in red) shows publishers where quotes harm article performance, with madeinfoot.ouest-france.fr at -57%. Key terms include quote impact, French publishers, and article performance."
}
```

    The dataset was limited to editorial articles, excluding platforms like YouTube because they have different headline norms. We’ll dive back into these at the end, as they bring more clarity than anything else.

    ```json
{
  "alt": "Two bar charts comparing 'Quote articles' and 'Statement articles' percentages by format for English and French pipelines.",
  "caption": "A visual comparison of English and French pipeline content formats, highlighting the distribution of Quote and Statement articles.",
  "description": "This image features two bar charts side by side, showcasing the mix of content formats in English (EN) and French (FR) pipelines. Each chart lists formats such as content, creatorcontent, paginationpanoptic, and others, with bars depicting the percentage for 'Quote articles' in blue and 'Statement articles' in gray. The charts provide a visual comparison of how content is distributed between the two types of articles across different formats."
}
```

    Why is volume important? The crux of the argument depends on slicing this vast dataset by publisher, Discover surface, topic, and language while still keeping enough data in each segment for valid insights. This is where the real difference between numbers and insights, and between a genuine format effect and a statistical illusion, lies.

    ```json
{
  "alt": "Bar chart showing quote versus statement bonus by pipeline within publisher, with green and red bars indicating varying percentages.",
  "caption": "Explore the impact of quotes versus statements in publishing pipelines with this insightful bar chart. From freshvideos.f at +22.2% to userpersonascontent.f at -14.1%, see the shifts in median captures.",
  "description": "This bar chart illustrates the median percentage change in captures per article, comparing quotes and statements across differing publisher pipelines. Green bars show positive increases, led by freshvideos.f at +22.2%, while red bars indicate declines, with userpersonascontent.f showing a significant -14.1% drop. This visual data serves as a guide to understanding content dynamism within the publishing landscape."
}
```

    Here’s a sneak peek: when you pool all publishers together, a clear gradient appears with quote-led headlines leading the pack and statements trailing.

    ```json
{
  "alt": "Bar charts comparing question vs statement bonus by pipeline for English and French publishers.",
  "caption": "Explore the variations in question vs statement bonus across different pipelines for English and French publishers, revealing interesting insights.",
  "description": "This image showcases two bar charts comparing the question vs statement bonus by pipeline for English (EN) and French (FR) publishers, respectively. On the left, the English chart displays data for various pipelines such as mustntmiss.f and deeptrends.f, showing both positive and negative median changes in capture rates. The right chart shows similar data for French pipelines like c.f and mustntmiss.f, with varied capture rate changes. Green bars indicate positive changes, while red bars represent negative changes, providing a clear visual representation of performance metrics across different language-driven pipelines."
}
```

    The frequently cited +29% is actually a conservative estimate for editorial pieces: quote-led headlines achieve a +37% lift in English and +48% in French. Even questions don’t lag behind as much as expected since they outperform statements to some extent (+7% EN, +16% FR).

    ```json
{
  "alt": "Bar charts comparing raw quote bonuses by domain for YouTube and x.com in English and French.",
  "caption": "Explore how YouTube and x.com handle quote bonuses differently across English and French domains through these insightful bar charts.",
  "description": "This image includes two bar charts analyzing the raw quote bonus by domain for YouTube and x.com. The left chart shows mean hits per article with quotes outperforming statements on YouTube, especially in French, and x.com having a penalty in French. The right chart compares quote bonuses, showing YouTube favors quotes, while x.com penalizes them. Keywords: YouTube, x.com, quote bonus, domain comparison."
}
```

    Though claim 1 appears understated and claim 2 misguided at the aggregate level, these are the observations on which most headline advice leans. Let’s delve further to understand what the data is really revealing.

    Let’s shift to the hidden aspects, starting with publishers. The raw comparison isn’t effectively between quotes and statements. It’s more about one set of publishers versus another because the publishers employing quotes often differ from those who don’t.

    Some media, like celebrity-focused outlets, regional newspapers, and sites attuned to trending topics, gravitate towards quotes, and naturally earn more Discover hits compared to entities that prefer factual presentations.

    This is a prime example of Simpson’s paradox: a strong trend at the aggregate level that fades or reverses when segmented into groups.

    To focus on the format itself, publishers must each be their own baseline: comparing quotes with statements within the same publishing entities while controlling for audience and topic diversity.

    So, the question is, how does each format fare on its own? Let me walk you through the rest of this journey as we unpack these layers.


    Inspired by this post on Search Engine Land.


    crushpress.ai community screenshot