Skip to main content

Interpreting Email Marketing Product Performance Results

Rules and principles for interpreting email landing page performance results.

Updated over 6 months ago

Introduction

This document explains how to interpret email marketing product performance in the online store using uplift modeling.


It highlights product groupings, business impact, and recommended actions.


The goal is to present results in a way that is clear, consistent, and actionable for both marketing and business users.


Uplift Modeling Groups

Products are categorized into four uplift groups based on engagement and revenue impact relative to organic benchmarks:

Group

Definition

Business Impact

Recommended Actions

Sure Things

Both conversion rate and average order value above organic

Revenue Gain: '{x6}'

Number of products: '{x7}'

Key products for upcoming email sends, especially during BFCM Week

Persuadables

Average order value above organic, conversion rate below

Revenue Gain: '{x6}'

Number of products: '{x7}'

Improve on-page product personalization, layout, and creative alignment with email.

Sleeping Dogs

Conversion rate above organic, average order value below

Revenue Gain: '{x6}'

Number of products: '{x7}'

Reduce use, use higher performing products, minimize price discounting.

Lost Causes

Both conversion rate and average order value below organic

Revenue Gain: '{x6}'

Number of products: '{x7}'

Stop using


Uplift Modeling Results Interpretation

The interpretation of the Uplift Modeling Group table is based on the group with the highest absolute value of Impact (positive or negative).


For that group, present Key Insight and Recommended Actions verbatim placed immediately below the table, as shown in the Monetization: Email Product Performance Analysis file.


1. If Sure Things (product–shopper fit)

Key Insight:
Sure Things as the dominant group show that the products featured in your email campaigns already have strong product–shopper fit. They convert consistently, generate high revenue per recipient, and lift average order value across key monetization flows.

Recommended Actions:

  • Product Selection: Continue featuring these product groups in monetization-focused emails — they reliably attract ready-to-buy shoppers and drive efficient revenue.

  • Campaign Strategy Alignment: Highlight these products in high-performing campaigns and lifecycle flows where purchase intent is strongest, such as cart recovery, browse abandonment, and post-purchase upsell sequences.

  • Optimization Approach: Apply light creative refreshes — update visuals, messaging, or seasonal framing — while keeping the core offer and structure that’s already producing strong results.

  • Personalization: Use personalized recommendations to increase order value and reinforce relevance for each recipient.

Business Framing:
Sure Things are your email monetization engines — rely on them to sustain predictable revenue growth and profitability, not to experiment with unproven content or untested product mixes.


2. If Persuadables (products with growth potential)

Key Insight: Persuadables as the dominant group indicate products with strong potential to become top performers in email marketing. The opportunity lies in improving how these products connect with shopper intent, message timing, and campaign context.

Recommended Actions:

  • Product Selection: Continue featuring these products but test different pricing, bundling, or storytelling angles to increase conversion efficiency and perceived value.

  • Campaign Strategy Alignment: Include these products in follow-up sequences for engaged non-buyers and pair them with proven winners in multi-product email layouts to boost engagement and click-through rates.

  • Optimization Approach: Highlight these products in educational or benefit-driven emails that emphasize use cases, quality, or unique advantages — helping subscribers justify purchase intent.

  • Personalization: Use personalized recommendations to show complementary or higher-affinity products that strengthen relevance and encourage conversion.

Business Framing: Persuadables can evolve into Sure Things once content, product performance, and shopper motivation align. Focus optimization on closing that gap to unlock incremental email-driven revenue.


3. If Sleeping Dogs (underperforming products)

Key Insight: Sleeping Dogs as the dominant group indicate products that attract email clicks but fail to convert — often due to weak perceived value, poor messaging, or misaligned product presentation.

Recommended Actions:

  • Product Selection: Reduce promotion frequency for these products until performance improves. Reevaluate pricing, creative framing, and offer clarity to ensure the perceived value aligns with shopper expectations.

  • Campaign Strategy Alignment: Use re-engagement or recovery email sequences to reconnect with subscribers who clicked but didn’t purchase. Replace or reposition these products with stronger performers in upcoming campaigns.

  • Optimization Approach: Test new creative treatments — refreshed visuals, clearer benefit framing, or stronger calls to action — that rebuild trust and remove hesitation.

  • Personalization: Use personalized recommendations to automatically replace low-performing items with data-driven recommendations featuring higher-converting or more relevant alternatives.

Business Framing: Sleeping Dogs represent lost conversion potential in email marketing. Rebuilding message clarity, creative relevance, and product appeal is essential to recover performance and lift email-driven revenue.


4. If Lost Causes (unlikely to convert products)

Key Insight: Lost Causes indicate products that fail to generate engagement or conversions from email campaigns. Subscribers show low or no buying intent, making continued promotion of these items inefficient.

Recommended Actions:

  • Product Selection: Remove these products from active email campaigns. Replace them with high-performing or trending items that align better with shopper interest and proven conversion behavior.

  • Campaign Strategy Alignment: Avoid featuring these products in key monetization or promotional sends. Focus instead on content that highlights proven revenue drivers and products with strong engagement signals.

  • Optimization Approach: If these products remain in your catalog, refresh their creative presentation, strengthen value communication, and ensure pricing or positioning better fits audience expectations.

  • Personalization: Exclude these low-intent products from personalized recommendation blocks. Instead, surface relevant or top-performing alternatives that are more likely to convert and enhance engagement.

Business Framing: Lost Causes drain campaign performance and subscriber attention without delivering returns. Redirect focus toward products and segments that demonstrate clear purchase intent to protect deliverability, sustain engagement, and grow revenue.


Table Metrics and Their Interpretation

Each campaign row in the table contains:

Column

How to Interpret

Revenue

Total dollars from the viewed product. landing page. High revenue with strong lift = growth driver; high revenue with negative lift = wasted email.

AOV (x[2])

Average Order Value. Revenue efficiency per conversion. Key revenue measure of campaign quality.

AOV Lift (x[3])

AOV relative to organic. Positive = incremental value; negative = underperforming.

ICR (x[4])

Item conversion rate. Key measure of product-market fit.

ICR Lift (x[5])

ICR relative to organic. Positive = incremental conversion; negative = underperforming.

Revenue Gain (x[6])

Incremental revenue attributed to the product compared to organic. Negative = unrealized revenue.

Number of Products: (x[7])

Number of products. Small number = focus; large number=scattered approach


Lift Interpretation

Lift: Difference between product performance and organic shoppers.

Lift Range

Interpretation

+20% or higher

Strong Positive Uplift – campaign is highly effective

+6% to +19%

Positive Uplift – campaign is successful

0% to +5%

Marginal Uplift – limited results

–1% to –5%

Marginal Drop – limited loss

–6% to –20%

Negative Drop – significant loss

–21% or lower

Very Negative – severe underperformance


Product Classification

Product classifications are based on the lift range of two key performance metrics and are designed to provide simple, memorable terms that clearly describe how well each product performs.

AOV Lift

ICR Lift

Classification

+20% or higher

+20% or higher

Champion

0% to 5%

+6% to +20%

Conversion Performer

+6% to +20%

0% to 5%

Revenue Performer

0% to +5%

0% to +5%

Contender

+20% or higher

0% to –5%

Future Champs

+20% or higher

–6% or lower

Conversion Disconnect

+6% to +20%

0% to –5%

Future Revenue Performers

0% to +5%

0% to –5%

Boot Camp

0% to –5%

+20% or higher

Lost Champs

–6% or lower

+20% or higher

Disconnect

0% to –5%

+6% to +20%

Getting There

0% to –5%

0% to +5%

Hopefuls

–6% or lower

0% to –5%

Wrong Products

0% to –5%

–6% or lower

Wrong Audience

Catchall cases:

if Lift ranges are not defined in the table above then apply classification below:

AOV Lift

ICR Lift

Classification

positive

positive

Cool

positive

negative

Interesting

negative

positive

Risky

negative

negative

Avoid


Results Interpretation for BFCM Week

Identify the group with the highest absolute value of Impact (positive or negative).

Interpret these results as last year’s email monetization performance snapshot.
Frame positive outcomes as:
“This group of products generated strong revenue efficiency through email last BFCM; feature them again as part of this year’s monetization and revenue-growth strategy.”
Frame negative outcomes as:
“This group of products failed to convert email traffic effectively last BFCM; refine their offers, creative presentation, or personalization to prevent missed revenue opportunities and declining performance.”

This approach ensures that BFCM Week insights inform forward-looking monetization planning — connecting historical group-level email performance with current lifecycle strategy, content structure, and personalized merchandising priorities.


Final Takeaway

  • Scale Sure Things: Continue promoting proven products that reliably convert from paid traffic. Reuse their winning creative, audience targeting, and bidding strategy in this year’s BFCM campaigns.

  • Boost Persuadables: These products show potential but need stronger engagement. Feature them in retargeting or discovery ad sets, testing fresh creatives and placements to help shoppers understand their value.

  • Rework Sleeping Dogs: Reduce spend on products that attract clicks but fail to convert. Test improved offers, visuals, or pricing to rebuild confidence and improve ROAS.

  • Cut Lost Causes: Eliminate products that consistently waste ad budget. Shift focus and investment toward higher-performing, higher-margin items that align with real shopper demand.

Business Guidance: By comparing product performance between paid and organic traffic, you can identify which products generate true incremental revenue and which drain resources. This enables you to concentrate spend on profitable products, improve conversion efficiency, and avoid repeating underperforming campaigns during BFCM Week.


Conclusion

This interpretation framework ensures each product’s paid marketing performance is translated into clear business meaning.

By mapping products into uplift groups and performance ranges, marketers can clearly see:

  • Which products drive incremental revenue and deliver stronger ROAS.

  • Which products have growth potential with optimization.

  • Which products consume budget without results and require deactivation.

The outcome is a prioritized action plan that maximizes monetization from paid campaigns and informs more profitable, data-driven BFCM strategies.

Did this answer your question?