Introduction
This document explains how to interpret email marketing product performance in the online store using uplift modeling.
It highlights product groupings, business impact, and recommended actions.
The goal is to present results in a way that is clear, consistent, and actionable for both marketing and business users.
Uplift Modeling Groups
Products are categorized into four uplift groups based on engagement and revenue impact relative to organic benchmarks:
Group | Definition | Business Impact | Recommended Actions |
Sure Things | Both conversion rate and average order value above organic | Revenue Gain: '{x6}' Number of products: '{x7}' | Key products for upcoming email sends, especially during BFCM Week |
Persuadables | Average order value above organic, conversion rate below | Revenue Gain: '{x6}' Number of products: '{x7}' | Improve on-page product personalization, layout, and creative alignment with email. |
Sleeping Dogs | Conversion rate above organic, average order value below | Revenue Gain: '{x6}' Number of products: '{x7}' | Reduce use, use higher performing products, minimize price discounting. |
Lost Causes | Both conversion rate and average order value below organic | Revenue Gain: '{x6}' Number of products: '{x7}' | Stop using |
Uplift Modeling Results Interpretation
The interpretation of the Uplift Modeling Group table is based on the group with the highest absolute value of Impact (positive or negative).
For that group, present Key Insight and Recommended Actions verbatim placed immediately below the table, as shown in the Retention: Email Product Lifetime Performance file.
1. If Sure Things (product–retention fit)
Key Insight: Sure Things as the dominant group indicate products that not only convert efficiently through paid channels but also generate repeat purchases and strengthen long-term customer loyalty. They represent your highest-return investment — products that keep delivering even after the first click.
Recommended Actions:
Product Selection: Continue featuring these products in remarketing and retention campaigns — they perform reliably and drive repeat conversions at efficient cost.
Paid Strategy Alignment: Use them in loyalty, replenishment, and win-back campaigns where the objective is lifetime value, not just immediate ROAS.
Optimization Approach: Maintain consistent creative and cadence — slight variations in format or offer are fine, but avoid disrupting a high-performing retention loop.
Personalization: Target audiences with prior engagement or high purchase likelihood; leverage user behavior based personalization in your online store to maximize revenue and ROAS.
Business Framing: Sure Things are your retention powerhouses — they sustain profitable re-engagement, lower acquisition costs over time, and amplify customer lifetime value across paid channels.
2. If Persuadables (products with retention potential)
Key Insight: Persuadables as the dominant group signal products with emerging retention strength. They attract engagement and generate conversions, but their long-term loyalty impact is still forming. The opportunity lies in deepening connection after the first purchase and turning interest into habitual buying behavior.
Recommended Actions:
Product Selection: Keep promoting these products in paid remarketing and retention campaigns — pair them with retention triggers such as loyalty incentives, post-purchase education, or limited-time bundles to encourage repeat conversion.
Paid Strategy Alignment: Use these products in mid-funnel campaigns focused on reactivation and value reinforcement. Showcase authentic use cases or benefits that remind shoppers why they should return.
Optimization Approach: Refresh creative to emphasize sustained value — focus on usefulness, repeat need, or lifestyle fit that supports ongoing retention rather than one-time purchase.
Personalization: Target audiences who interacted but didn’t repurchase; use behavior-based personalization in your online store to recommend complementary products and drive incremental ROAS through re-engagement.
Business Framing: Persuadables are your loyalty builders in progress — strengthen post-purchase relevance and emotional connection to transform them into long-term retention drivers.
3. If Sleeping Dogs (products increasing risk of churn)
Key Insight: Sleeping Dogs as the dominant group indicate products that once performed well through paid campaigns but are now losing their ability to drive repeat engagement or retention. They may capture attention at first, but post-purchase satisfaction or perceived value isn’t strong enough to sustain loyalty — signaling early churn risk.
Recommended Actions:
Product Selection: Reduce spend on these products in retention or remarketing campaigns until engagement metrics recover. Reevaluate positioning, offer structure, and product experience before reinvesting.
Paid Strategy Alignment: Use these products in limited recovery or reactivation campaigns only. Gradually replace them with items that deliver stronger repeat value and retention lift.
Optimization Approach: Rework creative and messaging to restore credibility — highlight improvements, long-term benefits, or authentic use cases that rebuild trust and interest.
Personalization: Identify audiences who clicked or purchased once but never returned. Retarget them with personalized recommendations for higher-performing or complementary products that reignite buying intent.
Business Framing: Sleeping Dogs are paid marketing underperformers that can quietly drain retention ROI. Restoring product confidence and refining campaign focus is essential to stop churn and recover profitable engagement.
4. If Lost Causes (low-retention products)
Key Insight: Lost Causes as the dominant group indicate products that fail to generate repeat engagement or profitable lifetime value through paid channels. Shoppers may click or buy once, but rarely return — making these products poor candidates for ongoing spend. Continuing to promote them drains budget and reduces overall retention ROI.
Recommended Actions:
Product Selection: Phase out these products from remarketing and retention campaigns. Focus budget on items with proven re-engagement and long-term value contribution.
Paid Strategy Alignment: Exclude these products from loyalty, reactivation, and win-back ad sets. Replace them with consistently high-performing products that sustain repeat conversions.
Optimization Approach: If these products must stay in your catalog, reposition them with clearer value framing, bundles, or complementary add-ons to improve perceived usefulness.
Personalization: Remove low-retention products from dynamic recommendation and ad personalization. Promote proven retention drivers instead to improve ROAS and post-purchase loyalty.
Business Framing: Lost Causes dilute retention efficiency. Redirect paid marketing resources toward products that build repeat engagement, expand lifetime value, and strengthen long-term profitability.Table Metrics and Their Interpretation
Each campaign row in the table contains:
Column | How to Interpret |
Revenue | Lifetime dollars from the product. landing page. High revenue with strong lift = growth driver; high revenue with negative lift = wasted email. |
RPLD (x[2]) | Revenue per Lifetime Day. Revenue efficiency per customer lifetime retention metric. Key revenue measure of product impact. |
RPLD Lift (x[3]) | RPLD relative to organic. Positive = incremental value; negative = underperforming. |
SLD (x[4]) | Shopper Lifetime Days. Key measure of customer retention. |
SLD Lift (x[5]) | SLD relative to organic. Positive = incremental retention; negative = underperforming. |
Revenue Gain (x[6]) | Incremental revenue attributed to the product RPLD compared to organic. Negative = unrealized revenue. |
Number of Products: (x[7]) | Number of products. Small number = focus; large number=scattered approach |
Lift Interpretation
Lift: Difference between product performance and organic shoppers.
Lift Range | Interpretation |
+20% or higher | Strong Positive Uplift – campaign is highly effective |
+6% to +19% | Positive Uplift – campaign is successful |
0% to +5% | Marginal Uplift – limited results |
–1% to –5% | Marginal Drop – limited loss |
–6% to –20% | Negative Drop – significant loss |
–21% or lower | Very Negative – severe underperformance |
Product Classification
Product classifications are based on the lift range of two key performance metrics and are designed to provide simple, memorable terms that clearly describe how well each product performs.
RPLD Lift | SLD Lift | Classification |
+20% or higher | +20% or higher | Champion |
0% to 5% | +6% to +20% | Retention Performer |
+6% to +20% | 0% to 5% | LTV Performer |
0% to +5% | 0% to +5% | Contender |
+20% or higher | 0% to –5% | Future Champs |
+20% or higher | –6% or lower | Retention Disconnect |
+6% to +20% | 0% to –5% | Future LTV Performers |
0% to +5% | 0% to –5% | Boot Camp |
0% to –5% | +20% or higher | Lost Champs |
–6% or lower | +20% or higher | Disconnect |
0% to –5% | +6% to +20% | Getting There |
0% to –5% | 0% to +5% | Hopefuls |
–6% or lower | 0% to –5% | Wrong Products |
0% to –5% | –6% or lower | Wrong Audience |
Catchall cases:
if Lift ranges are not defined in the table above then apply classification below:
RPLD Lift | SLD Lift | Classification |
positive | positive | Cool |
positive | negative | Interesting |
negative | positive | Risky |
negative | negative | Avoid |
Results Interpretation for BFCM Week
Identify the group with the highest absolute value of Impact (positive or negative).
Interpret these results as last year’s retention performance snapshot.
Frame positive outcomes as: “This product strengthened loyalty last BFCM; feature it again as part of this year’s retention and reactivation strategy.”
Frame negative outcomes as: “This product failed to sustain engagement last BFCM; replace or reposition it to prevent ROAS degradation.”
This approach ensures that BFCM Week insights inform forward-looking planning — connecting historical product retention performance with current lifecycle strategy and personalization priorities.
Final Takeaway
Scale Sure Things: Keep investing in proven retention products that drive repeat purchases and extend customer lifetime. Reuse their top-performing creatives, placements, and messaging in loyalty and reactivation campaigns.
Boost Persuadables: Strengthen these emerging loyalty drivers. Feature them in mid-funnel and post-purchase campaigns supported by follow-ups that encourage the second and third conversion.
Rework Sleeping Dogs: Reduce spend on products that once performed but now underdeliver. Test new messaging, refreshed creative, or value framing to rebuild relevance and engagement.
Cut Lost Causes: Stop allocating budget to products that fail to generate repeat customers. Redirect spend toward retention-positive items that contribute to lifetime value and brand affinity.
Business Guidance:
By comparing product performance between paid-driven and organic shoppers, you can pinpoint which items truly reinforce retention and which erode it. This clarity helps optimize ad budgets, improve long-term ROAS, and build sustainable growth through loyalty-focused paid marketing.
Conclusion
This interpretation framework translates product performance into retention intelligence.
By mapping products into uplift groups and retention ranges, marketers can clearly see:
Which products extend customer lifetimes and drive repeat purchases.
Which products can grow loyalty with improved positioning or content.
Which products fail to sustain relationships and should be phased out.
The result is a prioritized action plan that uses products as retention instruments — maximizing lifetime value through smarter merchandising, personalization, and lifecycle strategy.