Introduction
This document explains how to interpret email marketing product performance in the online store using uplift modeling.
It highlights product groupings, business impact, and recommended actions.
The goal is to present results in a way that is clear, consistent, and actionable for both marketing and business users.
Uplift Modeling Groups
Products are categorized into four uplift groups based on engagement and revenue impact relative to organic benchmarks:
Group | Definition | Business Impact | Recommended Actions |
Sure Things | Both conversion rate and average order value above organic | Revenue Gain: '{x6}' Number of products: '{x7}' | Key products for upcoming email sends, especially during BFCM Week |
Persuadables | Average order value above organic, conversion rate below | Revenue Gain: '{x6}' Number of products: '{x7}' | Improve on-page product personalization, layout, and creative alignment with email. |
Sleeping Dogs | Conversion rate above organic, average order value below | Revenue Gain: '{x6}' Number of products: '{x7}' | Reduce use, use higher performing products, minimize price discounting. |
Lost Causes | Both conversion rate and average order value below organic | Revenue Gain: '{x6}' Number of products: '{x7}' | Stop using |
Uplift Modeling Results Interpretation
The interpretation of the Uplift Modeling Group table is based on the group with the highest absolute value of Revenue Gain (positive or negative).
For that group, present Key Insight and Recommended Actions verbatim placed immediately below the table, as shown in the Retention: Email Product Lifetime Performance file.
1. If Sure Things (product–retention fit)
Key Insight: Sure Things as the dominant group indicate products that not only drive repeat purchases but also extend customer lifetimes and strengthen loyalty. These products deliver consistently high engagement and retention impact, proving their ability to sustain long-term value beyond the first conversion.
Recommended Actions:
Product Selection: Keep featuring these products in key retention flows — they’re proven to attract repeat buyers and build lasting brand affinity.
Email Strategy Alignment: Highlight these products in loyalty, replenishment, and post-purchase campaigns where long-term connection matters more than short-term promotion.
Optimization Approach: Refresh creative or timing slightly to maintain interest, but avoid over-rotation or unnecessary testing that could disrupt established retention performance.
Personalization: When existing customers engage with your emails, use personalized recommendations that pair these products with complementary or next-purchase items to deepen lifetime value.
Business Framing: Sure Things are your retention anchors — they create predictable repeat revenue, expand lifetime value, and reinforce emotional loyalty across the customer journey.
2. If Persuadables (products with retention potential)
Key Insight: Persuadables as the dominant group signal products that have the potential to become long-term loyalty drivers. They generate initial interest and early engagement but haven’t yet established a strong link to repeat purchasing or sustained customer relationships. The opportunity lies in strengthening post-purchase connection and ongoing relevance.
Recommended Actions:
Product Selection: Keep featuring these products, but enhance retention triggers around them — test replenishment reminders, loyalty rewards, or follow-up education to encourage repeat purchases.
Email Strategy Alignment: Include these items in post-purchase, discovery, and win-back flows where storytelling and real-world use cases can deepen attachment and perceived value.
Optimization Approach: Refine creative tone and content around longevity — emphasize durability, usefulness, or emotional appeal that supports a continuing relationship rather than a one-time buy.
Personalization: Use behavioral data to recommend complementary or next-purchase items once a shopper has engaged with or bought these products, guiding them toward repeat interaction and long-term value.
Business Framing: Persuadables are products on the verge of becoming retention engines — focus on reinforcing their relevance after purchase to turn new customers into loyal ones.
3. If Sleeping Dogs (products increasing risk of churn)
Key Insight: Sleeping Dogs as the dominant group indicate products that once drew attention but no longer inspire repeat engagement or loyalty. These products may have strong initial appeal yet fail to sustain interest or repeat purchases — often due to unmet expectations, weak perceived value, or poor post-purchase experience.
Recommended Actions:
Product Selection: Limit their use in retention-focused campaigns until performance improves. Reevaluate quality, positioning, or supporting content to ensure the experience delivers lasting satisfaction.
Email Strategy Alignment: Use recovery or win-back flows to re-engage customers who bought or viewed these products but haven’t returned. Replace or reposition them with items that have stronger retention impact in future sends.
Optimization Approach: Refresh messaging to rebuild trust and relevance — emphasize benefits, longevity, and brand reliability. Pair updates with improved creative or educational content that restores confidence.
Personalization: Identify shoppers who interacted with these products and follow up with personalized recommendations for better-performing or complementary items that reignite interest.
Business Framing: Sleeping Dogs are products that stall retention momentum. Realigning their value story and experience is key to preventing churn and recovering customer trust.
4. If Lost Causes (low-retention products)
Key Insight: Lost Causes as the dominant group indicate products that fail to create lasting engagement or repeat purchasing behavior. Shoppers may buy once — or not at all — and rarely return, signaling poor contribution to retention and lifetime value. Continuing to promote these items in retention campaigns delivers diminishing returns.
Recommended Actions:
Product Selection: Remove these products from retention-focused flows. Prioritize those with proven post-purchase engagement and repeat purchase potential.
Email Strategy Alignment: Avoid featuring these products in loyalty or re-engagement sequences. Instead, focus on items that consistently drive long-term satisfaction and recurring revenue.
Optimization Approach: If these products must remain part of your catalog, reposition them with improved messaging, stronger value framing, or complementary bundles that increase perceived usefulness.
Personalization: Exclude low-retention products from recommendation logic. Instead, surface high-performing alternatives known to deepen loyalty and encourage repeat engagement.
Business Framing: Lost Causes weaken customer lifetime growth. Redirect attention toward products that nurture ongoing relationships and contribute meaningfully to retention and long-term profitability.
Table Metrics and Their Interpretation
Each campaign row in the table contains:
Column | How to Interpret |
Revenue | Lifetime dollars from the product. landing page. High revenue with strong lift = growth driver; high revenue with negative lift = wasted email. |
RPLD (x[2]) | Revenue per Lifetime Day. Revenue efficiency per customer lifetime retention metric. Key revenue measure of product impact. |
RPLD Lift (x[3]) | RPLD relative to organic. Positive = incremental value; negative = underperforming. |
SLD (x[4]) | Shopper Lifetime Days. Key measure of customer retention. |
SLD Lift (x[5]) | SLD relative to organic. Positive = incremental retention; negative = underperforming. |
Revenue Gain (x[6]) | Incremental revenue attributed to the product RPLD compared to organic. Negative = unrealized revenue. |
Number of Products: (x[7]) | Number of products. Small number = focus; large number=scattered approach |
Lift Interpretation
Lift: Difference between product performance and organic shoppers.
Lift Range | Interpretation |
+20% or higher | Strong Positive Uplift – campaign is highly effective |
+6% to +19% | Positive Uplift – campaign is successful |
0% to +5% | Marginal Uplift – limited results |
–1% to –5% | Marginal Drop – limited loss |
–6% to –20% | Negative Drop – significant loss |
–21% or lower | Very Negative – severe underperformance |
Product Classification
Product classifications are based on the lift range of two key performance metrics and are designed to provide simple, memorable terms that clearly describe how well each product performs.
RPLD Lift | SLD Lift | Classification |
+20% or higher | +20% or higher | Champion |
0% to 5% | +6% to +20% | Retention Performer |
+6% to +20% | 0% to 5% | LTV Performer |
0% to +5% | 0% to +5% | Contender |
+20% or higher | 0% to –5% | Future Champs |
+20% or higher | –6% or lower | Retention Disconnect |
+6% to +20% | 0% to –5% | Future LTV Performers |
0% to +5% | 0% to –5% | Boot Camp |
0% to –5% | +20% or higher | Lost Champs |
–6% or lower | +20% or higher | Disconnect |
0% to –5% | +6% to +20% | Getting There |
0% to –5% | 0% to +5% | Hopefuls |
–6% or lower | 0% to –5% | Wrong Products |
0% to –5% | –6% or lower | Wrong Audience |
Catchall cases:
if Lift ranges are not defined in the table above then apply classification below:
RPLD Lift | SLD Lift | Classification |
positive | positive | Cool |
positive | negative | Interesting |
negative | positive | Risky |
negative | negative | Avoid |
Results Interpretation for BFCM Week
Identify the group with the highest absolute value of Revenue Gain (positive or negative).
Interpret these results as last year’s retention performance snapshot.
Frame positive outcomes as: “This product strengthened loyalty last BFCM; feature it again as part of this year’s retention and reactivation strategy.”
Frame negative outcomes as: “This product failed to sustain engagement last BFCM; replace or reposition it to prevent repeat churn.”
This approach ensures that BFCM Week insights inform forward-looking planning — connecting historical product retention performance with current lifecycle strategy and personalization priorities.
Final Takeaway
Scale Sure Things: Continue promoting proven retention products that extend customer lifetime and drive repeat purchases. Reuse their winning content, placement, and positioning in loyalty and replenishment flows.
Boost Persuadables: These products have strong potential to build loyalty. Feature them in post-purchase or discovery campaigns with follow-ups designed to encourage the second or third order.
Rework Sleeping Dogs: Reduce focus on products that once sold well but no longer drive engagement. Test improved storytelling, offers, or education to rebuild trust and reawaken interest.
Cut Lost Causes: Stop promoting products that don’t create repeat customers. Shift focus toward items that deliver clear lifetime value and deepen ongoing brand attachment.
Business Guidance:
By comparing product performance between email-driven and organic shoppers, you can identify which items strengthen retention and which weaken it. This helps focus retention programs on products that truly expand customer lifetimes, improve long-term engagement, and reduce churn risk.
Conclusion
This interpretation framework translates product performance into retention intelligence.
By mapping products into uplift groups and retention ranges, marketers can clearly see:
Which products extend customer lifetimes and drive repeat purchases.
Which products can grow loyalty with improved positioning or content.
Which products fail to sustain relationships and should be phased out.
The result is a prioritized action plan that uses products as retention instruments — maximizing lifetime value through smarter merchandising, personalization, and lifecycle strategy.