Data & Analytics

Using cohort analysis to prove whether your welcome offer is worth the cost

Using cohort analysis to prove whether your welcome offer is worth the cost

When a new customer signs up and redeems your welcome offer, it feels great. But that first thrill can hide a costly truth: is that discount or free gift actually bringing long-term value, or simply accelerating churn and masking acquisition inefficiency? I use cohort analysis as my go-to way to answer this question. In this post I'll walk you through the practical steps I use with SMEs to prove — or disprove — whether a welcome offer is worth its cost.

Why cohort analysis (not “average” metrics) is essential

Average metrics lie. A single average retention rate or average order value can hide divergent behaviours from profitable, engaged customers and a cohort of bargain-hunters who never return. Cohort analysis slices customers by the date (or source) of first purchase and then tracks how each group behaves over time. That lets you see whether the welcome offer improves early conversion at the expense of longer-term value.

Put simply: cohort analysis answers the question I get asked most often — “did the welcome offer buy us loyal customers, or just a spike?” — with evidence rather than intuition.

What to measure: the KPI set I always recommend

Start with a compact set of metrics you can compute from order and customer data. I focus on the ones that map directly to business outcomes:

  • Conversion rate from signup to first purchase (if your welcome offer requires signup).
  • Repeat purchase rate at 30/60/90/180/365 days.
  • Average order value (AOV) for first order and subsequent orders.
  • Customer acquisition cost (CAC) allocated to the cohort (including the cost of the welcome offer).
  • Gross margin per customer across the observation window.
  • Customer lifetime value (LTV) within your chosen period (e.g. 12 months).
  • With those numbers you can answer: did the welcome offer increase acquisition? Did it reduce AOV for the cohort? How long before the cohort becomes profitable?

    Designing the cohort experiment

    There are two practical approaches, depending on your systems and traffic:

  • Historic cohort analysis: Compare cohorts from different calendar periods — e.g. the three months before you launched the welcome offer vs. the three months after. This is easy but vulnerable to seasonality and other simultaneous changes.
  • Randomised A/B cohort: If you can, split new signups randomly into Offer vs No-Offer groups and track each group over time. This is the cleanest way to attribute differences to the offer itself.
  • I always recommend A/B where possible. For many SMEs, a pragmatic compromise is to run staggered rollouts by region or traffic source to create quasi-experimental cohorts.

    Step-by-step: building the cohort table

    Here’s the minimal cohort table I build in a spreadsheet or BI tool. Columns are time buckets (week or month since acquisition) and rows are cohorts by acquisition week/month. Cells contain the metric (e.g. retention rate or cumulative revenue per user).

    Acq monthWeek 0 rev/userWeek 4 rev/userWeek 12 rev/userWeek 24 rev/user
    Jan£8.50£1.00£3.20£4.80
    Feb (with offer)£5.00£0.80£2.50£4.10
    Mar (with offer)£5.20£0.90£2.70£4.30

    In this simplified example, you can see the first-order revenue per user is lower for the "with offer" cohorts (because of the discount), but cumulative revenue narrows over time. The key questions are: when does cumulative revenue cross the cost line (welcome offer + CAC) and what happens to repeat behaviour?

    Calculating the real cost of the welcome offer

    Many teams make the mistake of only counting the face value of the discount. The true cost includes:

  • The face value of the offer (discount %, free product cost).
  • Fulfilment and operational costs (packaging, extra support).
  • Incremental marketing spend to drive signups to the offer (if you promoted it).
  • The opportunity cost of lower future AOV or lower margin if the offer attracts low-value customers.
  • When I model ROI I compute an adjusted CAC = marketing CAC + allocated offer cost. Then I calculate payback period = months until cumulative gross margin per user > adjusted CAC. If the payback is within your acceptable window (often within 6–12 months for SMEs), the offer can be justified; if it’s beyond that, you’re subsidising customers for too long.

    What good and bad cohort patterns look like

    Over the years I’ve come to recognise a few archetypes:

  • Healthy uplift: Offer cohort shows higher acquisition and similar or slightly lower first-order revenue, but equal or higher repeat rates and similar AOV later. Cumulative LTV catches up within an acceptable payback window.
  • Bargain-hunters: Offer cohort spikes in acquisition, low first-order AOV, and much lower repeat rates — cumulative LTV never recovers. These customers were acquired only by price.
  • Window-shifters: Offer accelerates the first purchase of customers who would have bought later anyway. Here you see a short-term lift but no long-term gain; lifetime value is unchanged but you’ve moved revenue forward and paid for it.
  • Examples from the field

    I worked with a D2C skincare brand that ran 20% off for new subscribers. Initial conversion doubled, but first-order gross margin per customer halved. Cohort analysis showed repeat rate at 6 and 12 months was the same as pre-offer customers, so cumulative LTV recovered by month 9 — after which cohorts became profitable. For that business the welcome discount made sense because they had low CAC and a product with sticky repurchase behaviour.

    Contrast that with a niche fashion retailer where a seasonal 30% new-customer code brought lots of returns and low repeat purchase. Cohort LTV never recovered past the acquisition cost. The fix there was to switch to a non-discount welcome (e.g. free shipping threshold or a low-cost gift) and couple the incentive with education content to encourage fitting and reduce returns.

    Practical tips to improve your cohort outcomes

  • Pair the welcome offer with onboarding: include a product use guide, review request or a second-order discount to nudge repeat behaviour.
  • Use a graduated incentive: smaller immediate discount + a larger reward locked to second purchase encourages retention without destroying AOV.
  • Segment by source: some channels attract higher-quality customers. Track cohorts by acquisition source to allocate promos effectively.
  • Monitor returns and promo stacking: if welcome-offer buyers return at higher rates, inflate the effective cost in your calculations.
  • Timebox your analysis: give cohorts at least 6–12 months where possible. Short windows can mislead, especially for infrequent-purchase categories.
  • Common pitfalls and how to avoid them

  • Mixing cohorts: ensure cohort membership is based on first purchase date and that subsequent behaviour is correctly attributed to that customer.
  • Ignoring seasonality: compare like-for-like calendar periods or use control groups to remove seasonal bias.
  • Using the wrong currency for LTV: use gross margin, not revenue, when calculating payback and profitability.
  • Stopping analysis too early: some businesses have long repurchase cycles; cutting off at 90 days can hide eventual profitability.
  • Cohort analysis turns the welcome offer debate from an opinion to a measureable business decision. It forces you to account for hidden costs, to measure behaviour over time, and to design incentives that align with long-term value, not just short-term signups. If you want, I can outline a template you can plug your data into — or review a cohort report you already have and point out the leverage points. Drop a note via the contact page on Zynrewards Co or ping me on LinkedIn and we can dig into your numbers together.

    You should also check the following news:

    How small retailers can use transactional data to create personalised email rewards with Klaviyo
    Loyalty Programs

    How small retailers can use transactional data to create personalised email rewards with Klaviyo

    I often get asked by small retailers how they can turn the transactional data already sitting in...

    Dec 02 Read more...
    A simple framework to set measurable KPIs for your loyalty programme in 30 days
    Loyalty Programs

    A simple framework to set measurable KPIs for your loyalty programme in 30 days

    I’m often asked by founders and marketing teams: “Can we set sensible, measurable KPIs for our...

    Dec 02 Read more...