How do I know that shoppers converting through emails triggered by Instant wouldn't have converted regardless?

When a shopper purchases after engaging with an abandonment email triggered by Instant, we attribute that revenue to Instant. This attribution model mirrors how platforms like Klaviyo attribute revenue generated to individual email marketing flows.

Our research has found that the majority of revenue attributed to Instant is associated with merchants who would not have placed an order had they not received an abandonment email. However, given the seasonality of retail sales, it can be difficult to see exactly how Instant's incremental revenue increase has impacted a merchants' top-line revenue, especially when a merchant adopts Instant during a quieter sales month.

Case Study

For this merchant, we conducted an A/B test to determine exactly how much additional revenue Instant's superior abandonment email marketing could generate for them.

We assigned all shoppers identified by Instant, and not identified by Klaviyo or Shopify, to two cohorts:

  • Control — for this segment of shoppers, despite our ability to identify them, we suppressed sending any events to Klaviyo. Therefore, shoppers in this group would not receive abandonment emails triggered by Instant, and if they were to purchase, this would have been purely of their own volition.
  • Treatment — for this segment of shoppers, we sent the usual events to Klaviyo, triggering abandonment emails.

Over two weeks, we found:

  • The control segment, who did not receive any Instant-triggered abandonment emails, generated $69.8K in revenue.
  • The treatment segment, who did receive Instant-triggered abandonment emails, generated $84.2K in revenue.

This is a revenue uplift of $14.4K over two weeks. Had the A/B test not been running the merchant would've generated $28.8K, or $57.6K over a one-month period.

While we did find that Klaviyo attributed slightly more revenue than this to Instant Audience's flows, this revenue uplift is impressive and inline with the results published in our case studies, achieving a massive 23x return-on-investment for the customer.