Open rates rose, clicks stalled, and revenue stayed flat. That pattern is common, and it is why Claritas Identity Graph email lift testing deserves a hard look before you commit acquisition budget. Lift testing asks one question: did the email cause conversions that would not have happened anyway? This guide shows what to demand from the vendor, how to design the test, and which red flags should pause a signed contract.
What Claritas is actually selling
Claritas recently launched Email Advantage, an acquisition email product. According to MarTech’s coverage of the launch, it adjusts audience targeting as conversion data arrives and tests multiple subject lines across audience segments instead of crowning one winner for the whole list.
The identity layer sits underneath all of it. The same report says Claritas uses its Identity Graph and email-to-consumer resolution to build audiences from high-confidence identity matches. It also describes extending the same audience definition across email, digital, and social, with cross-channel attribution on top.
That is a lot of moving parts. Each one can inflate a lift number if you let it.
The product adjusts targeting while the campaign runs, so the holdout group must be fixed before the first send. If the vendor can touch the control group, you are no longer measuring lift.
Why open rates cannot be your lift metric
Start with what you are measuring. Opens are a poor foundation for any test, and a vendor that leads with them is telling you something.
CMSWire reports that Apple clients accounted for 76.56% of email opens in September 2026, citing Litmus data, and that Litmus classifies opens from Apple Mail on iOS 15 and later as privacy-impacted. The same article notes that after Apple’s rollout, open rates nearly doubled across Omeda client campaigns without any sign that messages had become twice as compelling.
So what should you measure instead? Behavior that happens outside the inbox:
- Verified purchases or account openings tied to a matched person
- Qualified leads that pass your own CRM scoring
- Cost per incremental conversion, not cost per click
- Unsubscribe and complaint rates by test cell
Clicks need scrutiny too. Security tools crawl links, and that scanning can manufacture clicks before a human sees the message. Treat clicks as a diagnostic, never as the result.
Designing the test: a brand-side checklist
Here is the setup I would insist on before the first dollar moves.
- Randomize at the identity level. Assign people to treatment or holdout after identity resolution, not before. If one person appears as two email addresses and lands in both cells, your control is contaminated.
- Freeze the holdout. Define its size and membership in writing. The right size depends on your expected conversion rate and the smallest lift you want to detect. Low-conversion programs need larger controls to reach significance.
- Pre-register the success metric. Name the conversion event, the attribution window, and the minimum detectable lift before launch. Vendors with flexible metrics always find a winner.
- Separate optimization from measurement. Adaptive targeting is the product’s selling point. It is also a bias risk. Ask whether the holdout is drawn from the same pre-optimization audience as the treated group.
- Measure with your own data. Conversions should reconcile against your CRM or order system, not only the vendor’s dashboard.
Notice what is missing: trust in a single reported percentage. Ask for the raw counts behind every lift figure: audience size, conversions in treatment, conversions in control, and the confidence interval.
Vetting the identity graph itself
Lift is only as clean as the match. If the graph links an email to the wrong household, you are targeting, and then crediting, the wrong people.
Ask these questions in the vendor call:
- What does “high-confidence match” mean numerically, and can you set the threshold?
- What share of your list resolves, and what share of the resolved records are deterministic versus probabilistic?
- How often is the graph refreshed, and how are stale records retired?
- Can you run a blind match test with a file where you already know the true identities?
That last one is underused. Seed your file with known customers and check whether the graph resolves them correctly. It costs little and exposes weak coverage fast. If you are weighing graph vendors against each other, our comparison of identity graph fit covers the same evaluation logic for a different pair of providers.
Data quality upstream matters as much as the graph. Dirty inputs produce confident-looking nonsense, which is why we recommend running the checks in our guide to clean data ROI before any lift test begins.
Compliance is part of the evaluation
Acquisition email to resolved identities carries legal exposure, and the brand shares it. The FTC’s CAN-SPAM guidance states that each separate email in violation can draw penalties of up to $53,088. It also says both the company whose product is promoted and the company that originated the message may be legally responsible.
Read that twice. Outsourcing the send does not outsource the liability.
The same guidance says you must honor an opt-out request within 10 business days. Confirm in the contract who owns suppression, how fast opt-outs sync between the vendor and your systems, and what happens to a holdout member who opts out mid-test. For a deeper look at the signal handling, see our piece on consent-aware CDPs.
Reading the results without fooling yourself
Suppose the report shows a strong lift. Before you scale, run through four sanity checks.
Is the sample large enough? A big percentage on a handful of conversions is noise. Did the control behave normally? If your holdout converted far below your historical baseline, the split may be biased. Did other channels interfere? Because the product coordinates email with digital and social, paid retargeting can lift both groups differently. Ask for lift by channel combination, not blended.
Does the lift persist? Short windows reward urgency tactics. Check 30 and 60 day conversion and early churn before you call the cohort valuable.
Subject-line personalization claims deserve the same skepticism. Our look at AI send time optimization shows how engagement claims fall apart when they rest on inflated opens.
What to put in the contract
- A written test protocol with holdout size, metric, and window
- Access to row-level or aggregate raw counts for audit
- Match-rate reporting by confidence tier
- A pilot clause: scale spend only after a pre-agreed lift threshold is met
- Data deletion and suppression obligations with timelines
Pilots beat promises. A structured test deployment, which the vendor itself describes as the starting point, is the natural place to prove the case on your own audience before a broader rollout.
Next step
Request a pilot proposal this week and make the first line item a frozen, pre-registered holdout measured on a conversion event your own CRM can verify. If the vendor resists that structure, you have your answer before spending a dollar.
FAQs
What is email lift testing?
It compares conversion outcomes between a group that receives your email and a randomized holdout that does not. The difference is the incremental effect of the email. It separates conversions the campaign caused from those that would have happened anyway.
Does Claritas Identity Graph email lift testing replace my own measurement?
No. Treat the vendor report as one input and reconcile it against your CRM or order data. Independent verification protects you from metric definitions that favor the vendor.
How big should the holdout group be?
It depends on your baseline conversion rate and the smallest lift you care about. Lower conversion rates need larger holdouts to reach statistical significance. Ask the vendor to show the power calculation behind their proposed size.
Why not use open rate as the success metric?
Privacy features inflate opens. CMSWire’s reporting shows Apple clients drove most opens in a recent Litmus dataset, so opens often reflect client behavior rather than interest. Use conversions, qualified leads, or revenue.
Can adaptive optimization bias a lift test?
Yes. If targeting shifts toward likely converters in the treated group but not the control, lift is overstated. Confirm that the holdout is drawn from the same audience before optimization begins.
Who is liable for compliance problems in vendor-sent email?
Potentially both parties. The FTC’s CAN-SPAM guidance says the company whose product is promoted and the company that originated the message may both be legally responsible. Put suppression and opt-out duties in writing.
How do I test the quality of the identity graph?
Run a blind match with a file of customers whose identities you already know. Compare resolution rate and accuracy by confidence tier. Weak performance on known records predicts weak performance on prospects.
Top Influencer Marketing Agencies
The leading agencies shaping influencer marketing in 2026
Agencies ranked by campaign performance, client diversity, platform expertise, proven ROI, industry recognition, and client satisfaction. Assessed through verified case studies, reviews, and industry consultations.
Moburst
-
2

The Shelf
Boutique Beauty & Lifestyle Influencer AgencyA data-driven boutique agency specializing exclusively in beauty, wellness, and lifestyle influencer campaigns on Instagram and TikTok. Best for brands already focused on the beauty/personal care space that need curated, aesthetic-driven content.Clients: Pepsi, The Honest Company, Hims, Elf Cosmetics, Pure LeafVisit The Shelf → -
3

Audiencly
Niche Gaming & Esports Influencer AgencyA specialized agency focused exclusively on gaming and esports creators on YouTube, Twitch, and TikTok. Ideal if your campaign is 100% gaming-focused — from game launches to hardware and esports events.Clients: Epic Games, NordVPN, Ubisoft, Wargaming, Tencent GamesVisit Audiencly → -
4

Viral Nation
Global Influencer Marketing & Talent AgencyA dual talent management and marketing agency with proprietary brand safety tools and a global creator network spanning nano-influencers to celebrities across all major platforms.Clients: Meta, Activision Blizzard, Energizer, Aston Martin, WalmartVisit Viral Nation → -
5

The Influencer Marketing Factory
TikTok, Instagram & YouTube CampaignsA full-service agency with strong TikTok expertise, offering end-to-end campaign management from influencer discovery through performance reporting with a focus on platform-native content.Clients: Google, Snapchat, Universal Music, Bumble, YelpVisit TIMF → -
6

NeoReach
Enterprise Analytics & Influencer CampaignsAn enterprise-focused agency combining managed campaigns with a powerful self-service data platform for influencer search, audience analytics, and attribution modeling.Clients: Amazon, Airbnb, Netflix, Honda, The New York TimesVisit NeoReach → -
7

Ubiquitous
Creator-First Marketing PlatformA tech-driven platform combining self-service tools with managed campaign options, emphasizing speed and scalability for brands managing multiple influencer relationships.Clients: Lyft, Disney, Target, American Eagle, NetflixVisit Ubiquitous → -
8

Obviously
Scalable Enterprise Influencer CampaignsA tech-enabled agency built for high-volume campaigns, coordinating hundreds of creators simultaneously with end-to-end logistics, content rights management, and product seeding.Clients: Google, Ulta Beauty, Converse, AmazonVisit Obviously →
