The Email Metrics That Actually Tell You Something

Share
The Email Metrics That Actually Tell You Something

Email marketing dashboards are full of numbers. Open rate, click rate, click-to-open rate, bounce rate, unsubscribe rate, spam complaint rate, list growth rate, revenue per email, conversion rate by segment — and that's before any platform-specific metrics that individual ESPs track on top of industry standards.

Having access to all of these numbers doesn't produce clarity. It often produces the opposite: a reporting environment where so much is being tracked that nothing is being acted on, where performance is assessed in a quarterly review by averaging everything together, and where the individual signals that would indicate something worth changing are buried in aggregate noise.

The Metrics That Diagnose, Not Just Describe

The distinction worth drawing is between metrics that describe performance and metrics that diagnose it. Open rate describes whether people are opening. It doesn't tell you why they are or aren't, what to do if the rate is declining, or whether the opens are translating into anything meaningful downstream. Spam complaint rate, by comparison, diagnoses: a spike in complaints tells you something specific is wrong, points toward the likely cause (unrecognizable sender, irrelevant content, too-high frequency, a purchased segment), and dictates an immediate action.

Spam complaint rate is the most important deliverability metric because of its direct causal relationship with inbox placement. Anything above 0.08% warrants investigation. Anything above 0.15% warrants immediate action. The action usually involves identifying the segment where the complaints originated — new subscribers, re-engaged lapsed subscribers, a specific campaign type — and either removing that segment or significantly changing how it's being contacted.

Click-to-open rate is the most useful content performance metric because it controls for the effects of list quality and subject line performance. If ten percent of your list opens and five percent of those click, that's a 50% CTOR — which tells you the content is working well for the people who opened it. If thirty percent opens and two percent of those click, the 6.7% CTOR tells you the content isn't delivering on what the subject line promised. The headline attracted attention that the body didn't justify.

Unsubscribe rate by source is more useful than overall unsubscribe rate. A list that has five acquisition sources will have different unsubscribe rates from each source, and those differences are diagnostic. If subscribers acquired through a specific lead magnet unsubscribe at three times the rate of subscribers who signed up directly, that lead magnet is attracting people whose interest doesn't align with the newsletter content. The overall rate might look acceptable while hiding a specific acquisition problem.

The Cohort Analysis Nobody Runs

One of the most useful and least commonly run email analyses is engagement by subscriber cohort — grouping subscribers by when they joined and tracking their engagement over time. This analysis answers a question that overall metrics can't: is engagement improving, declining, or stable for each generation of subscribers you acquire?

A list that's growing consistently might have declining overall engagement rates not because the content is getting worse but because newer subscribers engage less than older ones — either because acquisition quality has declined or because the onboarding sequence isn't building the engagement habit effectively in new subscribers.

The cohort view makes this visible by separating the performance of subscribers acquired in different periods. If subscribers from 18 months ago have 40% open rates and subscribers acquired in the last three months have 15% open rates, that's a specific problem with a specific location — it's in the acquisition and early engagement phase, not in the content program that the longer-tenured subscribers clearly value.

The Metrics Worth Ignoring

Raw open rate has been significantly compromised as a metric since Apple's Mail Privacy Protection pre-fetches email content and registers opens for MPP-enabled users regardless of whether they actually opened the email. Depending on the composition of the list, this can inflate reported open rates by 20–40 percentage points relative to actual engagement. Trends in open rate over time may still be informative, but absolute open rate numbers should be treated with significant skepticism.

List size as a success metric optimizes for the wrong thing. A list of 50,000 subscribers with a 15% engagement rate is a worse asset than a list of 15,000 subscribers with a 45% engagement rate for almost every business purpose: revenue generation, deliverability, word of mouth, conversion to paid products. Growing the list is a means to an end; the end is an engaged audience.

Read more