Paywall Experiments

I led a multivariate paywall test on El Confidencial. The main question was whether a paywall without prices — followed by a dedicated landing — could convert better than the paywall with prices. The test ran with a control plus three without-prices variants. The priced paywall won. The case closed with two moves: redesign the winner with the language that worked from the losing variants, and rework the offer side itself.

Subscription Growth A/B Testing CRO
Client:
El Confidencial
Area:
Subscription Experience / CRO
Date:
2024
Paywall Experiments — hero screen
The production paywall before the experiments

Where the Project Started

El Confidencial ran a single paywall with two plans and visible prices, managed in Piano content-fields. Conversion was stable, but with no counterfactual — nobody knew whether the friction of showing price was worth the clarity, or whether a value-led paywall without price (handing checkout off to a dedicated landing) would convert better. The goal was to settle that question with a real test, not an opinion.

Research & Principles

I benchmarked international news paywalls (NYT, FT, WaPo) and ran working sessions with the SUSC team to prioritise hypotheses. Three principles drove the design: the paywall is a decision moment, not a friction — if the user is reading, they're already engaged; price can be information, not obstacle — hiding it might read as evasion, but it had to be tested; and never put the production paywall on the line — the control keeps the majority of the traffic, always.

Designing the Variants

The control is the production paywall already shown above — visible prices, in-line checkout. Three without-prices variants ran against it, each testing a different lever before bouncing to a dedicated landing where the subscription closes: a minimal/transactional version, a social-proof version, and a value-based version highlighting the benefits of subscribing. All three share the same soft CTA — "Continue reading" instead of "Subscribe" — to test the editorial framing without the transactional pressure of the production paywall.

A · Transactional / Minimal

"Subscribe to continue reading" as a headline, "Discover the stories behind the headlines" as the only piece of value framing, and a single soft CTA. No price, no benefits list, no proof. The cleanest possible test of whether intent and the editorial promise alone can carry the user to the landing.

Variant A — transactional / minimal paywall without prices, single CTA bouncing to landing

B · Social proof

"Don't stop at the headline" over three reader avatars and a live counter — "X people are reading this story". Tests whether the social bias of seeing peers already inside the story shifts the decision. No price, no benefits — just the implication that other readers chose to pay for this exact piece.

Variant B — social proof paywall with reader avatars and live counter

C · Value-based

"Everything your subscription includes", followed by "Discover the benefits of being an influential reader" and four benefit icons — unlimited access, exclusives, newsletters, comments. Tests whether making the value proposition explicit and visual shifts the decision more than minimal intent or social proof.

Variant C — value-based paywall with four benefit icons

Experiment performance

4 arms Weights 50.02 / 16.66 / 16.66 / 16.66 — control plus three without-prices variants (A, B, C).
99.92% Of the target audience covered (non-subscribers without access to EC Exclusivo). Effectively the entire relevant segment.
Control wins No without-price variant outperformed the priced paywall over the test period. Conversion data and behavioural micro-events both pointed in the same direction.
Several weeks We tested it until the conclusion was clear, then deactivated the experiment and shifted focus to redesigning the winner.
50% Reserved for Control permanently. Became a team rule for any future paywall experiment: no test ever risks more than half the revenue.

Key Metrics

Consolidated data from production. We tested it for several weeks until the conclusion was clear. The headline read: the priced paywall won — no without-price variant moved the needle enough to replace it.

Key Decisions

Five decisions that defined the system. Each one started as a tension with stakeholders — and ended up earning its place once the experiment had been running long enough to argue with data.

Decisions and rationale

Control gets 50% of traffic, permanently Splitting four ways evenly would have meant risking the majority of revenue on unvalidated hypotheses. Reserving half for the priced paywall keeps the system safe enough to run indefinitely.
Three without-prices variants, not one The real question was what carries the user when you remove the price, not whether to show it or not. Three variants cover the relevant levers: minimal intent only, social proof (peers already inside the story), and explicit value framing through benefits.
Without-prices variants bounce to a landing Consistent with the hypothesis: if the value proposition fits in the small paywall, a dedicated landing should close it better — full SKU comparison, bundles, multiple CTAs. The paywall hooks; the landing sells.
Invest in improving the winner, not in new strategies Once the control was confirmed as the winner, the effort was better spent making it better than testing another alternative. The test had already done its job by pointing at the option worth doubling down on.
The redesigned priced paywall — aspirational message, Annual plan highlighted with -20% badge

Redesigning the winner

The test confirmed the priced paywall. Four changes made it into the redesign:

Aspirational headline. "Discover the stories behind the headlines" replaces "Pick the plan that fits you best".

Visual hierarchy. Annual plan highlighted with a -20% badge — the recommendation is set, not left to the user.

Per-month framing on both plans. 6€/3 months (3.25€/mo) and 29€/yr (2.4€/mo). Absolute and unit price coexist.

Action verb in the CTA. "Subscribe to read" replaces the generic "Subscribe".

Learnings & Notes

  1. 01

    A test that confirms what was already there is still a test worth running.

    The priced paywall won. That's not a failed experiment — it's a clear answer about where to push next. Without the without-prices variants in the test, the redesign of the priced paywall would have been a guess. With them, it had a real base.

  2. 02

    Losing variants gave us the words for the redesign.

    The new headline on the redesigned paywall — "Discover the stories behind the headlines" — came straight from the language we tried in the value-based variants. The variants that didn't win weren't wasted: they were the source for what worked.

  3. 03

    Designing three real alternatives is also how you test what already works.

    The three without-prices variants weren't easy to beat. Each one tried a real angle — minimal intent, social proof, explicit value. The priced paywall didn't win by being safer; it won while the others were doing their best. That made the case for keeping prices visible — and for the redesign that followed — much harder to push back against.

All Projects