A/B Test Landing Pages With One Short Link

A/B Test Landing Pages With One Short Link: equal split, UTM tags and how many visitors you need

A/B testing two landing pages doesn’t need a testing tool if the traffic comes through one link. A Capsulink smart link with two destinations and no conditions splits clicks equally between them (How does the targeting work?). Add a different utm_content to each page URL, and Google Analytics shows which page converts better. The link you share stays the same during and after the test.


Diagram: an ad, email, post or QR code uses one short link that splits clicks 50/50 between page A with utm_content=page-a and page B with utm_content=page-b, conversions counted in GA4

The short link splits the traffic, GA4 compares the results.

How the equal split works

When a smart link has several destinations and no targeting rules, Capsulink distributes the redirects equally. The help center’s example uses three test pages, so each gets 33.33% of clicks. With two pages, each gets half.

Annotated Capsulink screenshot of cli.re/blog-demo-ab with two smart URLs, page-a and page-b, both marked Evenly because no targeting conditions are set

The demo link cli.re/blog-demo-ab, set up for this post.

Setup in Capsulink:

  1. Create a short link. Its default URL can be either page.
  2. Open Smart Links, add page A’s URL and save it without any targeting condition.
  3. Add page B’s URL the same way. Both show “Evenly”.
  4. Share the short link everywhere the test should run.

Smart links come with paid plans. Rules by country, language, device and time use the same screen, see one link for the App Store and Google Play.

Tag each page so GA4 can tell them apart

Give the two destination URLs the same utm_source, utm_medium and utm_campaign, and a different utm_content:

Variant Destination URL ends with
Page A ?utm_campaign=spring&utm_content=page-a
Page B ?utm_campaign=spring&utm_content=page-b

In GA4, open Traffic acquisition, add Session manual ad content as a secondary dimension, and compare key events for page-a and page-b. The two pages can also be two completely different URLs. The tags work the same way. See the UTM parameters guide for naming.

How many visitors you need

A test needs enough visitors per page before a difference means anything. The numbers below come from the standard two-proportion sample size formula, at 95% confidence and 80% power:

Bar chart of visitors needed per page at 95% confidence and 80% power: 686 for 10% to 15%, 1,471 for 5% to 7.5%, 3,826 for 2% to 3%, 3,841 for 10% to 12%, 8,158 for 5% to 6%

Visitors needed per page. Small lifts need large samples.

Page A converts Page B converts Visitors per page
10% 15% 686
5% 7.5% 1,471
2% 3% 3,826
10% 12% 3,841
5% 6% 8,158

A page converting at 5% needs about 8,158 visitors per variant to reliably detect a lift to 6%. Low-traffic tests should aim for bigger differences between the pages, like a new offer, not a new button color.

Rules for a clean test

The same link can be printed in a QR code, which makes offline A/B tests possible too: two flyer offers, one code. More in how to track QR code scans.

FAQ

Can I A/B test landing pages with a link shortener?

Yes, with a smart link that splits traffic between two destinations. Capsulink splits equally when no targeting rules are set.

How do I see which page won?

Tag each destination with a different utm_content and compare conversions per utm_content in Google Analytics.

How long should an A/B test run?

Until each page reaches the visitor count your expected lift needs, and at least one full week.

This article is about:

Alexander Bickov

Alexander Bickov is a digital product designer with over 15 years’ of experience in UX/UI design and digital marketing. Through his work, he aims to connect people and products using strategy, creativity and technology. Alexander has built digital services and products for many different organizations ranging from small startups to large companies. His projects has been featured in the iOS App Store, Wall Street Journal, CNN, Business Insider, Forbes and Big Think. You can find him on Twitter and LinkedIn.

Join as contributor

Become a contributor and help our readers level-up their digital marketing skills.

Subscribe to newsletter

Receive the latest digital marketing, content marketing, and social media tips straight to your inbox.

Brought to you by Capsulink, a simple custom link management platform

All-in-one Custom URL shortener that allows you to gain deeper control over your links. Includes Smart links, Branded links, API URL shortener and more.