Mohsan Ebadian
20.11.2019

Facebook Ads A/B test guide

Facebook Ads A/B testing is crucial to understanding what marketing content works best. Datasine’s PPC Manager outlines how Facebook Ads A/B tests work in this simple guide.

What is A/B testing?

Facebook A/B testing is when you experiment with various elements in your advertising campaigns to decipher what drives higher performance. As you discover things that perform well (and implement them) as well as things that hinder performance (and eliminate them), you should see your campaign performance gradually increase. In Facebook Ads, A/B tests can be through the platform’s split testing functionality.

Facebook-ads-testing

How to A/B test in Facebook Ads

The first thing you need before you begin A/B testing is a hypothesis. In the example below, we test the hypothesis: photo ads work better than graphic-only ads.

AB-testing-guide

The results from our Facebook Ads A/B test

The results above clearly verify our hypothesis that ads with photos perform better than graphic-only ads.

But one test alone isn’t enough to test our hypothesis. We need to conduct several ‘photo vs graphic-only’ experiments to verify or falsify our hypothesis with certainty, because there could be many factors responsible for one ads’ success over the other. 

What to A/B test in Facebook Ads?

Ad visuals 

Most people running campaigns in Facebook Ads have done some research into or have experience of the audiences, devices and even copy that tend to perform well. And even if they don’t, Facebook Ads’ platform does an incredibly good job of optimising automatically using machine learning so long as you have a diverse number of ad sets in your campaigns. 

There is one thing however which is the most crucial to a successful Facebook Ads campaign: your ad visual. It is the element that stops your target audience in their tracks and grabs their attention. All other aspects of your ads (e.g copy and landing page) really only come into play if you have a good visual to get your target audience to look at your ad in the first place. 

split-AB-testing

But while Facebook’s platform is really good at optimising many aspects you can set at ad set level – such as audience, placements, device, etc. – it’s not as straightforward when it comes to your Facebook Ad visuals. 

Suppose you put two different images in your ad set, one close-shot and one long-shot of a person holding your product: if the long-shot does better, it doesn’t necessarily mean that it was the long-shot aspect that was the cause of success. It may be that it was actually the colour blue (featured more in the long-shot) which drove the higher performance. And, in fact, a close-shot with the emphasis of blue actually performs better than long-shots.

While you can test ad visuals using A/B testing to an extent – and you definitely should to get the most out of your Facebook Ads A/B testing – there are infinite variations to test, so this could end up being an endless experiment. Instead, focusing on the features in your ad visuals and conducting semantic content analysis can help cut back time and money spent on experimentation, while increasing ROI.

psychology-AI-semantic

Content features our AI tool, Connect, found in this image

But, in order to scale this process, a marketer needs an AI or a machine learning model which can conduct semantic content analysis in moments.

This is where Connect can help you. The AI platform analyses your historical performance and gives you insights into what features are resonating with your audience, and which aren’t. Better still, it can use this information to rate and rank your ad visuals according to how effective they are going to be. 

Connect-House-Ad

So going back to our example, Connect’s AI will analyse the performance of your various ads and all the aspects within your ads and tell you that it was the colour blue that made the ad appealing. With this tool, therefore, you can supplement your investigation and creativity with data to save you time and money. You can try Connect for free today, with a limited time 14-day trial

Ad copy

Much like ad visuals, ad copy is something that requires the common sense and creativity marketers’ possess rather than something Facebook Ads’ platform can optimise with its machine learning alone. 

But, ad copy can still be optimised with Facebook’s machine learning algorithm through A/B testing. For example, testing exclamation marks, emojis, capitalisation and certain phrases can be done quite easily with dynamic ads and can show what copy is resonating most with your audience.

Facebook-ads-copy-AB-test

Other elements

Here’s some other elements to test but we recommend where possible to leverage  Facebook’s machine learning instead of manually A/B testing. For instance, let’s say you want to test different placements, it’s easier to select automatic placements with conversion optimisation and allow the platform to gradually select the highest-performing placement for your campaigns.

  • Interest-detailed targeting
  • Demographic-detailed targeting
  • Gender
  • Age
  • Geo-location
  • Landing page

_____________________________________________________________________________________________________

Three Facebook A/B testing rules

  1. Ceteris paribus: The Latin phrase meaning “other things equal”. In our context, it means that Facebook A/B tests should only test one element at a time. So if you’re testing blue vs red, absolutely everything else (audience targeting, placements, ad copy, etc.) must be the same.
  2. Statistical significance: Just because an experiment seemingly verifies or falsifies a hypothesis, it doesn’t mean that it actually has. In order for the test to be valid, you have to have a sufficient amount of volume to your ads. There are plenty of statistical significance calculators on the web to help you with this. However, sometimes it’s not just about a simple calculation but about using common sense. For example, in our graphic-only vs photo test, there are many elements involved which cannot be controlled so it makes sense to test a diverse range of photo and graphic-only ads to get an accurate result from your experiment.
  3. Performance compass: Let performance, specifically cost-per-conversion, guide and measure your results. An increase in CTR is great but if it came at the cost of a higher CPA then, although there is some learning that could be derived, you haven’t directly found anything that drives higher performance for your campaigns.

_____________________________________________________________________________________________________

How to set up a split test in Facebook Ads

Step 1: Create a campaign.

Step 2: Turn the split test toggle on. (Note: The campaign budget optimisation toggle has to be turned off to be able to do this.)

Step 3: Choose a variable (creative, delivery optimisation, audience, placement and more than one).

Step 4: Choose the number of ad sets (from two to five).

Step 5: Set the aspects you want to test separately to those which you do not. For example, if you wish to test ‘Creative A’ vs ‘Creative B’, then select the ad sets and edit at the settings at the same time since all these should remain constant. After that, you can put in the creatives in each ad set in turn.

For more detailed instructions for split testing on Facebook Ads, check out Facebook’s own split testing guide.

newsletter-house-ad

Filter by Category:
Jergan Callebaut
The AI Tool Marketers Are Using to Increase Facebook Campaig...

A new breed of marketing tools is here that leverages machine learning and psychology to pick high-converting creatives for your Facebook ads.

READ MORE
In Conversation with… Bernardo Nunes, Head of Science at G...

Growth Tribe’s Bernardo Nunes joins the conversation to talk artificial intelligence in marketing: how companies can leverage AI and cultivate tech talent.

READ MORE
Use AI to identify high-converting marketing images

Cutting-edge AI (artificial intelligence) research into how computers see marketing images is changing the way marketers build more successful campaigns.

READ MORE
Speaker spotlight: Mitch Platt, UK Country Manager at Growth...

Datasine discusses growth marketing, personalisation and AI adoption with Mitch Platt, UK Country Manager at Grow Tribe, ahead of his presentation at #SuperchargeMarketing.

READ MORE
In Conversation with… Mohamed El Hannaoui, Growth Marketer

Experienced Growth Marketer Mohamed El Hannaoui joins the conversation to talk growth marketing in startups and how AI is going to change marketing

READ MORE
Speaker spotlight: Emily Miller, Head of Marketing at Ollie ...

Datasine talks marketing, AI and personalisation with Emily Miller, Head of Marketing at Ollie Quinn, ahead of her fireside chat at #SuperchargeMarketing.

READ MORE
Your images matter: five reasons why

Got your attention with the picture above? Great! I’m sure you’ll love the rest of this article. It probably doesn’t come as a surprise to you that we live in the age of visual culture. Ten percent of all photos ever taken by humankind took place in the last 12 months.

READ MORE
In Conversation with… Harry Hugo, Co-Founder of The Goat A...

Serial Entrepreneur and Co-Founder of The Goat Agency, Harry Hugo, joins the conversation to talk social media, influencer marketing and founding Goat.

READ MORE
Speaker spotlight: Mack Grenfell, Biddable Lead at Babylon H...

Datasine talks to Mack Grenfell, Biddable Lead at Babylon Health about falling into the industry, and how AI is helping marketers optimise spend.

READ MORE
In Conversation with… Meagan Healey, Head of Content &...

Head of Content & Product Marketing at Attest, Meagan Healey, joins the conversation to talk data-driven marketing and why aligning sales and marketing is a game changer.

READ MORE
Speaker spotlight: Karla Rivershaw, Head of Marketing of Tur...

Datasine discusses the tools that make marketing work, and finding the right balance when personalising communications with Karla Rivershaw, Head of Marketing at Turtl.

READ MORE
Forms of personalisation in today’s digital world

Personalisation means connecting with your audience on a deeper level. Our Head of Psychology, Jergan Callebaut, looks at its many forms.

READ MORE
Nine Mailchimp integrations for personalisation

Check out our top nine Mailchimp integration picks for empowering marketers to increase campaign metrics and improve customer experiences.

READ MORE
What makes us click? Increase ad performance with content da...

Datasine’s CEO Igor Volzhanin outlines his MAD//Fest presentation, explaining why using content data and AI leads to a steep increase in ad performance.

READ MORE
Three Mailchimp newsletter growth hacks

Email is one of the most effective marketing channels and Mailchimp has long been a favourite amongst marketers and growth hackers. Learn how to up your Mailchimp newsletter game with our growth hacks. 

READ MORE
Speaker spotlight: Emma Wynne, Head of Growth Marketing at P...

Datasine talks about personalising marketing communications and marketing tools with Emma Wynne, Head of Growth Marketing at Pasta Evangelists.

READ MORE
The three must-ask questions before a rebrand

Datasine’s Marketing Director, Cornel Lazar, shares the questions each brand must ask before rebranding, and Datasine’s journey to change its look and feel.

READ MORE
Growth hacking Facebook ads

Growth hacking Facebook ads sends engagement skyrocketing and there are many ways to optimise paid ads to drive brand awareness and sales.

READ MORE
Adtech vs martech: what’s the difference?

Adtech and martech are terms that are regularly conflated. Let’s put aside misconceptions to define adtech and martech – and their differences.

READ MORE
Mirroring at scale

How mirroring can help you level up the impact of your one-to-many communications, offering personalised content and customer experience.

READ MORE
Which images make the most successful Facebook ads?

Images are the cornerstone of successful Facebook ads. We look at how to find the best images to create more effective Facebook ads.

READ MORE
How AI is set to transform email marketing

Artificial intelligence (AI) is increasingly used in email marketing, learn how machine learning enhances personalised email campaigns.

READ MORE
From idea to martech: combining psychology with AI for bette...

Igor Volzhanin, our CEO, explains what started Datasine, a martech platform combining psychology and AI for better customer experiences.

READ MORE
Marketing 20:20: meet the Speakers

Datasine sits down with the two guest speakers of Marketing 20:20, Becky Simms, Founder and CEO of Reflect Digital and Social Media Expert Kieran S Lawler

READ MORE
What is a rebrand? (And what is it not?)

I sat down with our Marketing Director to discuss what a rebrand is, what goes into a rebrand and how Datasine approached the project.

READ MORE
Five of the best tools for Facebook Ads in 2020

Datasine looks at the five of the best – and most affordable – tools on the market for creating and optimising Facebook Ads.

READ MORE
Semantic content analysis will disrupt marketing – for the...

Discover the benefits semantic content analysis brings, and how to utilise data, psychology and AI to predict the highest-converting content for your brand.

READ MORE
MAD//Fest Day One: the recap

We look back on our first day at MAD//Fest with presentations from Burger King, Virgin Trains and our own CEO Igor Volzhanin.

READ MORE
Five things we learned at Supercharge Marketing

Datasine looks back at the five things we learned at Supercharge Marketing, from data-driven marketing to investing in learning new skills.

READ MORE
Delivering truly personalised email marketing experiences

Datasine sits down with Lemlist CEO Guillaume Moubeche to talk about delivering personalised email marketing experiences and building relationships.

READ MORE
What is segmentation in marketing?

Segmentation in marketing allows marketers to place customers into groups for targeting. We take a look at the types of market segmentation.

READ MORE
A quick guide to remarketing with Facebook dynamic ads

Facebook dynamic ads, or Facebook product ads, let you remarket to your audience. Find out how to use them in this simple guide to DPA ads.

READ MORE
Can AI optimise the creative process?

While artificial intelligence (AI) has had little impact on the creative sector so far, AI has huge potential to optimise ad creatives

READ MORE
How to grow your brand using paid social

Brand Manager and Founder of Maxtractor.agency, Magda Urbaniak, shares her best practices for brands paid and organic social efforts

READ MORE
Running a data-driven marketing team

Data-driven marketing is a key focus for marketing teams today. I spoke with Alessio Pieroni, Head of Marketing at Mindvalley about how to practice it successfully.

READ MORE
What’s the most important part of Facebook Ads? The creati...

The data boom has driven focus on areas such as targeting, brand and reach for Facebook Ads, yet the creative remains the most impactful factor in successful Facebook Ads

READ MORE