Log In
Members
Home
Add Reply
Add Topic
Topic RSS
QuoteHey John,
I'm also wondering how split testing is different from just putting two ad sets in the same campaign ? I've never used split testing before (just dynamic creative) but noticed there is a toggle for it at the campaing level. Wondering about testing my video ad against an image ad.
Thanks,
Karen
9:20 am
June 9, 2011
Offline
Hi Karen,
Steve here from support.
When running two ad sets within a campaign, you could simply be targeting two different audiences, each with its own set of ads, which is not a split test at all.
A split test is when for instance you run three ads within the same ad set, to the same audience, with the only difference between the ads being one element of the ad (image, headline, call to action, etc...)
So for instance if you ran three ads with three different images to the same audience, to see which image performs the best with that audience, that is a split test.
Another example would be on your website. For instance if you wanted to split test your squeeze page headline, to see which increases the page's conversion rate, you would create two almost identical pages where the only difference is the headline. Then you'd evenly split the traffic to each version of the page, to see which page emerges as the winner. That's called an A/B split test.
Does that make sense?
2:21 pm
June 7, 2011
Offline
Hi Karen,
In addition to what Steve said, using multiple ads or ad sets to test variables still leaves a lot of the onus on FB's algorithm so it's less of a true split test (though it's not uncommon to still refer to this as a split test).
But the split test option you see in Facebook is a true split test that shoots for statistical significance. As such, it is much more expensive.
Having trouble with your marketing? Wish you could have an experienced direct-to-fan marketing expert look over your actual campaigns, music, or content and offer feedback? Or perhaps you’re just looking for a little one-on-one assistance so you can ask questions that pertain to your specific goals and get a second, more experienced, perspective? Click here to book a session with me now.
Thank you John and Steve,
John, your answer seems to be getting at the understanding I wanted but I'm still a little confused! When you say it's more expensive, you mean you have to wait longer for true statistical significance- but it's a more statistically reliable method than just doing 2 ads ... or it's more expensive in another way ?
Thanks,
Karen
9:09 am
June 7, 2011
Offline
Yes, it is more expensive because you need to get a lot of reach for true statistical significance. I'm not sure if they still have the same minimums, but last I looked at it, most split tests required budgets over $800. Most musicians can't afford to wait that long to make decisions about whether something works or not.
Having trouble with your marketing? Wish you could have an experienced direct-to-fan marketing expert look over your actual campaigns, music, or content and offer feedback? Or perhaps you’re just looking for a little one-on-one assistance so you can ask questions that pertain to your specific goals and get a second, more experienced, perspective? Click here to book a session with me now.
1 Guest(s)
