Here are six lessons for marketers from the “Replication Crisis” in the sciences to keep in mind as you design your next round of A/B tests. Nathan Labenz on March 25, 2019 In today’s digital-first advertising world, many marketing leaders aspire to conduct marketing as a science. We speak in scientific terms – precision, … Continue reading Are your A/B tests just junk science?
Lorraine Pavel — February 4, 2019 Follow @marketdigibook — February 4, 2019 Anyone in business, whether new or experienced, wants their message or product to impact their target and eventually have high conversions or gain more customers, right? Site owners often leverage analytics on their sites but most of them forget to leverage the data … Continue reading What Is A/B Testing? Learn How to Run One Here
Zach Heller — November 30, 2018 Follow @zheller — November 30, 2018 Subject line testing is a crucial part of any email marketer’s role. It is singularly one of the simplest and most effective ways to improve the performance of an email marketing campaign. But saying it is simple is one thing. So today I … Continue reading The Complete Guide to Subject Line Testing
Zach Heller — November 28, 2018 Follow @zheller — November 28, 2018 geralt / Pixabay A common refrain from the conversion rate optimization world can be heard after a failed test: “Well that didn’t work. What’s next?” It is easy to assume that your testing strategy is flawed when you can’t find wins. Failed … Continue reading What You Can Learn from a Failed Test
Derek Gleason — November 22, 2018 — November 22, 2018 qimono / Pixabay You regularly run A/B tests on the design of a pop-up. You have a process, implement it correctly, find statistically significant winners, and roll out winning versions sitewide. Your tests answer every question except one: Is the winning version still better than … Continue reading Hold-Out Groups: Gold Standard for Testing—or False Idol?
Ana Gotter — November 11, 2018 Follow @ana_gotter — November 11, 2018 We talk a lot about how important split testing is. Split testing (or “A/B testing”) allows you to test multiple variations of your ad campaigns to see your audience responds to, and from there you can start to work out why. Before you … Continue reading Split Testing 101: How to Actually Split Test Facebook Ads
Aleks Nikitina — September 5, 2018 — September 5, 2018 When it comes to PPC campaign management and optimization, A/B testing is key. In my past life working for agencies and directly with brands, we tested new creatives every two weeks. By constantly running these tests, we were able to better understand which exact wording … Continue reading Running an A/B Test with Google Drafts and Experiments
Rudly Raphael — July 31, 2018 — July 31, 2018 StockSnap / Pixabay First, let’s be honest. Although it is now a commonly used term, if you’re not familiar with “cluster sampling”, it can come across as a bad episode from the Twilight Zone. There’s something eerie about the word to make one feel like … Continue reading All You Need to Know About “Cluster Sampling”
Mike Moran — June 24, 2018 Follow @MikeMoran — June 24, 2018 Everyone wants to be data-driven these days, so A/B testing is all the rage. Too often, however, I run into clients that run dozens of tests a month and come back with the disheartening results: Not enough repetitions to know the right answer. … Continue reading How Do You Know How Long to A/B Test Your Website Changes?
T.J. Prebil — June 14, 2018 — June 14, 2018 Optimizing your customer experience requires a dedicated, ongoing commitment to testing. This is true across channels – from your website to your email and ad campaigns and your mobile app experiences. To drive results, you need to test, test, test, and then test some more. … Continue reading The Evolution of A/B Testing in a 1-to-1 World