Category Archives: A/B Testing Process

Hold-Out Groups: Gold Standard for Testing—or False Idol?

Derek Gleason — November 22, 2018 — November 22, 2018 qimono / Pixabay You regularly run A/B tests on the design of a pop-up. You have a process, implement it correctly, find statistically significant winners, and roll out winning versions sitewide. Your tests answer every question except one: Is the winning version still better than … Continue reading Hold-Out Groups: Gold Standard for Testing—or False Idol?

A Detailed (Step-By-Step) Look at Effective Ecommerce A/B Testing

David Hoos — May 31, 2018 Follow @davidhoos — May 31, 2018 Let’s start with the good news. You’re running a fairly successful ecommerce site. You’re making a decent amount of revenue and things are chugging along nicely. But it’s not all bubblegum and roses. Frankly, you’re having challenges. Your store’s ecommerce conversion rate – … Continue reading A Detailed (Step-By-Step) Look at Effective Ecommerce A/B Testing