What “Test and Learn” Looks Like in Practice

One of the core attributes of an effective digital team is a focus on creating a “test and learn” culture. And what digital marketing experts mean when talking about a “test and learn” culture is one where you put an emphasis on testing your assumptions about your marketing activities, learning from those tests, then doubling down on the areas that work; in other words, fish where the fishin’s good.

To do this successfully, of course, you need data. And it can seem complicated to understand what data is most critical to your business. But there are really only a small handful of questions you need to answer, that you must have the data for, to ensure you’re well positioned to effectively test your digital marketing activities and learn from those tests.

So what is this data? I’m glad you asked.

It’s fairly straightforward to find out where to focus your efforts. First, you need to answer these five questions:

1. What are your conversions? What are the actions you want your customers to take? Do you want them to buy on your website or mobile app? Or are you in a lead-generation business and want them to provide contact information? Each is equally valid and provides a key building block for creating a test and learn culture.
   
2. How much are those conversions worth to your business? Exactly what it sounds like. If you’ve got an e-commerce site, how much is a typical transaction worth to you? If you’re using lead generation tactics, what’s a lead worth? (If you don’t know the answer to that, think about what a customer is worth, then multiply by the rate you convert leads to paying customers. If you don’t know the answer to that, start by dividing your new customers added by the number of leads generated each month.)
   
3. Which pages get the most traffic? Again, pretty much what exactly what it sounds like. Which pages on your site attract the most traffic? Whether your analytics suite calls them landing pages or entry pages or what-have-you, you’re interested in finding out where prospects start their journey on your website or app.
   
4. How often do customers reach your conversion page from each of your top entry points? You’ll use this data to assign an economic value to each entry page and to determine the potential value each test can deliver.
   
5. What other pages send customers deeper into your purchase funnel? Most analytics tools can tell you how often any given page leads to a specific conversion action. You’ll use this data to learn which pages contribute to conversions even if they’re not top entry pages.

Armed with the answers to these five questions, you’re immediately positioned to improve your digital marketing activities.

For instance, let’s imagine you run a mid-sized enterprise software company and that one of your top entry pages leads to a conversion – in this case, submission of a lead form – 10% of the time. If we assume that each lead you convert is worth $ 10,000 annually to your company, each visitor to your site (or app, whatever) starting on that entry page has a potential value of $ 1,000 ($ 10,000 * 10% = $ 1,000). If the page gets a lot of traffic, you may want to work towards improving that 10% “micro-conversion” rate. By contrast, if the page gets very little traffic, that should lead you towards testing how to get more traffic to the page to begin with. The following graphic illustrates how to approach this for your business:

I realize this may almost sound too good to be true. And in part, this is a simplified version of a more in-depth approach. It usually also takes some work to collect and refine the data necessary to answer each of these 5 questions for each of your top entry pages as well as the top pages leading to conversions. However the most successful marketers tend to follow the Pareto principle — that is putting most of your efforts into the areas that will get you 80% of your return. It’s not about following a complicated process; it’s about focusing on the areas with the greatest return.

Creating a test and learn culture starts and ends with data. But in the middle it depends on using that data to ask the right questions about your customer needs and generate the greatest return on your efforts. Of course, if you think I’m wrong, there’s an easy way to find out: test my theory. And learn for yourself.

(52)