Imagine this scenario: you’ve just run your first few A/B tests and taken action based on the results. The primary call-to-action button on your homepage is now orange instead of gray. Extra steps in your checkout funnel have been removed to reduce friction. You’re wondering: where does the next great idea come from? Maybe you have several ideas; which do you choose?
There’s a good chance these questions sound familiar to you, even if you’re part of a mature experimentation program. Many teams, no matter the size, face a shared set of challenges when it comes to building an impactful, data-driven practice. These challenges include how to research, ideate, plan, develop and interpret the results of tests and campaigns to maximize impact.
Optimizely makes it easy to experiment with and personalize your website. Below, we offer a series of articles to guide you through the strategy and practice of running an experimentation program.
There are five major stages in the Optimization Methodology:
Your team works through each of these stages, from ideation to production, with every experiment you run. This iterative cycle helps your testing organization continually learn from and improve your site experience, to drive business goals.
The articles below help you plan more effectively through each stage. So, when you analyze results in production (stage 5), you can monitor how improvement in one test affects other valuable revenue sources on your site -- because you set up monitoring goals in design (stage 3). Or, you can turn interesting data in your results into the next great idea you'll test (stage 2).
In this series, you’ll find:
Strategic recommendations for building a powerful, sustainable program
Actionable templates to help you jump right into prioritizing, designing, and sharing your experiment and campaigns
Resources to help new teams and more mature testing organizations build a strong, data-driven culture
Learn the strategy of experimentation like deciding what to test and how to prioritize in our free, interactive trainings sessions.
1. Implement Optimizely and establish your experimentation program
First, establish an optimization framework that prepares your team for longterm success. You’ll complete this phase once and revise only based on significant program or company-level changes. But you’ll consult the resources often to orient your efforts. So, tackle these steps early.
2. Decide what to test
Once you set the direction for your program, it's time to research and brainstorm ideas for testing and personalization.
3. Organize your experiments
Next, you’ll prioritize, plan, and design individual tests.
4. Build and run your experiment
Create your experiment in Optimizely. Before you publish it live to the world, QA to make sure it’s set up the way you want. Then, launch it!
5. Analysis and take action on your results
Analyze your results, and take action based on what you find. More importantly, use the insights that you’ve generated from your winning, losing, and inconclusive tests to design the next round of tests and campaigns.
Every optimization team is different. As your program grows, the iterative cycle from ideation to production will help you adapt your process to meet the changing needs of your testing organization.
If you’re interested in discussing A/B testing strategy and Personalization strategy with other experience optimization professionals, join the Optiverse Community. Subscribe to the Optimizely Blog for more tips from experts in the field. Happy testing!