- The Optimizely Home Page
- The Six Steps
- Step 1: Create a Variation
- Step 2: Set Goals
- Step 3: Set URL Targeting
- Step 4: Set Audiences
- Step 5: Set Traffic Allocation
- Step 6: Preview and Test
- The Results Page
- Testing Strategy
In this article, you'll find our videos designed to help you use Optimizely and run effective A/B tests!
The Optimizely Home Page
These videos provide an overview of the Optimizely Home Page and the features and settings you can access from it.
The Home Page Overview
The Optimizely Home page helps you manage your project experiments, audiences, dimensions, integrations, collaborators, and settings. It's the central hub of your Optimizely account. This video will give you an overview of the features and settings you can access from the Home page.
The Optimizely Snippet
Before you can run Optimizely on your site, you have to install the Optimizely snippet in the head tag of each webpage you want to test. This video walks you through how to get Optimizely set up on your site.
In Optimizely, users are called collaborators. This video will walk through how to add, remove, and change user roles for collaborators on your team.
Projects are designed to help you better organize your experiments. This video will show you how to create, switch, rename, and manage projects.
There are three types of experiments you can run in Optimizely. This video will give you an overview of each type of experiment and the different statuses that an experiment can be in.
Experiments can be archived and duplicated. This video will show you how to manage your experiments and create new ones.
When we select a specific experiment inside a project, some key information appears in the right sidebar. This video will give you an overview of the information and settings you can access in the experiment sidebar.
The Six Steps
There are six essential steps in each Optimizely experiment. This section will show you each step in detail.
Step 1: Create a Variation
Making Basic Changes
Variations can be created in the Optimizely Visual Editor. This video will show you how to make basic changes to your webpage and use Optimizely features like: select container, edit style, edit text, edit html, move and resize, rearrange, and more.
The Code Editor
When you make a change using the Visual Editor, Optimizely creates a line of jQuery code that corresponds to the change you made. This video will show you how to use the Optimizely Code Editor to see, or make changes to, the jQuery that has been generated.
Interactive mode allows you to interact with your page as you edit it, as if you were a visitor. This video will show you how to use Interactive Mode to show elements like drop-down menus or remove elements like pop-ups.
The Optimizely Editor lets you modify a page to create variations. But you can also use Optimizely to test two completely different URLs against one another. This video will show you how to set up a redirect experiment, which will redirect your visitor to another page.
Step 2: Set Goals
In Optimizely, you’ll track conversion events by setting up goals. This video will give you an overview of how to set up and manage your experiments’ goals.
This video will show you how to set up Click goals, which track how often your visitors click on a certain element.
This video will show you how to set up Pageview goals, which track the number of unique impressions on a specific page, or subset of pages.
Custom Event and Revenue Tracking Goals
Custom tracking events allow you to capture and report on visitor actions or events that might not be related exclusively to clicks or page views. The revenue tracking goal will track revenue from purchases or events on your site and attribute the amount to the visitor's experiment and variation. This video will show you how to set up custom event goals and the revenue tracking goal.
Step 3: Set URL Targeting
URL Targeting allows you to specify the pages on which the experiment should run. This video will show you how to target specific URLs or groups of URLs depending on the match type selected.
Step 4: Set Audiences
This video walks you through how to use Audiences, which allows you to control which visitors can see your experiment, based on whether they match a list of conditions that you specify.
Step 5: Set Traffic Allocation
This video will show you how to set Traffic Allocation, which you use to specify the percentage of visitors who will be included in an experiment and what percentage of those visitors will be shown a certain variation.
Step 6: Preview and Test
Do a quick basic check that your variation is appearing, that it looks good, and that there’s no page flashing. You have two quick tools at your disposal: Preview Mode and something we call the Force Parameter. This video will show you how to use these tools to do basic QA for your experiment.
The Results Page
The Results Page Overview
Optimizely's Results page allows you to see your experiments' performance and explore your visitors' behavior. You can use the results on this page to make key business decisions based on the data you see. This video will give you an overview of the features and settings you can access from the Results page.
Winners and Losers
This video shows you how to check if a variation won or lost, and how to compare your different variations.
The conversion rate is a measure of the percentage of visitors who converted on the goal that you set. This video explains how Optimizely calculates the conversion rate and uses it to decide which variation won.
Statistical significance is a measure of how confident you can be in your results at that point in time. It can help you decide whether to keep the test running or to call a variation a winner and launch it to your site. This video explains how Stats Engine calculates statistical significance, and how you can change the significance level to suit your business' tolerance for risk.
The difference interval shows you a range of values where your conversion rate is likely to lie, depending on the statistical significance threshold. It helps you interpret the trend of your data. This video walks you through an example of how to read the difference interval.
Charts show you how well your experiment has been performing over time. You can use them to explore conversion rates for variations, compare different goals, share your results with stakeholders, and more. This video shows you how to find, view and share your charts.
Segments allow you to filter your results, giving you valuable insights about different groups of visitors. This feature can help inform the next steps you should take in your testing program. This video shows you how to filter by segments on your results page.
More on Optimizely Results
This video, presented by Lev Tatarov (Strategy Consultant), will take you through the process of learning many things you probably did not know about Optimizely results. It will go into statistical significance, risk mitigation, and how to read and report on results correctly in 7 minutes.
Testing for Impact: Top Ways to Ensure ROI from Testing
This video, presented by Ryan Lillis (Strategy Consultant), will walk you through the process and strategies that help you get the most ROI from your Optimizely experiments. Topics include organizational structure, project planning, brainstorming test ideas, forming hypotheses, and effective testing strategies.