relevant products:
  • Optimizely Classic

This article will help you:
  • Run experiments that compare different combinations of changes
  • Set up a multivariate experiment in Optimizely Classic
  • Add variations and sections to the experiment
  • Allocate traffic among variations and sections
 
Note:

Multivariate testing is not available to all account types. If you don’t see this feature in your Optimizely account, or want to learn more about what’s available, please refer to our Optimizely Classic packages matrix.

For an overview of the pros and cons of multivariate experiments, see our article on experiment types.

Multivariate experiments allow you to create a few simple changes on your page and test how the different combinations of changes affect the page's performance.

In this article, we'll walk through the five steps in creating a multivariate experiment:

  1. Create a new experiment

  2. Set experiment type

  3. Add variations

  4. Add sections

  5. Allocate traffic

1. Create a new experiment

To create a multivariate experiment, start the same way you would to create a regular experiment:

  1. From the Home page, click New Experiment.

  2. Type a name for the experiment and the URL of the website you’d like to test.

  3. Click Create Experiment.

Your new experiment will load in the Editor.

2. Set experiment type

  1. In the Editor, click Options > Experiment Type.

    205808798 (1).png

  2. Select Multivariate Test.

    200028420 (1).png

  3. Click Apply.

Next, you'll add variations and sections to your experiment. Each variation/section combination will be tested in your multivariate experiment.

3. Add variations

The Editor automatically loads a page you can use to create Variation #1 for Section #1 (more about sections in the next step).

Click + Add Variation to create more variations. In this example, the variations will test the language on the button (the Original, 'Search It!', and 'Google It').

200612500 (1).png

You can change the name of a variation by clicking the dropdown in the Variation menu.

To see how a variation's changes will display, click the dropdown arrow next to the variation name and select Preview.

4. Add sections

When you selected Multivariate Test, the + Add Section option appeared above the Variation tabs.

200612490 (1).png

Sections are separate A/B experiments that all run at the same time (for example, a button, image, headline, and line of text). Your multivariate test will have more than one section, and each section will have multiple variations--that's how the multivariate test helps you determine which combination of variations performs the best out of all of the possible combinations.

In this example, for Section #2, you'll choose the two different images on your page. Click Add Section and make your changes.

Like variations, you can change the names of sections by clicking on their names.

Sections are applied from left to right. In our example, the Button section will run first, and the Image section will run after it. This is important if you're running a multivariate test that affects the same element in two different sections.

5. Allocate traffic

In the Editor, navigate to Options > Traffic Allocation:

200612520 (1).png

In this example, 33.3% of your visitors will see each of the variations from the two sections. The visitors do not have to see the same variation from each section--they will be randomly assigned to one variation from each section. You can change the traffic allocation by typing in new percentages, but don't forget to make sure they add up to 100%. When you're finished, click Apply.

When you go to the Results page, you will see all of the possible combinations that your experiment generates.