- Pause, archive, and change tests
- Use the Experiments dashboard
In Optimizely X Full Stack, you'll use the Experiments dashboard to pause, archive, and change tests.
Here's our developer documentation, where you'll find code samples, full references for our SDKs, and getting started guides.
Pause a test
To pause a running test, click the Actions icon . Choose Pause from the dropdown menu for the environment you want to pause. After pausing a test, all users will start to receive the original experience.
Pause a variation
Once you've started an SDK test, you cannot delete a variation. However, you can pause variations instead. When you pause a variation, traffic from that variation will be redistributed among the test's other variations, but the results will still be accessible for the paused variation.
Clicking Confirm will tell Optimizely to stop sending traffic to Var_1. However, the variation can be un-paused later by clicking Resume.
All previous results will still be available for any resumed variations.
User profiles and sticky bucketing
Pausing a variation is only necessary if you are using Optimizely's user profiles feature. User profiles allow Optimizely users to ensure variation assignments are sticky in any SDK.
If you are working with user profiles and want to ensure that a variation no longer receives any new traffic, you have two options:
Pause the variation, which ensures that it will no longer receive any traffic, or
Set variation traffic distribution percentage to zero, to ensure the variation will no longer receive new traffic, while users who have previously been exposed to the test will remain in their assigned variation.
If you haven't implemented user profiles in the SDK, pausing a variation is no different than setting that variation's traffic distribution percentage to zero. See the Optimizely developer docs for more information on implementing user profiles. You can also learn how bucketing works in Optimizely Full Stack.
Archive and un-archive a test
Archive a test to remove it from the Experiments dashboard. Optimizely keeps your test data, so you can unarchive the test later if you wish.
To archive a test, click the Actions icon for the test and choose Archive from the dropdown menu.
Here's how to unarchive a test, with step-by-step instructions below:
Click the filter menu and choose Archived from the dropdown.
Click the Actions icon for the test.
Choose Unarchive from the dropdown menu.
Change test parameters
You can change the test parameters, such as traffic allocation, variations, audiences, and events directly in the Experiments dashboard.
Here's a quick walkthrough. Scroll down for step-by-step instructions.
Click the test name to open the Edit A/B Test modal.
Change your test parameters as desired.
Click Save Experiment.
Changing your tests will update your project’s datafile within a few seconds. It may take some time before your tests are updated in production, depending on how often you retrieve datafile updates.
If you want your tests to update in real-time, use Webhooks to receive datafile updates.
In Optimizely X Full Stack, be careful when you’re changing test parameters, especially the experiment key and variation keys for a running test.
Don’t change the experiment key or variation keys unless you’re making the corresponding changes in your code. If you use a key that isn’t referenced in your code, no traffic will be sent to that test or variation.