Skip to main content
menu_icon.png

Have questions about site performance or Google's upcoming search changes? Join our AMA, hosted by Michael Hood (Senior Performance Engineer) on Wednesday, July 11th at 8:30am PST.

x
Optimizely Knowledge Base

Studying for the Optimizely X Platform Exam

Congratulations! By deciding to study for the exam, you are one step closer to becoming certified on the Optimizely X platform!

This study guide consists of dozens of articles that go into depth on every feature in our product, containing knowledge needed to pass the Optimizely Certified User exam.  Please feel free to also browse around our community and read interesting discussions by customers like you. Of course, the best way to prepare is to actually become familiar with using the product by running multiple experiments with statistically significant results.

Once you feel confident with what you've learned, try taking our mock Platform Exam in the Academy. Those questions will give you a peek into what to expect on the actual exam. 

This study guide is made to be taken in the suggested sequence, but feel free to jump around if you already feel comfortable with certain topics. Good luck!

How Optimizely works

Key concepts:

  • A/B, multivariate, and multi-page tests
  • How Optimizely runs on your site
  • How unique visitors are counted in Optimizely
  • Optimizely APIs and their functions
  • Stats Engine and how it differs from other statistical models
  1. Get started on Web Optimization
  2. The Optimizely snippet
  3. Experiment Types: A/B, Multivariate
  4. Implement the Optimizely snippet
  5. The Optimizely Stats Engine

Connect optimization with business goals

Key concepts:

  • How to optimize for smaller KPIs and focus on concrete goals
  • Interpret analytics to identify testing opportunities
  • Develop a strong hypothesis
  1. Improve metrics that matter
  2. Generate ideas for experimentation
  3. Design a hypothesis that drives your business goals

 

 

Set up your Optimizely account

Key concepts:

  • Manage collaborators and user roles
  • Best practices for implementing the snippet
  • Distinguish between Account, Project and Experiment levels
  • Manage integrations
  • Pause, clone and archive experiments
  1. Manage collaborators and user roles
  2. Implement the Optimizely snippet
  3. Manage projects and experiments
  4. Manage integrations

Prepare Optimizely X for your site

Key concepts:

  • How to manage and use Pages
  • URL targeting and match types
  • Adjust page activation & managing dynamic content
  • How to manage and use Events
  • Track metrics 
  • Create audience conditions and custom settings
  • Simultaneous testing and mutually exclusive experiments
  • Create custom attributes 
  1. Choose where experiments run
  2. Conditionally activate experiments
  3. Setting up events and metrics
  4. Target your audiences
  5. Mutually exclusive experiments

The Visual Editor

Key concepts:

  • Editing capabilities available within the Optimizely visual editor
  • Creating custom code in the Code Editor
  • Activation mode
  • Best practices for using the editor and for running experiments
  • Conditions required for loading your webpage into the editor
  1. The Visual Editor 
  2. Conditionally activate experiments
  3. Custom Code Editor

QA and launch an experiment

Key concepts:

  • Adjust traffic allocation
  • How to use preview tool and run a cross-browser test
  • Share unpublished variations with stakeholders
  • QA and debug experiments using the JS API and Optimizely log
  • Check goal firing
  • Troubleshoot pages that are not loading
  • Stats calculator
  1. Traffic Allocation
  2. Preview tool
  3. QA-ing the experiment
  4. Pages that are not loading in the editor
  5. How long to run a test

Interpret and take action on results

Key concepts:

  • Statistical significance and why it matters
  • How to manage winning, losing and inconclusive results
  • How goal conversions are tracked on the results page
  • Segmenting results
  1. Statistical Significance and the Stats Engine
  2. Interpret your results
  3. Results page
  4. False discovery rate
  5. Send all traffic to the winning variation