a/b testing and optimizely module
DESCRIPTION
Use A/B testing to monitor the impact of changes of web page elements that lead to more downloads, user contributed content, increased revenues, or whatever result you want to achieve. A/B testing involves testing two versions of a website - an A version (the control) and a B version (the variation) - with live traffic and measuring the effect each version has on your conversion rate. Results of A/B tests are used to make informed decisions about how to structure and present content on a site. There is no longer a need to guess what the site's user response is to changes, simply test and look at the trends in the data. The power and ease of use of the Optimizely framework is further enhanced using the Optimizely Drupal module. We will discuss the current and future integration of A/B testing with Drupal and Optimizely using the Optimizely Drupal module in detail. The presentation will end with a discussion of what future integration of Optimizely with Drupal is desired to further leverage the partnership.TRANSCRIPT
with
A/B Testing
&
What is A/B Testing?
A/B testing allows you to test two or more versions of a webpage to determine which changes produce the desired results.
The country's largest not-for-profit for young people and social change.
“Dee” - DeeZone (288060) & Peter - pleher (2257350)
with
A/B in Action...
&
Original
A) Spotted (Sad)
B) Fence (Jail)
Golden (Super Cute)
Golden2 (Super Cute v2)
Peak Results after “Tweek”“Golden2”“Golden”
Data “Normalization”
Introduction ofalternative “Golden”
Puppy Results
Base
v1Cell (optional)
v2Placeholder Text+ Cell (optional)
v3“Submit”
v4“See the Pets”
Data “Normalization”Sample Size? Confidence level?
Forget:“See the Pets”“Submit”
The ResultsPeak Results“Cell Optional”“Cell Optional+ Text”
Under the Hood
optimizely.com
Projects
Experiment
AdminExperiment
Project Code - “Snippet”
JS File Size
JS Call to enable project on web page.“Project Code”
25142535242.1kb
Optimizely 7.x-2.10 Module
Account InfoAdmin Settings
The account Number and the initial Project Code are the same
251425352
AjaxEnable / Disable
Path conflict “ ”
Project Listing
* Project Code251425352
“Project Code” number from Optimizely website
Add Project /admin/config/system/optimizely/add_update
251425352
Each path must be - unique between projects - a valid path on the site
Update Project /admin/config/system/optimizely/add_update/2
Cache Refresh
CDN Call
CDN: content delivery network
Bang! for your Buck $$$
= Actions
Fake Doors / Smoke Sceens
Interest?
Project Pagedrupal.org/project/opimizely
Experiment listing in Projects
Filter by User Roles for each Exeriment
Filter by user location - city, state, country
Bucket user into different experiments on repeat visits to experiments (cookie)
???
Up next...
Drulenium - Testing made easyTech Nikh