conversion optimization breakfast workshop
TRANSCRIPT
![Page 1: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/1.jpg)
Lessons from the World’sGreatest Testers
May 2016
@Hazjier
![Page 2: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/2.jpg)
Hazjier PourkhalkhaliLead Strategy Consultant
@Hazjier
![Page 3: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/3.jpg)
Optimizely is the world’s largest digital laboratoryAlexa 10k websites, Q1 2016
![Page 4: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/4.jpg)
![Page 5: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/5.jpg)
We researched the world’s top companies
Interviewed experts
§ Spoke with thought leaders in the industry
§ Met with top customers
Built maturity model
§ Developed comprehensive maturity model
§ Assessed 100 customers
§ Surveyed 50+ customers
Held 100+ Business Reviews
§ Met with executives at over 100 Optimizely clients
Analyzed Top Revenue Experiments
§ Analyzed the 100 best experiments run on Revenue Per Visitor
§ Asked customers to describe test and process
![Page 6: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/6.jpg)
1 Understand yourrevenue levers
3 Solve realproblems
2 Test all changes
4 Test multiplevariations
![Page 7: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/7.jpg)
1 Understand yourrevenue levers
![Page 8: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/8.jpg)
User acquisition:
1.5m
User retention
33%
Add-to-Cart:4.00%
Cart Checkout:
50.0%
Average quantity:
2.00
Average per unit price:
£25.00
Average Order Value:
£50.00
Conversion Rate:2.00%
Revenue Per Visitor:£1.00
Visitors:2.0m
Revenue:£2.0m
Understand the revenue drivers
![Page 9: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/9.jpg)
Goals
Strategies
Tactics
Cart Checkout
Rate
Wording / messaging
Location / size
Design / color /
iconography
Establish a visual
hierarchy
Remove non-
critical content
Limit number of
choices
Select/target the right USP’s
Refine the messaging
Crystallize visually
Clear and consistent
UI
Structure, naming,
and order of sections
Describe visually
Test ideal product visuals
Use the right
review systems
DescriptionsReviewsImages
Emphasize the Primary
Call to ActionMinimize
DistractionsCommunicate
Unique Selling Points
Design Intuitive
Navigation
Market Products
EffectivelyBuild a Sense
of Urgency
Show quantity
left
Push temporary
offers
Promote buying
before set times
![Page 10: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/10.jpg)
2 Test all changes
![Page 11: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/11.jpg)
“Every change we make to ourwebsite has to be approvedby our senior staff”
-Financial Services company
Testing requires freedom
LOW FREEDOM HIGH FREEDOM
![Page 12: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/12.jpg)
Testing requires freedom
LOW FREEDOM HIGH FREEDOM
“Our Brand Styleguide is key.We cannot make changes that do not fit our design book”
-Luxury goods company
![Page 13: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/13.jpg)
Testing requires freedom
LOW FREEDOM HIGH FREEDOM
“We would even change our logo if it converted better”
-Travel Company
![Page 14: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/14.jpg)
3 Solve realproblems
![Page 15: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/15.jpg)
![Page 16: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/16.jpg)
NO BEARD CAVEMAN
.30% .29% .28% .32% .25% .74%
.11% .28% .24% .32% .09% .59%
.74%
.59%
![Page 17: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/17.jpg)
Minimize Distractions:Remove Non-Critical Content +14%
Revenue PerVisitor
![Page 18: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/18.jpg)
BASED ON KEYWORDCURATED
+24%Click to Sale
+30%Add-to-Cart
+210%Conversions
![Page 19: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/19.jpg)
Problem Solution Result
All great hypotheses begin with the problem, NOT the solution!
![Page 20: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/20.jpg)
4 Test multiplevariations
![Page 21: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/21.jpg)
The problem with “A/B Testing”
2
A B
4
A B C D
![Page 22: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/22.jpg)
Most people test only 2 variations
0
10,000
20,000
30,000
40,000
50,000
60,000
2 3 4 5 6 7 >8
Tests 65% 17% 17%
# of Variations
![Page 23: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/23.jpg)
Most people test only 2 variations
0
10,000
20,000
30,000
40,000
50,000
60,000
2 3 4 5 6 7 >8
Tests
# of Variations
![Page 24: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/24.jpg)
Test 5 variations and nearly double your win rate!Win Rate
# of Variations
14% 18% 20% 27% 20% 22% 23%0%
10%20%30%40%50%60%70%80%90%
100%
2 3 4 5 6 7 >8
+90%
![Page 25: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/25.jpg)
Running more variations will significantly improve your testing!
![Page 26: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/26.jpg)
1 Understand yourrevenue levers
3 Solve realproblems
2 Test all changes
4 Test multiplevariations
![Page 27: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/27.jpg)
Workshop
![Page 28: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/28.jpg)
§ The <user persona>§ Cannot find…§ Does not know…§ Does not see…§ Wants to…§ Is distracted by…§ Is forced to…§ Needs…
Problem Solution Result
§ By <…> the user will… <…>
§ If <solution> solves <problem>, then <metric> will rise
Build powerful hypotheses
![Page 29: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/29.jpg)
§ Discover 5-10 problems for your users
§ Group problems by themes
§ Prioritize most important problems
Problem Solution Result
§ Select 1 concrete problem
§ Design 10 solutions per theme
§ Choose 4 preferred solutions
§ Primary Goals:What do you seek to impact immediately
§ Secondary Goals:What would you like to impact, but do not have to
§ Monitoring Goals:What are metrics you want to track
Exercise: Build Powerful Hypotheses
![Page 30: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/30.jpg)
Optimizely funnel analysisHomepage
FlightResults
BookFlight
PassengerDetails
FlightOptions
Payment Page
Step
45%30%
65% 65%
90%
70%
40%
40%
15% 20%
5%
25%
15%30%
20% 15%5% 5%
![Page 31: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/31.jpg)
Optimizely funnel analysisHomepage
FlightResults
BookFlight
PassengerDetails
FlightOptions
Payment Page
45%30%
65% 65%
90%
70%
40%
40%
15% 20%
5%
25%
15%30%
20% 15%5% 5%
Step
Completion
![Page 32: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/32.jpg)
Optimizely funnel analysisHomepage
FlightResults
BookFlight
PassengerDetails
FlightOptions
Payment Page
45%30%
65% 65%
90%
70%
40%
40%
15% 20%
5%
25%
15%30%
20% 15%5% 5%
Step
Divergence
![Page 33: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/33.jpg)
Optimizely funnel analysisHomepage
FlightResults
BookFlight
PassengerDetails
FlightOptions
Payment Page
45%30%
65% 65%
90%
70%
40%
40%
15% 20%
5%
25%
15%30%
20% 15%5% 5%
Step
Exit Rate
![Page 34: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/34.jpg)
Optimizely funnel analysisHomepage
FlightResults
BookFlight
PassengerDetails
FlightOptions
Payment Page
Step
45%30%
65% 65%
90%
70%
40%
40%
15% 20%
5%
25%
15%30%
20% 15%5% 5%
Exit Rate
Divergence
Completion
![Page 35: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/35.jpg)
Optimizely funnel analysisHomepage
FlightResults
BookFlight
PassengerDetails
FlightOptions
Payment Page
Step
Primary /SecondaryGoals
§ Searches Submitted
§ Category tabs§ Deals§ Frequent Flyer
§ Flight Selection§ Filter Usage§ Refine Search§ Sort Order
§ Continue button
§ Edit search§ Upsells
§ Field completion rate
§ Continue button
§ Continue button
§ Upsells§ Seat
selection
§ Conversion rate
§ Form field completion
§ Payment Type
MonitoringGoals
§ Checkboxes§ Flight tracker
§ Home page clicks
§ Menu interactions
§ Site search
§ Home page clicks
§ Menu interactions
§ Site search
§ Field error rate
§ Home page clicks
§ Menu interactions
§ Site search
§ Shopping cart pageviews
§ Home page clicks
§ Return to previous page
§ Edit address, information
§ Error rate
![Page 36: Conversion Optimization Breakfast Workshop](https://reader031.vdocuments.mx/reader031/viewer/2022021922/58857da71a28abbb7e8b6bdf/html5/thumbnails/36.jpg)
§ Discover 5-10 problems for your users
§ Group problems by themes
§ Prioritize most important problems
Problem Solution Result
§ Select 1 concrete problem
§ Design 10 solutions per theme
§ Choose 4 preferred solutions
§ Primary Goals:What do you seek to impact immediately
§ Secondary Goals:What would you like to impact, but do not have to
§ Monitoring Goals:What are metrics you want to track
Exercise: Build Powerful Hypotheses