learn from failed a/b tests to create winning results
TRANSCRIPT
![Page 1: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/1.jpg)
Profitable ‘A-ha!’ moments everyday.™
![Page 2: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/2.jpg)
THE CONNECTED CONVERSION OPTIMIZATION PLATFORM
![Page 3: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/3.jpg)
Keep up with the new platform at vwo.com/evolution
![Page 4: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/4.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Learn From Failed A/B Tests to Create Winning Results
How to Turn Losses into Wins
![Page 5: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/5.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Before we get started. . .
• This presentation deck and recording will be available to you after the webinar
• Use the General Chat panel to ask questions or make comments in real time
• Stay to the end for the chance to win a free digital copy of You Should Test That! Type question here
![Page 6: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/6.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
One of you will win the book today.
Get a free chapter at: YouShouldTestThat.com
![Page 7: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/7.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
• Developed the LIFT Model®, PIE Framework, and Infinity Optimization Process™
• Keynotes at conferences and seminars around the world
• Author of You Should Test That!Get a free chapter at: YouShouldTestThat.com
Chris GowardFounder & CEO, WiderFunnel
![Page 8: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/8.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
23.4% more orders for IBM Softlayer servers
![Page 9: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/9.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
40.5% more ink subscriptions for HP Instant Ink
![Page 10: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/10.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
115% more qualified leads for Magento Enterprise
![Page 11: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/11.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
210% lead generation lift for Equity Trust
![Page 12: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/12.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
$1 million per month additional revenue for BuildDirect.com
![Page 13: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/13.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 14: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/14.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
But not all tests are winners, right?
![Page 15: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/15.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 16: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/16.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 17: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/17.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Result: Both variations lost.
Var A Var B
![Page 18: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/18.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 19: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/19.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
But! The experimental design delivered valuable insights.
![Page 20: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/20.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Var A Var B
![Page 21: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/21.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Clarity: Shoppers want to refine their results by color.
..but, inconsistent use of “color” and “palette”creates cognitive load.
![Page 22: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/22.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
There are no losing experiments......if you use the right experiment process.
![Page 23: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/23.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
?
![Page 24: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/24.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
?
A B C
![Page 25: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/25.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 26: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/26.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
?
A B C
15.6% Lift 9.8% Lift23.6% Lift
![Page 27: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/27.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Great results aren’t random
The right process makes magic happen.
![Page 28: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/28.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Infinity Optimization Process
![Page 29: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/29.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
A B C ê 7.7%é 0.6%
![Page 30: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/30.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
A B C
![Page 31: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/31.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
A B C é 14.1%é 8.9%
?
![Page 32: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/32.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
ValidateDesign of Experiments is used to maximize the growth and insights results from experiments.
![Page 33: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/33.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Your challenge: Balance results and insights
![Page 34: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/34.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Unless you have infinite traffic...You can't isolate every variable - tests will take too long.
You can't only test one variation - you'll learn nothing.
You can find the ideal balance with Design of Experiments.
![Page 35: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/35.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
The results and insights spectrum
Results Insights
A/B Multivariate
![Page 36: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/36.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
The results and insights spectrum
Results Insights
A/B MultivariateFractional factorial
![Page 37: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/37.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Why is this important?
![Page 38: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/38.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
It allows you to gain important insights.
![Page 39: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/39.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Use Factorial Testing to understand your customers’ psychology
![Page 40: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/40.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 41: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/41.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 42: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/42.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Infinity Optimization Process
![Page 43: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/43.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Explore
Web analytics – done right – can feed insights into user experience hypotheses.
![Page 44: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/44.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Conversion Rate: -2.23%Revenue per visitor: -2.95%
![Page 45: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/45.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 46: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/46.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Conversion Rate: -9.97%Average Donation: +1.57%Revenue per visitor: -8.55%
![Page 47: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/47.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Ikea effect
Consumers place a
disproportionately high value on
products they partially create.
Could interacting with the slider
create a sense of ownership of
the donation?
![Page 48: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/48.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Explore
Your visitors convert in their minds before they convert with their click.
![Page 49: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/49.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
#AlternativeFacts
![Page 50: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/50.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Loss Aversion
Studies have shown that losing
an amount is twice as
psychologically powerful as
gaining the same amount.
- Amos Tversky and Daniel Kahneman
![Page 51: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/51.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Conversion Rate: +2.04%Average Donation: +5.94%Revenue per visitor: +8.01%
![Page 52: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/52.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Consistency Principle
We like to keep consistent with
what we think, say and do, and will
change to ensure this is so.
- Cialdini, Influence.
![Page 53: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/53.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 54: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/54.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
![Page 55: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/55.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
Conversion Rate: +1.97%Average donation value: +3.07%Revenue per visitor: +5.10%
![Page 56: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/56.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet to: @chrisgoward #Awesome
SelectedRegular donor
Selected Occasional
donor
Selected First-time
donor
Did not select an option
14% of visitors68% of donors
86% of visitors32% of donors
![Page 57: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/57.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Now, we’re building on these insights to deliver Personalized data-informed experiences.
![Page 58: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/58.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Q&A àOr email: [email protected]
![Page 59: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/59.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Want new ideas to spark your testing program?
Download the new graphical cheat-sheet with 17 new A/B test ideas:
WiderFunnel.com/17ideas
Email your questions to: [email protected]
![Page 60: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/60.jpg)
© 2007-2017 WiderFunnel Marketing Inc.
Tweet this: @chrisgoward #Awesome
Thank You!You will receive a recording of the webinar
in the next few days.
![Page 61: Learn from failed A/B tests to create winning results](https://reader030.vdocuments.mx/reader030/viewer/2022020213/58cf45d11a28ab254a8b6335/html5/thumbnails/61.jpg)
Profitable ‘A-ha!’ moments everyday.™