data driven product management
TRANSCRIPT
![Page 2: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/2.jpg)
I don’t do math
![Page 3: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/3.jpg)
WHICH OF THESE CAN YOU USE IN THE DARK?
![Page 4: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/4.jpg)
90% of world's data generated over last two years
Source: Science Daily
![Page 5: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/5.jpg)
USE DATA OR PERISH
![Page 6: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/6.jpg)
GOING FROM 0 TO 60 IN 2.8 SECONDS
![Page 7: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/7.jpg)
DOMAIN SEARCH ≠GOOGLE SEARCH?
Query Tokenize Understand Generate suggestions
Rank suggestions
Buy from registry
toiletseat.com
toilet seatOR
toilets eat
toiletseat.infotoiletseat.org
toiletseat.plumbingtoiletseat.co
toilet seat toiletseat.infotoiletseat.co
toiletseat.plumbing
toiletseat.co
![Page 8: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/8.jpg)
GoDaddy Domain Search Results
2 years ago
![Page 9: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/9.jpg)
9
CHECKLISTDOT -> MLN
Proprietary. Copyright© 2014 GoDaddy Operating Company, LLC. All rights reserved.
M
Leverage existing data OR
“create” new data
L
Define intended outcome
NTOD
Testingcapability
MVP Launch Next steps
![Page 10: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/10.jpg)
D FOR DATA
Customer interactions
UX discovery with users
Customer feedback
Customer service agentfeedback
Purchases
3rd party research
![Page 11: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/11.jpg)
11
CUSTOMER JOURNEY MAPS
Proprietary. Copyright© 2014 GoDaddy Operating Company, LLC. All rights reserved.
5
4
3
2
1 Search Results3.4
Homepage3.0
Configure3.7
Cart4.4
Login4.1
Checkout3.2
![Page 12: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/12.jpg)
GATHERING DATA TO BUILD A SEARCH EXPERIENCE
CustomerProfile Searches Purchases Usage
PatternsCustomer Service
• Products in Use• How are they used?
• Segments• Paths
• Search Sessions
• Clicks• Behavior
• Domain purchased
• Other products bought
• Cart size
• Top complaints• How they sell?
Competitors IndustryTrends
![Page 13: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/13.jpg)
O FOR OUTCOMEPICK THE RIGHT METRIC TO MEASURE
Q: Optimize the entire path or just a page?
• Alignment on metric to build to:– Customer experience– Revenue ($, margin)
• Set explicit and realistic goals• Clearly state assumptions and dependencies
![Page 14: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/14.jpg)
14
Revenue(Conversions, Order size,
# of Products)
Relevance(Click position, nDCG)
V/S
![Page 15: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/15.jpg)
15
Metric to optimize: Add To CartMade up a metric as nothing standard fit the need!
Proprietary. Copyright© 2014 GoDaddy Operating Company, LLC. All rights reserved.
![Page 16: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/16.jpg)
T FOR TEST
“Test fast, fail fast, adjust fast”
• Do you have an A/B testing platform?
• Build v/s Buy
• What should you test and when?
• Do you trust your data - gut check test results
![Page 17: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/17.jpg)
1ST A/B TEST FOR SEARCH
![Page 18: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/18.jpg)
A/B TESTS TODAY
18
![Page 19: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/19.jpg)
M FOR MVP
• Build a multi year roadmap of “big
rocks”
• Pick the 1st “rock”
• Define the simplest happy path
• Simplify it even further
• Build that!
![Page 20: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/20.jpg)
DOMAIN SEARCH MVP
Rule basedmodel
Algorithmic suggestions
GlobalRankingModel
MarketRanking Models
Customer segment models
Path specific models
t = 0 t = 1y t = 2y t = 3y
Reorder Tokenize Complex rules
MVP 1 MVP 2 MVP 3
![Page 21: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/21.jpg)
21
Simplifying the MVP with data
Proprietary. Copyright© 2014 GoDaddy Operating Company, LLC. All rights reserved.
Singular ➢Plural
Plural ➢Singular
Add token to end
Delete least important word
Stemming Replace word Digits Dashes
2 2 12
13 X X
![Page 22: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/22.jpg)
L FOR LAUNCH
• Launch your MVP
• Log everything (even if you don’t need it)
• Measure test results
• Understand dynamic between metrics
– Conversion, Order side, New customer acquisition, LTV
• Share bad news quickly, wait to share good news
![Page 23: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/23.jpg)
WHAT IS STATITICAL SIGNIFICANCE?
• Not leaving outcome to chance
• Probability (p) is your friend – helps manage
risk
• Easy to compute tools available online
– 95% confidence => You are wrong 1 in 20 times
– 90% confidence => You are wrong 1 in 10 times
![Page 24: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/24.jpg)
24
MY “BOB” STORY
![Page 25: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/25.jpg)
N FOR NEXT STEPS
• Launch your MVP
• Add new “big rocks”
• Leverage Lean canvases
Source: Steve Blank
Prioritize: Customer Experience, not Revenue / Effort
![Page 26: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/26.jpg)
DON’T LOSE SIGHT OF WHO YOU ARE BUILDING FOR?
![Page 27: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/27.jpg)
GODADDY SEARCH EXPERIENCE TODAY
27
![Page 28: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/28.jpg)
28
NEW KID ON THE BLOCK
![Page 29: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/29.jpg)
TAKEAWAYS
• Think of data as your road to
insights
• Optimize the right metric
• Test fast, fail fast, adjust fast
• Minimum Viable Product
• Optimize for customer experience,
not revenue or effort29
![Page 30: Data driven product management](https://reader034.vdocuments.mx/reader034/viewer/2022051318/58efbd5d1a28aba1198b45bf/html5/thumbnails/30.jpg)
TAPAN [email protected]