3 important things about metrics founders should know
DESCRIPTION
Read the full blog post here: http://jan-koenig.com/blog/?p=109TRANSCRIPT
![Page 1: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/1.jpg)
3 Important ThingsAbout Metrics
Jan König - @einkoenig
founders should know
Metricsfor Startups
![Page 2: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/2.jpg)
things you
probably know
0
![Page 3: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/3.jpg)
The AAA’s of Metrics
Actionable
0
Auditable Accessible
![Page 4: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/4.jpg)
What Makes a Good Metric?0
A rate or a ratio rather than an absolute or cumulative value. New users per day is better than total users.Comparative to other time periods, sites, or segments. Increased conversion from last week is better than “2% conversion.”No more complicated than a golf handicap. Otherwise people won’t remember and discuss it.For “accounting” metrics you use to report the business to the board, investors, and the media, something which, when entered into your spreadsheet, makes your predictions more accurate.For “experimental” metrics you use to optimize the product, pricing, or market, choose something which, based on the answer, will significantly change your behaviour. Better yet, agree on what that change will be before you collect the data.
Source: http://leananalyticsbook.com/one-metric-that-matters/
![Page 5: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/5.jpg)
3 things you
should know
about metrics
0
![Page 6: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/6.jpg)
A metric tells a complete story using data, measures, information, and other metrics to answer a root question.
Martin Klubeck
“
”
1
![Page 7: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/7.jpg)
Metrics
Root Question
Metric
Information Information
Measures Measures Measures
Data
Data
DataData DataData
Data
Source: Klubeck, “Metrics”, page 13
1
![Page 8: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/8.jpg)
Examples
Data, Measures, and Information1
Page Hits on Dec 232500 (Data) Hits (Measures)
Page Hits per Day Last Week2500 (Data) Hits (Measures)2600 (Data) Hits (Measures)……2350 (Data) Hits (Measures)
2520 (Data) Hits (Measures) per Day (Information)
Information
Data
Data Data
DataData
Data
Measures
DataData
Data
Measures
![Page 9: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/9.jpg)
Root Question1
“Answers are only useful when you know the question”
– Martin Klubeck
A wrong question means:wrong data, measures, and informationwrong metric interpretationwrong actionwrong product change
![Page 10: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/10.jpg)
Finding the Right Question: 5 Whys1
Ask Why (What, How, What if?) until you can no longer answer with a deeper need.
Example
“I want to measure retention with a cohort analysis”
“Are the users coming back to use my product?”
“What could make them come back more often?”
“What product changes do address theusers’ needs and lead to an increasing usage?”
(possible) root question
“What do I have to change to make a betterand more desired product for my users?”
“Is my product at the moment solving their problems well enough to be important to them?”
![Page 11: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/11.jpg)
Metrics are a tool, an indicator –they are not the answer and may havemultiple interpretations.
Martin Klubeck
“
”
2
![Page 12: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/12.jpg)
Metrics as Indicators2
A Systematic Approach for Data-Driven Decision Making
“Data is just one perspective”Source: http://blog.intercom.io/the-problem-with-data-driven-decisions/
Never base decisions on core numbers!
Use metrics as indicators to find out wheresomething is wrong.
Then do further investigation.In-depth Analysis. Customer Development.
http://jan-koenig.com/blog/?p=82
![Page 13: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/13.jpg)
Triangulation is a principle foundationfor a strong metric program.
Martin Klubeck
“”
3
![Page 14: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/14.jpg)
Triangulation3
Product / Service HealthCustomer View
Delivery
Usage
Customer Satisfaction
Example: Triangulation of Effectiveness Metrics
using multiple measures, collection methods, and sources for a comprehensive picture
![Page 15: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/15.jpg)
Triangulation in a Restaurant3
Restaurant’s Effectiveness Metrics
Delivery Usage Customer Satisfaction Possible Interpretation
Crazy! Time to look at other metrics to improve your business.
Source: Klubeck, “Metrics”, page 149f
Great food and a loyal, but very small customer base. Maybe a bad location.
“The only game in town.” Or a product customers need but don’t want.
OK, something is wrong here. You know that.
with Triangulation
![Page 16: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/16.jpg)
Triangulation in a Restaurant3
Restaurant’s Effectiveness Metrics
Delivery Usage Customer Satisfaction Possible Interpretation
good
good
bad
bad
without Triangulation
focus on
![Page 17: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/17.jpg)
?
So, how do I use these principles? What’s next?
![Page 18: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/18.jpg)
Martin Klubeck’s Answer Key
Product / Service Health
Process Health
Organizational Health
Future Health
Return vs.Investment
State of theOrganization
Customer View
Business View
Worker View
Leadership View
CompanyMaturity
?
![Page 19: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/19.jpg)
Martin Klubeck’s Answer Key
Process Health
Organizational Health
Future Health
Return vs.Investment
State of theOrganization
Business View
Worker View
Leadership View
Product / Service HealthCustomer View
?
![Page 20: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/20.jpg)
Focus on Product Health
Product / Service HealthCustomer View
Delivery
Usage
Customer Satisfaction
?
![Page 21: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/21.jpg)
Focus on Product Health
Product / Service HealthCustomer View
Delivery
Usage
Customer Satisfaction
?
Customer Journey
Activation, Retention, Revenue
![Page 22: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/22.jpg)
Feedback?
Hey, I’m Jan!
I am a German student and I’m currently writingmy bachelor’s thesis about metrics for startups.
I would love to get some feedback about this approach(which is the “high-level part” of my thesis).
I will upload some other presentations about metricsdesign in startups within the next weeks.
Glad to hear from you!Jan
Twitter: @einkoenigMail: [email protected]
![Page 23: 3 Important Things About Metrics Founders Should Know](https://reader034.vdocuments.mx/reader034/viewer/2022051323/5478c7e25906b59e048b45ab/html5/thumbnails/23.jpg)
Photo Credits
Slide 3Jan Krömer, http://www.flickr.com/photos/81336062@N00/285835148ZionNPS, http://www.flickr.com/photos/54168808@N03/5015792234comedy_nose, http://www.flickr.com/photos/23408922@N07/4873283906
Slide 6Neta Bartal, http://www.flickr.com/photos/53742192@N05/6646556769/
Slide 11Furryscaly, http://www.flickr.com/photos/98528214@N00/312210315
Slide 13loop_oh, http://www.flickr.com/photos/80384851@N00/7986197617