open mastery: let's conquer the challenges of the industry!

CTO, New Iron, Austin, TXJanelle Klein

©2015 New Iron Group

Open Mastery

Creation Date: 10/05/2015

Let’s Conquer the Challenges of the Industry!

Mentors Craftsman

Yay!

What is this talk about?

How do we conquer the challenges?

Open Mastery is a peer learning network focused on

codifying open decision models and standards for solving industry-wide problems

The obstacles, the strategy, the business model

RESET

https://www.youtube.com/watch?v=0mUN3RppEHE

Fear and InspirationJosh Corman, DevOpsDays Austin 2015

https://www.youtube.com/watch?v=0mUN3RppEHE

Infecting

We’re putting software and connectivity in everything...


The security implications are frightening...


RESET

90% of our software is assembled from existing parts...


The Complexity and Risk is in the Supply Chain

Bad Software is like Environment Pollution

Cost&

Risk

Complexity

Cumulative Complexity in the SW Supply Chain(i.e. shared dumping ground of crappy software)

HumanLimitations

RESET


We’ve copied everything from Deming’s manufacturing ideas except Quality and Risk Management Practices.

RESET

To conquer the challenges of quality and risk

We have to manage quality in the Supply Chain


@iamthecavalry

This is Painful!

Our Application

PROBLEMS

Problems cascade through the supply chain…

This is Painful!Alert!

Alert!

Our Application

PRESSUREfor better quality parts

What if we managed quality and risk inthe software supply chain?

PROBLEMS

Everythingis easy!

Our Application

PRESSUREfor better quality parts

What if we managed quality and risk inthe software supply chain?

How could we do it?

My Background is in Process Control & Supply Chain

Optimizationin Manufacturing

My Learning Framework is a Control System

Systematically Optimize Decisions

Great TeamDisciplined with Best PracticesConstantly Working on Improvements+

Project FAILURE

UnexpectedBehavior

ProblemResolved

Recording Painful Interaction with the Code (Friction)

Troubleshooting

Progress

5 hours and 18 minutes of troubleshooting...

PAINFUL

Process Control in Manufacturing

This is “Out of Control”

Lower Variability = Better Control

“Pain Control” in Software Development

Average Pain per Incident

Target

Control Limit

We don’t improve productivity by trying to go faster, we improve productivity by improving control.

Quality Risk

Familiarity Risk

Assumption Risk

Case Study 1: Healthy project (10 months) with a focus on reducing troubleshooting time.

Troubleshooting

Progress

LearningRework10-20% friction

Effects of Escalating Risk

Case Study 2: 18 months after a rewrite and tons of pressure to deliver features.

Troubleshooting

Progress


0:00 28:15

12:230:00


Case Study 3: 12 year old project after all the original developers had left.

Troubleshooting

Progress


7:070:00

0:00 19:52


Case Study 1

Case Study 2

Case Study 3

1 day

2 days

1 day

3 days

1 day

3 days

We can’t see these effects by measuring velocity or task lead-time.


Typical Idea Flow Maps

Single Problem

Multi-Problem

Long-Term Trends

0%

100%

Release 1 Release 2 Release 3

Troubleshooting

Progress

Learning

Percentage Capacity spent on Troubleshooting (red) and Learning (blue)

Long-Term Trends

0%

100%



Learning is front-loaded

Troubleshooting

Progress

Learning

Long-Term Trends

0%

100%



Validation is deferred

Troubleshooting

Progress

Learning

Long-Term Trends

0%

100%



Baseline friction keeps rising

Troubleshooting

Progress

Learning

Long-Term Trends

0%

100%



Unpredictable work stopsfitting in the timebox

Troubleshooting

Progress

Learning

Improving Control improves…

Quality

Productivity

Predictability

Our software problems are all caused by the same thing:

Friction in Understanding

PAIN occurs during the process of understanding and extending the software

PAIN

Not the Code.

Optimize Developer Experience

Software is a Reflection of our Decisions

Past decisions constrain future choices

Mastery = Optimize Decisions

Developer Experience

The Process of Mastery

Systematically Optimize Decisions

Target - The direction we’re trying to go…


Output - The pain signal we’re trying to improve


Input - The constraints that limit our short-term choices…


1. Visibility - Make the pain visible

1.Visibility

1.Visibility


1.Clarity

2.Clarity

2. Clarity - Understand the causes of the pain


3.Awareness

3. Awareness - Learn to avoid the pain


Focus on the biggest pain



Improve - Codify decision principles

What’s a Decision Principle?

1. How do I evaluate my situation?2. What should I optimize for?

Answers Two Questions

Pseudo-code for trade-off decisions.

The Scientific Method

We learn by continuously refining our models.

= Decision Model

Core Challenge in Software DevelopmentIt’s really easy to spend tons of time on

improvements that don’t make much difference.

The key to improving quality, productivity, and predictability isidentifying the biggest causes of friction.

1. Test Data Generation

2. Missing Diagnostic Tools

3. Environment Problems

1000 hours/month

Identify the Biggest Causes of Friction

VisibilityClarity

Awareness Target

The Mastery Spiral

RESET“A good strategy is a specific and coherent response

to—and approach for overcoming—the obstacles to progress.”

-- Richard P. Rumelt

What are the Obstacles?

Increasing Demand for Software

Lack of Skilled Developers

Lots of Crappy Software

+

The Education Gap

We learn the art of software development through mentorship.

Educational Institution

That’ll be 40k dollars please.

Loans

$$ $$

$$$$$

Development skills are primarily learned through mentorship.

studentsI still don’t know what to do!

Irrelevant Education

Hiring Costs are Skyrocketing

Company

We need aDeveloper!

Nope.Nope.Nope.Nope.Nope.

Nope.Nope.Nope.Nope.Nope.

Nope.Nope.

Nope.Nope.Nope.

Nope.Nope.Nope.Nope.Nope.Nope.Nope.Nope.

Nope.

Yay!

Traditional Cost AccountingPressure to Cut CostsInvisible Indirect Costs

Really Bad Management Decisions

+

We’re managing a discovery process without visibility of the emergent risks.

The Visibility Gap

The Cause of Much Pain…

Stress & Exhaustion

What’s the specific approach for overcoming the obstacles?

What if we had an institution dedicated to solving industry-wide problems?

Open Mastery

+

Running LeanAsh Maurya

Lean Canvas

“Iterate from Plan A to a Plan that Works”Developing a Plan…

Clients

We need aSr Developer!

New Iron

TechnicalInterviews

Sr Developers

$$$$$

Jr Developers

The Origin of Open Mastery


Clients


New Iron

???

TechnicalInterviews

Sr Developers

$$$$$

Jr Developers

+


Clients

Jr Developers

New IronSr Developers

$$$$$

TechnicalInterviews


+


Clients

Jr Developers


$$$$$

TechnicalInterviews



Clients

Jr Developers


Mentorship

TechnicalInterviews


Clients

Jr Developers


Mentorship

TechnicalInterviews

Yay!

$$$


Clients

Jr Developers


Mentorship

TechnicalInterviews

$$

$$ $

Yay!

Yay!

I don’t scale…

Yay!

Yay!

$$$


Clients

Jr Developers


Mentorship

TechnicalInterviews

I don’t scale…

???


Clients

Sr Developers

Mentorship

TechnicalInterviews

Jr Developers

New Iron ???

+


Clients

Jr Developers


Mentorship

TechnicalInterviews


+

Clients

Jr Developers


Mentorship

TechnicalInterviews


Clients

New Iron

TechnicalInterviewsMentorship


Clients

TechnicalInterviewsMentorship

New Iron


Clients

CraftsmanCertificationMentorship

New Iron


Clients

CraftsmanCertification

MentorshipCertification

New Iron

Open Mastery 2016Let’s Conquer the Challenges of the Industry!

FREE!


Clients



New Iron

Open Mastery 2016Let’s Conquer the Challenges…

FREE!

Mentors Craftsman



Clients



New Iron

Open Mastery 2016Let’s Conquer the Challenges

FREE!

Mentors Craftsman

Yay!

Yay!

$$

$$


Clients



New Iron

Open Mastery 2016Let’s Conquer the Challenges…

FREE!

Mentors Craftsman

Yay!

Yay!

Yay!

$$

$$

$ $$$ $$

Yay!Yay!


IndividualsFree Membership

CompaniesPaid Membership

Open Mastery Membership



Software Mastery

Organizational Mastery

Supply Chain Mastery

Mastery Certification

Mentorship Certification

API DX Certification

Learn Teach

VisibilityClarity

Awareness Target

Learn: Software Mastery

IFM Tools

Anonymized data

Open Mastery Community

IFM Tools

IFM Tools IFM Tools

IFM Tools

IFM Tools

Community Focus

Integrated #HashTagGlossary

Tags: #problemtag

Breakdown the Causes into Patterns

VisibilityClarity

Awareness Target

Teach: Software Mastery

Idea Flow Learning Framework

Optimizing for Small HaystacksOptimizing the Test Signal to Noise RatioOptimizing for Low Diagnostic DifficultyStrategies to Hedge Against Uncertainty

Designing for ExperimentationDesigning for Learnability

Designing for Dependencies Across Teams

How to Generate More Design Options

Free Software Mastery Certifications

Really? FREE...?What’s the catch?

A good education costs money,but it doesn’t need to come from those wanting education.

What if we turned the education model

upside-down?

Developers pay for training

to get hired at Companies

Cost

Developers get free training

Companies payfor trained developers

Cost

Here’s the Catch:

When you’re looking to switch jobs (now or in the future)

We ask that you...

Let us help you find a job.

Clients



New Iron

Open Mastery 2016Let’s Codify the Art of Better!

FREE!

Mentors Craftsman

$$

$$

$ $$$ $$

Use Recruiting Fees to Fund Mentorship

Who is going to teach all the developers?

VisibilityClarity

Awareness Target

Teach: Software Mentorship

Mentorship is the Path to Mastery

9-Month Weekly Peer Mentorship Certification

Mastery I

Mastery II

Mastery III

Mastery I. Teach decision skills to mid or senior developers Mastery level 1 focuses on identifying poor decision habits and learning strategies to correct the habits. Primary skill: recognizing decision patterns.Mastery II. Teach decision skills to junior developersMastery level II explores how to create reference experiences to support decision-making when a developer doesn’t have past experiences to draw from. Primary skill: Constructing conceptual models.

Mastery III. Design a new decision-making testMastery level III explores turning tacit knowledge into explainable knowledge and developing strategies for teaching abstract concepts. Primary skill: codifying decision-making knowledge.

(I’ll be your circle coach)

Craftsman ICraftsman II

Craftsman III

Each wave of Mastery III Craftsman will generate a new craftsman certification program

Generating New Skill Certifications

Craftsman ICraftsman II

Craftsman III

Developers in the craftsmanship programwill receive 1-on-1 mentoring while developing features

on:

Craftsmanship Training

Open Mastery’sOnline Certification Platform

Profile

Profile

Profile Profile

Profile

Profile

Certifications will require video critique of other developers.Open Mastery Certification

Online Graded Videos

Mentor’s Skill Badge

Craftsman Skill Badge

Balance Creates Sustainability

The more developers in the mentorship program,

the more mentors available to teach the craft.

Craftsman I

Craftsman II

Craftsman III

Mastery I

Mastery II

Mastery III

Additional SkillsMastery of Skills



Software Mastery






Learn Teach

VisibilityClarity

Awareness Target

Learn: Organizational Mastery

Traditional Cost AccountingPressure to Cut CostsInvisible Indirect Costs

Really Bad Management Decisions

+

+

Eli Goldratt’s “The Goal”

Ash Maurya’s “Scaling Lean” (early 2016)

“The Art of the Scientist” — Ash Maurya

Theory of constraints applied to services business.

Retention

Revenue

ReferralActivation

Acquisition

Ash Maurya’s Customer Factory

Dave McClure’s “Pirate Metrics” mapped to a Customer Factory

Goldratt’s Throughput Accounting

SystemProductivity

ThroughputInventory * Operating Expense

=

Rate at which the system makes

money

Rate of Sales Revenue

Investment tied upin the system

Money to convertinventory into

throughput

Ash Maurya’s Customer Factory Translation

SystemProductivity

ThroughputInventory * Operating Expense

=

Rate at which the system makes

money

Rate of Happy Customers or Referrals

User Load Effort required to convert users into happy customers

Revenue (sales) vs Capacity Cost (cost of sales) per Customer

Throughput Accounting in a Services BusinessMy Boss:

“How do we get more customerslike these?!”

How could we make the indirect costs ofsoftware development visible to the business?

0%

100%


Troubleshooting

Progress

Learning


“Operating Expense”

Throughput Accounting in a Software Business

What if troubleshooting timewent on the balance sheet?

IFM Tools

IFM Tools

IFM Tools IFM Tools

IFM Tools

IFM Tools

Member companieswork together tofigure out analyticrules

Idea Flow Analytics PlatformPrivate data

Automate Pattern Recognition and Decision Support

CompaniesPaid Membership

Why Pay for Membership?

Company Members get:Registered employees under non-solicit

Push this button to turn the school into a consultancy.

Access to Idea Flow analytics platform

Access to private training & consulting

Advertising of jobs to devs in the network



Software Mastery






Learn Teach

This is Painful!

Our Application

PROBLEMS

Problems cascade through the supply chain…

Bad Software is like Environment Pollution

Cost&

Risk

Complexity

Cumulative Complexity in the SW Supply Chain(i.e. shared dumping ground of crappy software)

HumanLimitations

VisibilityClarity

Awareness Target

Learn: Supply-Chain Mastery

Designing for Evolution

Pain Pushes

(Threat of Survival)

Opportunity Pulls

(Path of Least Resistance)

“The Industry”

RESET

Human Systems DesignThere is always cost. There are always

consequences. Open != Good

Private Competition

Survival of the Fittest Self-Optimizing

CreativityInnovation

Open Standards

Define the CompetitionOptimize the Whole

Public DebateEmpathyInteractions

causesystem effects

Pain Pushes

(Threat of Survival)

“The Industry”

How do we create pain?

RESET

...

The Modern API Decision-Making Process

“Hmm... I need a Contact Management API.”

RESET

Contact Management API

...



RESET


...

Our API directory now includes 63 CRM APIs. The newest is thePingGiant API. The most

popular, in terms of mashups, is theSalesforce API. We list 44 Salesforce mashups. Below

you'll find some more stats from the directory, including the entire list of CRM APIs.

source: http://programmableweb.com



http://www.programmableweb.com/apitag/CRM

http://www.programmableweb.com/api/pinggiant

http://www.programmableweb.com/api/salesforce.com

http://www.programmableweb.com/api/salesforce.com/mashups

http://programmableweb.com/

RESET


...






“Ugh...this is taking too long.”







RESET


...






“Hey George, what API do you use for Contact Management?”








RESET


...







“We made our own Salesforce mashup.

I’ll send you a link.”








RESET


...







“We made our own Salesforce mashup.

I’ll send you a link.”

“Thanks, George. I’ll use that one I guess.”








Learnable APIsOpen Standard

for

What if we had…

Easy to Learn and Use Hard to Learn and Use

Learnability Index

Learnability measures the cost of understanding.Learnability measures the risk of mistakes.

“Learnability” is the average friction across a set of Developer Use Case Experiments

RESET


...


Let’s Try this Again...

RESET


...


Informed decisions create selection pressures for quality in the market

Cost of Ownership Analysis

Let’s Try this Again...

How do we create pull?

Opportunity Pulls

(Path of Least Resistance)

“The Industry”

VisibilityClarity

Awareness Target

Teach Software Mastery!



Software Mastery






Learn Teach

Let’s work together to solve our shared problems!

Open Mastery 2016Let’s Codify the Art of Better!

Mentors Craftsman

Open Mastery is a redesign of public education

Driven by a capitalist feedback loop and industry-leading talent,

rather than tuition, taxes, and politicians.

And It’s FREE!

@iamthecavalry

We can lead the way!

I need your help!

@janellekz

Open Mastery 2016Join us! @openmastery

[email protected]

Thank you!

Free e-book if you sign up before publish day! (Jan

2016)

Tweet about #ideaflow!

IFM Tools available at: github.com/ideaflow/tools

mailto:[email protected]

http://ideaflow.org/tools