fiverr - delivering fast w/ no qa - agile israel 2016 gil wasserman

Delivering Fast.Then Faster.No Retreat. No Surrender.No QA.Gil Wasserman Fiverr VP R&DAgile Israel 2016

About Fiverr

Quick Facts

About Fiverr

• Founded: 2010

• Funding: $110M

• Team: 250

• Dev team: 70

• Offices: Tel Aviv, NYC, SF, Chicago, Miami

Fiverr is the world’s largest marketplace for creative and

professional services with millions of buyers and sellers

around the world.

Logo Design, Illustration & Caricatures, Video & Animation, Copywriting and more! Work Created on Fiverr

Creative Goldmine

190 Countries

150 Categories

25 Million Orders

Order processed every 4 seconds; Over 1M orders per month

CD Daily

Production Deploys

Deploys Done by

Developer

Task Force: PM, BE, FE,

BA, Designer

20 TFsMicro Tasks, Large

Projects

Team X 5

Millions LOC

No QA !

NoQA - WhyQA in The

Critical

Path

Is a Drag Is a Drug

Is a

Barrier to

Self

Growth

Software Development is a Knowledge Game

NoQA - For WhatRemoving

QA from The

Critical Path

Faster

DeliveryEfficient Effective

Better

Quality

Does It Fit All ?

Section A

First Steps: Learn to walk

Think smallNo context switch.

QA not a Gatekeepera Team Member

QA StarvationUse your judgement

No Bugz Manag.

15 → 50→ 70 Dev2 → 2 → 0 QA

Learn to

Forget

Hey...What About Automation?• UT vs Integration vs full system tests ?

• Environment - Local, staging, p-likes

• DOM load vs full rendering?

• UT - Essential quality tool or a waste?

• Automated testing development - a bottleneck or not?

• Successful run - a condition to merge?

• Cross Browsers?

• Refactoring?

Guiding Principles• Company Vision and Mission

• Dev Mission: Quality Impact, Fast!

• Nothing is perfect. Everything is imperfect. Grow within uncertainties.

• Minimal policy setting

• Trust → Autonomy → Ownership → Accountability

• Fear is no option. Be Responsible. Use your judgement

• Continuous learning

• Continuous goal setting

HubSpot

So... What About Automation?• UT vs Integration vs full system tests ?

• Environment - Local, staging, p-likes

• JS or full rendering?

• UT - Essential quality tool or a waste?

• Automated testing development - a bottleneck or not?

• Successful run - a condition to merge?

• Cross Browsers?

Own the Journey

Own the FeatureUnderstand the user

Own the FeatureLive in Production

Own the Business

Production Health

Own the BusinessFollowup

- Graphite, Grafana- Kibana- Graylog- Seyren- CircleCI- Slack- Docker, Consul- Impala- SiSense- P-Likes- New Relic- Rollout- Feature flags- AB tests

MVR, MVA

Rule Your Domain• Tech and Product ownership

○ Teamwise

○ Enabler not a Tyrant

○ Managing tech debt

○ Code health

○ Production health

“Devs know their code best and should test it.”Large project retrospect

Our Current Quality Pyramid Cup

Manual Local Testing

UT

Manual P-Like Testing

Rollout Strategy

Production Monitoring/AlertsQuick

Turnaround

Judgement Call

Is It Right For Me?

Thank you