how to scale mobile testing across several teams...34 @dnlkntt | how to scale mobile testing across...

How to Scale Mobile

Testing Across

Several TeamsDaniel Knott | @dnlkntt

Hi, I‘m

Daniel Knott

Lead Software Test Engineer Mobile

@dnlkntt

www.adventuresinqa.com

www.handsonmobileapptesting.com https://leanpub.com/smartwatchappt

esting@dnlkntt | How to Scale Mobile Testing across several Teams

http://bit.ly/2bUasW8

3

@dnlkntt | How to Scale Mobile Testing across several Teams

Founded 2003

Listed company

HQ Hamburg

+950 employees (30+nationalities)

+200 developer

+20 product teams Professional networkPeople, Jobs, News, Events+12 Mio users, DACH focus

4


Why is mobile testing so important?

5


6


https://twitter.com/_adrianhinojosa/status/757015786057641985

7


Every app can be the next bigthing overnight!

8


And then, it must work

http://www.trustedreviews.com/opinions/how-to-fix-common-pokemon-go-problems-bugs-issues

9


Mobile Technology changedour life

10


11


To keep up the fast pace of the mobile technology we

need to scale

12


2008

13


No Mobile Knowledge

14


External Mobile Developmnet

15


16


2010

17


# 2 iOS Developer

# 2 Android Developer

# 2 Software Test Engineers

# 1 Product Owner

# 1 Designer / UX

First Mobile Team

18


# 60+ Web Developers

# 10+ Web Software Test Engineers

# Non Public API

# 8+ Agile Teams

Web Company

Legacy challenge of „web-era“ companies

19

+10


21


2014

22


Web

iOS

Android

API

Windows

Mail Search

...

Full Stack Product Thinking

Mobile Unleashing

23

+10

Public

Feature Teams


Mobile Unleashing

24

Platform Teams Feature Teams

PO

UI/UX

Devs

Tester

PO

UI/UX

Devs

Tester

Mobile Infrastructure

PO, Devs, Tester

Windows

PO + Freelancer

News

PO, UI/ UX, Dev, Tester

Premium

BE FEPO, UI/ UX, Dev, Tester

BE FE

Jobs


Startpage


BE FE

Growth


...


BE FE


25


46 Android/ iOS Developers20 Mobile Tester

26


TestingChallenges

27

Image: https://upload.wikimedia.org/wikipedia/commons/thumb/7/75/Internet1.jpg/745px-Internet1.jpg@dnlkntt | How to Scale Mobile Testing across several Teams

28


HIRING

29


Mobile Test Automation

Image: https://stocksnap.io/photo/P9YPEQPQ18

30


CommunicationImage: https://stocksnap.io/photo/E7OYDS1NK7

31

Release Coordination

Image: https://stocksnap.io/photo/CTKY2SVZM8@dnlkntt | How to Scale Mobile Testing across several Teams

32


Release Train

33


What is a Release Train?

# Planned Code Freezes

# Fixed Release Dates

# Train is always on time

# Missing the train == features not live

http://adventuresinqa.com/2017/03/06/the-mobile-release-train/

34


Android Release Train

Code Freeze/

Upload to Google

100Users

Coding

10 days

Beta Testing7 days

20% Users2 days

50% Users5 days

Code Freeze/

Upload to Google

100%Users

Coding

10 days

Beta Testing7 days

20% Users2 days

50% Users5 days

Coding

10 days

Beta Testing7 days

20% Users2 days

50Users5 days

35

@dnlkntt | How to Scale Mobile Testing across several Teams@dnlkntt | How to Scale Mobile Testing across several Teams

36


Testautomation

37


https://upload.wikimedia.org/wikipedia/commons/

8/88/EspressoImg.png

Keep It

Functional

38


40


# Two Frameworks

# No Code Sharing

# Different Languages

41@dnlkntt | How to Scale Mobile Testing across several Teams

Migrated to Calabash

Image: http://arnoldzwicky.s3.amazonaws.com/BottleGourd.jpg

42


https://techglimpse.com/wp-content/uploads/2014/07/android-ios.jpg

43


Build Pipeline, Tools & Devices

44


Local test run

Code Review

Merge

Build Pipeline

Static Analyzer

Unit Tests

End 2 End

Tests

Alpha/ Beta

Release

45


Internal App Store

46


Mobile Devices

47


Android Test Farm

www.openstf.io

https://medium.com/xing-engineering/android-smartphone-test-farm-66f28f9bc73d#.wvd2901yi

48


Summary

49


1. Communication is key2. Hiring is not easy3. Mobile skills are important4. Invest time in your

environment5. Reconsider your work &

setup regularly

Thank You

50

Daniel Knott - @dnlkntt

www.adventuresinqa.com/publications

This is

our home!#Hamburg

Follow @xingdevs, @dnlkntt

how to scale mobile testing across several teams...34 @dnlkntt | how to scale mobile testing across...

Documents