automated testing: go beyond the basics

39
W3 Test Automation 10/5/16 11:30 Automated Testing: Go Beyond the Basics Presented by: Jim Holmes Guidepost Systems Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 8882688770 9042780524 [email protected] http://www.starwest.techwell.com/

Upload: techwell

Post on 23-Jan-2018

158 views

Category:

Software


3 download

TRANSCRIPT

Page 1: Automated Testing: Go Beyond the Basics

       W3  Test  Automation  10/5/16  11:30            

Automated  Testing:  Go  Beyond  the  Basics  Presented  by:    

 

  Jim  Holmes      

Guidepost  Systems    

Brought  to  you  by:        

   

   

350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073    888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  [email protected]  -­‐  http://www.starwest.techwell.com/      

 

   

Page 2: Automated Testing: Go Beyond the Basics

   

Jim  Holmes      An  executive  coach  at  Pillar  Technology,  Jim  Holmes  works  with  organizations  trying  to  improve  their  software  delivery  process  and  ship  higher  value  to  their  customers.  He's  the  owner/principal  of  Guidepost  Systems,  engaging  directly  with  struggling  organizations.  Since  joining  the  US  Air  Force  in  1982,  he  has  been  in  various  corners  of  the  IT  world  with  organizations  from  start-­‐ups  to  Fortune  10  companies.  Jim  has  been  in  many  different  environments  but  greatly  prefers  the  lean  and  agile  communities.  When  not  working,  Jim  may  be  playing  Xbox,  hiking  with  his  family,  enjoying  a  glass  of  wine,  or  banished  to  the  garage  practicing  his  guitar.  

Page 3: Automated Testing: Go Beyond the Basics

Automated Testing

Beyond The Basics

Slides:SpeakerDeck.com/JimHolmes

Page 4: Automated Testing: Go Beyond the Basics

A Story of Woe

finf

Page 5: Automated Testing: Go Beyond the Basics

What’s YOUR

Current State?

Slow

Page 6: Automated Testing: Go Beyond the Basics

Brittle

High Maintenance Cost

Page 7: Automated Testing: Go Beyond the Basics

WTFITWBWH

What The Fuck is Tested By

What Where How

HECK

Page 8: Automated Testing: Go Beyond the Basics

TrustDeficit

Automation’s Goals?

Page 9: Automated Testing: Go Beyond the Basics
Page 10: Automated Testing: Go Beyond the Basics

Testers Test!

TRUST

Page 11: Automated Testing: Go Beyond the Basics

Let’s TalkFixes

First and Foremost:

Be Thoughtful

Page 12: Automated Testing: Go Beyond the Basics

Good Coverage

Reduce Overlap

Page 13: Automated Testing: Go Beyond the Basics

Understand Data Flows

Page 14: Automated Testing: Go Beyond the Basics

TDD Is Magic Bacon Unicorns and

Solves Everything!

Page 15: Automated Testing: Go Beyond the Basics

Don’t Test Stupid Stuff

Page 16: Automated Testing: Go Beyond the Basics

Don’t Test Low Value Less Optimal Stuff That Someone’s

Already Tested Or Is a Dependency You

Don’t Want

Gmail 3rd Party Controls

CAPCHA

SharePoint

Page 17: Automated Testing: Go Beyond the Basics

Test Code is

Production Code!

SOLID

Page 18: Automated Testing: Go Beyond the Basics

SRP

Cucumber => Step Definitions

Page 19: Automated Testing: Go Beyond the Basics

Domain Objects

CopyProductCatalogEditProductCatalogDeleteProductCatalogTransmitBookingOrderHandleRejectedBookingOrderWashJimsCarFixJimsCarReplaceJimsCarEngineWithRocket

Page 20: Automated Testing: Go Beyond the Basics

ProductCatalogBookingOrderJimsCarCarEngineRocketAdapterCasketForJim

Page Objects

Page 21: Automated Testing: Go Beyond the Basics

DRY moist

Page 22: Automated Testing: Go Beyond the Basics

Avoid Too Much Abstraction

Test Data

Page 23: Automated Testing: Go Beyond the Basics

Don’t Use UI Tests to Set up or Configure

Baseline Datasets

Page 24: Automated Testing: Go Beyond the Basics

Store Datasets in Version Control!

Custom APIs

Page 25: Automated Testing: Go Beyond the Basics

Help tests be granular, random, and independent

Support APIs leverage existing

system APIs

Page 26: Automated Testing: Go Beyond the Basics

CreateRetrieveUpdateDelete

Setup and Teardown

Page 27: Automated Testing: Go Beyond the Basics

Configuration

FSAPITBAA

Page 28: Automated Testing: Go Beyond the Basics

Freaking Stupid Assed Pain In The Butt Async Actions

SharePoint

Page 29: Automated Testing: Go Beyond the Basics
Page 30: Automated Testing: Go Beyond the Basics

Oracles

Speed

Page 31: Automated Testing: Go Beyond the Basics

Parallelization Solves Everything!

Page 32: Automated Testing: Go Beyond the Basics
Page 33: Automated Testing: Go Beyond the Basics

Fix Your Dang System!

Page 34: Automated Testing: Go Beyond the Basics

bit.ly/3HoursTo3Mins

Takeaways:

Page 35: Automated Testing: Go Beyond the Basics

Automate High-Value, High Risk

Page 36: Automated Testing: Go Beyond the Basics

Avoid Overlapping

Coverage

Test Codeis

Production Code

Page 37: Automated Testing: Go Beyond the Basics

Manage Your Data

Build Out APIs

Page 38: Automated Testing: Go Beyond the Basics

Thank You!

bit.ly/leadershipjourney

Page 39: Automated Testing: Go Beyond the Basics

Slides:

SpeakerDeck.com/JimHolmes

[email protected]

FrazzledDad.com

@aJimHolmes