relating testing to quality –timeliness of testing –quality attributes gauge by testing –roles...
TRANSCRIPT
![Page 1: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/1.jpg)
•Relating Testing to Quality–Timeliness of Testing
–Quality Attributes Gauge by Testing– Roles
•Defining Test Discipline Activities
•Elaborating the Test Discipline
•Evaluating Testing Activities
Test Discipline - Outline
![Page 2: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/2.jpg)
Software problems are much more costly to find and repair after after the software is deployed
Development Deployment
Cost
Early Testing Reduces the Cost of Quality
UPEDU Concept: Product Quality
![Page 3: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/3.jpg)
Quality Attributes
Functionality
Reliability
Application Performance
System Performance
Is the application doing what is required?
Is the application leaking memory?
Is the application responding acceptably?
Is the system performing under production load?
Create test cases for each scenario implemented
Use analysis tools and code instrumentation
Check performance for each use-case/scenario implemented
Test performance of all use-cases under authentic and worst-case load
Type Why? How?
![Page 4: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/4.jpg)
•Relating Testing to Quality
•Defining Test Discipline Activities–Types of Testing
–Test Planning and Design Activities
–Test Implementation Activities
– Test Execution Activities
•Elaborating the Test Discipline
•Evaluating Testing Activities
Test Discipline - Outline
![Page 5: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/5.jpg)
Levels of Testing Discipline
Debugging
Unit
Integration
System
AcceptanceAlpha testing
Beta testing
Chunk of source code
Designed product unit
Architectured product units
Product environment
Product functionality
Product usability
Programmer workmanship
Implementer design realization
Implementer product realization
Implementer product operation
Client product understanding
Users product
Level Product Target Activity Tested
UPEDU Concept: Stages of TestUPEDU Concept: Acceptance Testing
![Page 6: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/6.jpg)
Test Discipline Involves Many Activities
Design Test
Tester
DesignerDesign Test Classes
Implementer
Implement Test Components
Plan Test Evaluate TestExecute Test
Plan &Design
Implement
Execute
![Page 7: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/7.jpg)
Test Planning and Design Activity
Implementer
Integrator
End User
Test Plan
SupplementarySpecifications
DesignModel Implementation
Model
Tester Plan Test
Use-Case Model
Design Test
Implementer
ImplementComponent
Use Case
Component
Analyst
Find Actors
and Use Cases
(from Requirements
Detail a Use Case
(from Requirements)Analyst
Test Cases
![Page 8: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/8.jpg)
Test Implementation Activities
DesignerDesign Test Classes
ImplementerImplement Test Components
Test Components
Test Classes
Design Model
Test Cases
Build Component
Implementer
ImplementComponentIntegrator
Integrate System
![Page 9: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/9.jpg)
Driver
Stub1
Function
Stub 2
Driver:An upstream software or interface that provides access to the Function
Stub:Software that simulates a downstream process
Simple Complex
The Functions of the Stubs & Drivers
![Page 10: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/10.jpg)
Test Execution Activities
Tester Execute Test
Component(fixed)
Test ResultsBuild
ImplementerFix Defect
(from Implementation)
Evaluate Test Test evaluation report
IntegratorIntegrate System
(from Implementation)
Defect
![Page 11: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/11.jpg)
Regression Testing is EmphasizedIterationIteration
nnIterationIteration
n + 1n + 1
IterationIterationn + 2n + 2
PlanTest
Execute Test
Evaluate Test
Defect Tracking
ImplementTest
DesignTest
Build Build
ImplementationAnalysis &Design
RequirementsCapture
Development Cycle
ProjectPlanning
Test discipline
UPEDU Concept: Life Cycle of Testing
![Page 12: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/12.jpg)
•Relating Testing to Quality
•Defining Test Discipline Activities
•Elaborating the Test Discipline–Tests Cases
–The Test Plan
–The Risk Assessment Matrix
– Defect and Evaluation Reports
•Evaluating Testing Activities
Test Discipline - Outline
![Page 13: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/13.jpg)
Large Diversity of Artifacts
TesterTester Designer
responsiblefor
Implementor
responsiblefor
Test CasesTest Cases
DefectsDefectsTest ClassesTest Classes
Test ComponentsTest ComponentsTest PlanTest Plan
0
2
4
6
8
10
Elapsed Time (seconds)
Response Time
(seconds)
Test EvaluationTest Evaluation
Test ResultsTest Results
![Page 14: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/14.jpg)
The Major Elements Possess Test Cases
Test CaseTest Case
Requirements
SupplementarySpecification
Design ModelArchitecture
Use-Case Model
UPEDU Guideline: Test Cases
![Page 15: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/15.jpg)
The Test Plan Outlines the Schedule
![Page 16: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/16.jpg)
Risk Assessment MatrixOperational Profile
FactorRequirement for Test
Test Priority Description
Risk Factor
Risk Description Test Priority
Operational Profile Description
Risk Assessment
![Page 17: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/17.jpg)
A Defect Evaluation ReportLength of time in current status
0
5
10
15
20
< 1 day 1 - 2days
3 - 5days
6 - 10days
> 10days
# o
f D
efec
ts
Open
Pending
Use Case / Requirement Test Proc. ID Implementedtest cases
Exec. %Covered
ATM 5 5 50Cash Withdrawal 5 5 63
Normal Flow 1 CWN1xx01 1 1 100Normal Flow 2 CWN2xx01 3 3 100
Minimum Value 1 1 100Maximum Value 1 1 100Out of Range 1 1 100
Alternative Flow 1 CWAxxx01 1 1 100Alternative Flow 2 2 0 0Exception Flow 1 0 0
Deposit 0 0 0Transfer Funds 0 0 0Account Balance 0 0 0
Defects by Status(cumulative)
0
20
40
60
Week
# o
f D
efec
tsClosed
Opened
![Page 18: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/18.jpg)
•Relating Testing to Quality
•Defining Test Discipline Activities
•Elaborating the Test Discipline
•Evaluating Testing Activities–Are Defects Significant?–Are Testing Activities Reliable?
– Is the Product Quality Met?
Test Discipline - Outline
![Page 19: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/19.jpg)
Four Main Parameters in Defect Analysis• Status
– Open, being fixed, closed, etc..
• Priority– Resolve immediately, high priority, normal queue, low priority.
• Severity– Fatal error, major function not performed, minor annoyance.
• Source– Requirement, architecture, module N, lib.
![Page 20: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/20.jpg)
Defects by Status
0
510
15
2025
30
1 2 3 4 5 6
Week
# o
f D
efec
ts
ClosedOpened
Trend Reports Identifies Defect Rates Quality GapQuality Gap
![Page 21: Relating Testing to Quality –Timeliness of Testing –Quality Attributes Gauge by Testing –Roles Defining Test Discipline Activities Elaborating the Test](https://reader035.vdocuments.mx/reader035/viewer/2022081603/56649e5c5503460f94b53fce/html5/thumbnails/21.jpg)
Defect Density ReportDefect Density by Use Case Flow
and Severity
02468
10
Normal1
Normal2
Alt. 1 Alt 2 Alt 3
Use Case Flow
# o
f D
efec
ts
HighMedLow