MIMOS - Grid software Production process.

QA Practices and Tools

Ng, Kwang Ming2nd June 2008

2

• MIMOS background

• CMMI @ MIMOS

• Testing @ MIMOS

Pointers

3

MIMOS Berhad is an agency under the Malaysian Government’s Ministry of Science, Technology & Innovation and its focus is on National R&D for ICT

MIMOS Background

4

To be a Premier Applied Research Center in Frontier Technologies

To pioneer innovative information & communication technologies towards growing globally competitive indigenous industries

Vision

Mission

MIMOS BackgroundMIMOS: Vision & Mission

5

MIMOS BackgroundPath to Manageable Quality in Software

• A defined development process that is manageable yet flexible.– Driven by guidelines.

• A testing rigueur that covers user experience features.– Focus on the primary user impact.

6

• CMMI @ MIMOS– MIMOS Process Groups & Production Process– Asset library & review bank

• Testing @ MIMOS– Usability Testing– Functional, Performance & Load Testing– Compatibility & GRIDs

MIMOS BackgroundPath to Manageable Quality

• Why?– Its a proven standard for process management and

improvement– Provides a flexible guideline for software development

framework.

• MIMOS CMMI Implementation– Software Process Focus Groups– Software Production Process Overview– Process Infrastructure (Process Asset Library)– Project Artifacts

CMMI@ MIMOS

Sponsors

CMMI ProcessImprovement Team (PIT2)

Engineering

Process

Project Management

Support

Functional Area Reps

Process Action Team

MIMOS CMMI Process Focus

Process, Tool and Six Sigma

Software Development

Testing

Human Resource

Competency Development Group

(CDG1)

1 CDG – representatives from SDCE Departments, Projects Groups and Corporate HR2 PIT – comprise of Process Area (PA) Champions for each CMMI PA within SDCE

CMMI@MIMOSMIMOS Software Process Group

Customers

RequirementAnalysis

Planning

RequirementGathering

DesignCode & Unit Test

Build & Integration Test

TestPlanning

Test Development

Functional / System Test

Customers

Review

Project Management

Quality Management

Integral & Support

Process Improvement

Configuration and Change Management

Review Review Inspection

Review Review

IRR – Integration Readiness ReviewTRR - Test Readiness ReviewRRR - Release Readiness Review

RRR

TRR

IRR

CMMI@MIMOSMIMOS Software Production Process

Customers

RequirementAnalysis

Planning

RequirementGathering

DesignCode & Unit Test

Build & Integration Test

TestPlanning

Test Development

Functional / System Test

Customers

Review

Project Management

Quality Management

Integral & Support

Process Improvement

Configuration and Change Management

Review Review Inspection

Review Review

IRR – Integration Readiness ReviewTRR - Test Readiness ReviewRRR - Release Readiness Review

RRR

TRR

IRR

SSTE, STE

SCM

SCM

SQEPM

PM

SSE, SDE

CMMI@MIMOSMIMOS Software Production Process

Tools, Training Material & Plans

Policies

Process Documents

Supporting Process AssetsChecklists, Forms, Templates, Guidelines, etc.

Standards &Tailoring Guidelines

“What's”“What's”

Job AidsJob Aids

EnablersEnablers

Policy StatementsPolicy Statements

FrameworkFramework

CMMI@MIMOSMIMOS Process Infrastructure

CMMI@MIMOSMIMOS Process Asset Library

BEST PRACTICE WEBSITE

MIMOS Best Practice Website

1. Identify Areas1. Identify AreasFor ImprovementFor Improvement1. Identify Areas1. Identify AreasFor ImprovementFor Improvement

3. Collaboration3. CollaborationEffortEffort

3. Collaboration3. CollaborationEffortEffort

Q1 2007 Q2 2007 Q3 2007

2. Execute2. ExecuteImprovement EffortImprovement Effort

2. Execute2. ExecuteImprovement EffortImprovement Effort

AREAS • test environment• test processes• tester competencies

METHODS • questionnaires• footprint charts• other best practices

AREAS • test environment• test processes• testers competencies

METHODS • individual KPIs• group KPIs• CMMi• footprint chart reviews

PARTNERS • IBM (RUP)• QAI• Other Certification Bodies

Test COE

Testing@MIMOS

Screen VideoAny activity that is taking place on the user's screen

Mouse ClicksMouse events that include left, right and middle clicks

Camera VideoAll of the user’s video through a camera

AudioOriginal user audio through a microphone

Screen TextAll text on the user’s screen during the period of the recording

Keyboard ActivityEvery keystroke that the user makes

Web Page ChangesBrowser events such as when and where a web page is changed

Window EventsWindow events such as the window/dialog getting focus, opening, closing and resizing

Testing@MIMOSUsability Testing

Functional test cases are derived from the functional requirements of the software and are the basis for system testing.

These help you in testing if the required functionality is working as per the specifications and if the expected result is correct.

PASSEDPASSED

FAILEDFAILED

PASSEDPASSED

Testing@MIMOSFunctionality Testing

Controller

System Under TestSystem Under Test

The process of exercising an application by emulating actual users with a load generation tool for the purpose of finding system bottlenecksBecause a break at any point in your system means your customers are not getting the service you think they are

Testing@MIMOSPerformance Testing

LOAD TESTINGLOAD TESTING - exercising the system under test by feeding it the largest tasks it can operate with. Load testing is sometimes called volume testing, or endurance testing.

STRESS TESTSTRESS TEST - overwhelming its resources with data. The main purpose behind this madness is to make sure that the system fails and recovers gracefully - this quality is known as recoverability.

Controller

System Under Test

Testing@MIMOSLoad & Stress Testing

VISTA

APPLICATION

Testing application on different platform to ensure the scalability and robustness of the application.

Testing@MIMOSCompatibiliy Testing

TESTING AREAS:

• SecurityTest on Grid Security Infrastructure for loopholes and vulnerabilities

• Resource ManagementTest on the reliability of the resources on the grid

• Information ServiceValidate and verify the information flows for grid resources

• Data ManagementTest on connectivity between data resources and client

Testing@MIMOSGRID Testing

Thank You