systems engineering in the face of multiple models ... · pdf filesystems engineering in the...

26
Effectively Managing Process Compliance Systems Engineering in the Face of Multiple Models, Standards and Best Practices. Joseph Morin, Integrated System Diagnostics [[email protected]] Erich Meier, Method Park [[email protected]]

Upload: hoangduong

Post on 12-Mar-2018

216 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

1/V1.12© 2010 www.methodpark.de www.isd-inc.com

Effectively Managing Process Compliance

Systems Engineering in the Face ofMultiple Models, Standards and Best Practices.

Joseph Morin, Integrated System Diagnostics[[email protected]]Erich Meier, Method Park [[email protected]]

Page 2: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

2/V1.12© 2010 www.methodpark.de www.isd-inc.com

Agenda

• Current Challenges

• Goals

• Proposed Solution

• Tool Support and Interfaces

• Benefits

Page 3: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

3/V1.12© 2010 www.methodpark.de www.isd-inc.com

Current Challenges

• Heavy time and cost pressure affects product quality

• Frequent audits or appraisals

• Up to 25% of work hours for audit preparation and performance

• Assure compliance with specific models or standards for safety, security, quality, reliability, etc. in parallel

Page 4: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

4/V1.12© 2010 www.methodpark.de www.isd-inc.com

Goals

• Allow organizations to focus on the definition and implementation of processes

• Provide automated support to facilitate enactment of the processes

• Provide support for continuously monitoring adherence to the processes

• Support appraisal preparation and performance by automating evidence collection

• Effectively collect, manage and track non-conformances to closure in order to improve processes and secure future audit success

Page 5: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

5/V1.12© 2010 www.methodpark.de www.isd-inc.com

Key Idea

• Actively use the development processes in projects, i.e. by creating work products in projects

• Link the actively used development processes to the models or standards that need to be fulfilled (e.g. CMMI, ISO)

• Continuously perform PPQA activities

• Result: evidence data will automatically be collected in the background

Perform Organizationaland Project Processes

Assure Process Qualityand Control Compliance

against Reference Models

ProcessSelection

ProcessTailoring

ProcessCustomization

ProcessMeasurement

ProcessImprovement

QA & AppraisalPreparation

AppraisalPerformance

ImprovementFindings

ProcessExecution

Page 6: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

6/V1.12© 2010 www.methodpark.de www.isd-inc.com

Multi-model Support

• Multiple reference models can be linked into multi-models

• Multimodel links are weighted

• Multimodels are specific to organization (i.e. dependent ontype of business)

CMMI-DEV

CMMI Cross-Constellations

CMMI-SVC CMMI-ACQ

AS 9100, ISO 14000, DoD 5000.01 & 02, …

Business and Engineering Processes

Baldrige / EFQM

ISO9001

CobiT

CMMI-DevPeople CMM ISO20000-1

eSCM / CMMI-Acq

PEOPLE SERVICES & RISKS SOLUTIONS & VALUE

Page 7: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 7© 2008 Integrated System Diagnostics, Inc.

Establish and maintain Organization Standard Process model(s) in Model Wizard or Stages or tooling with similar capability.

Create or import a model of your enterprise processes that incorporates the desired best practices of applicable standards and model(s). Update when needed.

This step is performed once for each level at which the process is tailored within the enterprise. (e.g. Enterprise, Division, Department, Product Line)

Ultimately it is tailored to a particular project . At that point it becomes a representation of the Project’s Defined Process.

It can then be used as the basis for identifying and analyzing information and evidence supporting:

Project QA activity and monitoring,

Internal compliance audits, and

External benchmarking appraisals or compliance audits.

Process Composition and Definition

Page 8: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

8® 2005, Appraisal Wizard, ISF for Excellence - All rights reserved – ISD Inc.

RelationshipEnterprise Architecture, Best Practices, Process Improvement

Business Architecture

Activity A – Missing Process

ISF CPP X Objective ZISO Clause X

PCCM Practice Y

Best PracticesProcess Improvement

Implementation Guidance

Activity B – Needs Process ImprovementISF CPP X Objective Z

ISO Clause BCMMI Practice SP #.#

Market & CompetitorsLeadership,

Culture, Strategic Alignment

Infrastructure &Technology

Measurement, Innovation andImprovement

HumanCapital

Organizational

Market

Customers P&S ExecutionP&S Sustentation Customers

SupportManagement

Results (performance)

Customers(pre-contract)

Customers(post-contract)

Products & ServicesSuppliers

Suppliers

Page 9: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

9® 2005, Appraisal Wizard, ISF for Excellence - All rights reserved – ISD Inc.

Relationships:Process Architecture, Best Practices, Audits

CMMI

COBIT

ISO20000

eSCM

ISO9001

Baldrige

Market & Competitors

Leadership, Culture, Strategic

Alignment

Infrastructure &Technology

Measurement, Innovation andImprovement

HumanCapital

Organizational

Market

Customers P&S Execution P&S Sustentation Customers

Support

Management

Results (performance)

Customers(pre-contract)

Customers(post-contract)

Products & Services

Suppliers

Suppliers

Best PracticesISF for Excellence

PPQA / Audit / Appraisal FindingsCustomer Process Architecture

Integration / System

Diagnostic Tools

Enterprise Appraisal

Process DefinitionProcess Compliance

Page 10: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

10/V1.12© 2010 www.methodpark.de www.isd-inc.com

ISF for Excellence – Systemic View Integration Framework

Market & Competitors

Leadership, Culture, Strategic

Alignment

Infrastructure &Technology

Measurement, Innovation andImprovement

HumanCapital

Organizational

Market

Customers P&S Develop. P&S Sustaining Customers

Support

Management

Results (performance)

Customers(pre-contract)

Customers(post-contract)

Products & Services

Suppliers

Suppliers

Page 11: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

11/V1.12© 2010 www.methodpark.de www.isd-inc.com

Solution Details

• Reference models are broken into different model requirements

• Process elements are linked with model requirements

• Model requirements are mapped to evidences

• Evidence data maps can be generated

Process Execution

QA & Appraisal Preparation

WorkProduct

WorkProduct

Evidence

WorkProduct

ProcessStep

ProcessStep

Evidence

EvidenceEvidence

Reference ModelModel

RequirementModel

Requirement

ModelRequirement

Page 12: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

12/V1.12© 2010 www.methodpark.de www.isd-inc.com

Example: Process Lifecycle

Page 13: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

13/V1.12© 2010 www.methodpark.de www.isd-inc.com

Example: Process Compliance Mapping

Page 14: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

14/V1.12© 2010 www.methodpark.de www.isd-inc.com

Example: Compliance Gap Analysis

Page 15: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

15/V1.12© 2010 www.methodpark.de www.isd-inc.com

Example: Evidence Data Generation

Page 16: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

Use Appraisal Wizard (AW) to setup Appraisal Wizard Audit Template(s) for each type of Audit you want to perform (e.g. setup unique record types, status values, and document types, etc.)

•Create Audit Question records to build audit checklist for set of audit checkpoints.•Use the Record Documents tab and the document list to identify the expected objective evidence for each audit question.

Use the AW tool during the audit to document the audit finding(s) (e.g. “Compliance, “Non-Compliance (N/C)”, “Information Needed” record types).

•Write up N/C Action Item records •Determine compliance ratings

•Use Model Mapper to map QA Reference model to a standard or model (e.g. CMMI) for use in appraisals. •Import new “Mapped Model” into AW to use audit results and organization's existing data to support Readiness Reviews and Appraisals.

Audits and Appraisal Process

3

Use the AW tool to build various reports of the audit finding(s) (e.g. Reports of % compliant/% non-compliant findings; List N/C Action Items; etc.) to prepare for follow-on audits.

4

2

Use Model Wizard to create or import a model that represents your Organizational Standard Model and/or the desired QA Reference Model.

1

5

© 2008 Integrated System Diagnostics, Inc. 16QA Audit and Appraisasl Demonstration

Page 17: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 17© 2008 Integrated System Diagnostics, Inc.

QA Reference Model in Model Wizard

Page 18: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 18© 2008 Integrated System Diagnostics, Inc.

Setup Audit Templates Using QA Reference Model

Page 19: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 19© 2008 Integrated System Diagnostics, Inc.

Audit Spreadsheet Generate and Re-import

Page 20: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 20© 2008 Integrated System Diagnostics, Inc.

Determine Status of Records/Documents

Page 21: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 21© 2008 Integrated System Diagnostics, Inc.

Determine Element Compliance Ratings

Page 22: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 22© 2008 Integrated System Diagnostics, Inc.

Audit Results and organization's existing data supports appraisals and ties to other standards/ models

Page 23: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

QA Audit and Appraisasl Demonstration 23© 2008 Integrated System Diagnostics, Inc.

CMMI-DEV 1.2 Mapped to QA Reference Model

Page 24: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

© 2008 Integ QA Audit and Appraisasl Demonstration 24

Generate Reports

Page 25: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

25/V1.12© 2010 www.methodpark.de www.isd-inc.com

Benefits

• Reduce complexity• Process descriptions become consistent and lean• No „CMMI or ISO speak“• Fulfill multiple standards in parallel

• Reduce efforts and costs• Companies reported up to 60% less efforts

for audit preparations• No interruption of operational work because

of audit preparations

• Concentrate on process improvement,not process administration

Page 26: Systems Engineering in the Face of Multiple Models ... · PDF fileSystems Engineering in the Face of Multiple Models, Standards and Best Practices. ... • Up to 25% of work hours

26/V1.12© 2010 www.methodpark.de www.isd-inc.com

Thank youfor your interest.

Visit websites http://www.isd-inc.com and http://stages.methodpark.com

Download whitepaper from http://www.methodpark.com/en/resources/

Register for product trials at http://www.stagesAsAService.com

Request additional information at [email protected] or [email protected]