carnegie mellon cmmi software engineering …...the software engineering institute is a federally...

22
Software Engineering Institute Carnegie Mellon CMMI ® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results September 2007 Process Maturity Profile - Page 1 © 2007 by Carnegie Mellon University Software Engineering Institute Carnegie Mellon Process Maturity Profile CMMI ® SCAMPI SM Class A Appraisal Results 2007 Mid-Year Update September 2007 We could not produce this report without the support of the organizations and lead appraisers who reported their appraisal results to the SEI SM . Our many thanks for their continuing cooperation with our data collection and analysis efforts. CMMI Appraisal Program The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Def ense and operated by Carnegie Mellon ® University ® CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon University SM SCAMPI and SEI are service marks of Carnegie Mellon University © 2007 by Carnegie Mellon University

Upload: others

Post on 27-Jun-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 1© 2007 by Carnegie Mellon University

Software Engineering InstituteCarnegie Mellon

Process Maturity Profile

CMMI®SCAMPISM Class A Appraisal Results 2007 Mid-Year Update

September 2007

We could not produce this report without the support of the organizations and lead appraisers who reported their appraisal results to the SEISM.

Our many thanks for their continuing cooperation with our data collection and analysis efforts.

CMMI Appraisal Program

The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Def ense and operated by Carnegie Mellon® University

® CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon UniversitySM SCAMPI and SEI are service marks of Carnegie Mellon University

© 2007 by Carnegie Mellon University

Page 2: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 2© 2007 by Carnegie Mellon University

Outline

Introduction

Current Status

Summary

Terms used in this Briefing

How to Report your Appraisal Results to the SEI

This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes.

The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes lead appraisers, team leaders and certified high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority”of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only.

Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on appraisal methods and for a directory of authorized lead appraisers who can perform them, visit: http://www.sei.cmu.edu/appraisal-program/

Page 3: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 3© 2007 by Carnegie Mellon University

Introduction: Purpose

Characterize the adoption of CMMI® ®

Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.1/v1.2 Class A appraisals using Capability Maturity Model® Integration(CMMI) v1.1 /v1.2 *

Encourage continued reporting of results

* Organizations previously appraised against CMMI v1.0 and which have not reappraised against v 1.1 are not included in this report

Please visit: http://www.sei.cmu.edu/appraisal-program/profile/index.html for additional information or questions you may have about this briefing before contacting the SEI directly

Page 4: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 4© 2007 by Carnegie Mellon University

Current Status

SCAMPI v1.1/v1.2 Class A appraisals conducted from the SCAMPI V 1.1 April 2002 release through andreported to the SEI by

• appraisals• organizations• participating companies• reappraised organizations• projects• Non-USA organizations

Please refer to: Terms Used in this Report on page 20

Additional charts providing different views and break down of this information will be added to this briefing as more appraisal data is reported to the SEI over time.

July 2007

2,464

1,417273

10,33867.1%

2,140

June 2007

Page 5: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 5© 2007 by Carnegie Mellon University

Based on most recent appraisal of organizations

Num

ber

Of O

rgan

izat

ions

0

50

100

150

200

250

300

350

400

450

500

550

600

650

700

750

800

850

900

950

1000

Not Given Initial Managed Defined QuantitativelyManaged

Optimizing

Process Maturity Profile by All Reporting Organizations

2140

8.8%

1.6%

33.4%

38.1%

4.2%

13.9%

Page 6: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 6© 2007 by Carnegie Mellon University

0

10

20

30

40

50

60

70

80

Not Given Initial Managed Defined QuantitativelyManaged

Optimizing

Based on most recent appraisal of organizations

Num

ber

Of O

rgan

izat

ions

Process Maturity Profile (V1.2)by All Reporting Organizations

100

11.0%

2.0%

40.0%37.0%

1.0%

9.0%

Page 7: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 7© 2007 by Carnegie Mellon University

Based on organizations reporting an organization category

Reporting Organization Categories

0 200 400 600 800 1000 1200 1400 1600 1800

Military/Government Agency

Contractor forMilitary/Government

Commercial/In-house

Number of Organizations

24.5%

70.7%

2131

4.4%

Page 8: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 8© 2007 by Carnegie Mellon University

6.9%

1.3%

33.1%

39.6%

4.8%

14.4%

10.1%

2.5%

32.6%

38.0%

2.9%

13.9%

28.4%

2.1%

45.3%

16.8%

1.1%

6.3%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Not Given Initial Managed Defined QuantitativelyManaged

Optimizing

Commercial/In-house = 1512

Contractor for Military/Government = 524

Military/Government Agency = 95

Based on most recent appraisal of organizations reporting an organization category

% O

f Org

aniz

atio

ns W

ithin

Cat

egor

y

Process Maturity Profile by Reporting Organization Categories

2131

Page 9: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 9© 2007 by Carnegie Mellon University

Business Services34.1%

Engineering & Management Services20.2%

Other Services6.8%

Health Services1.7%

Mining0.1%

Wholesale Trade0.3%

Transportation, Communication, Electric, Gas

and Sanitary Services3.0%

Retail Trade0.3%

Finance, Insurance and Real Estate6.3%

Public Administration (Including Defense)

6.1%

Fabricated Metal Products0.3%

Primary Metal Industries0.8%

Industrial Machinery And Equipment

2.0%

Instruments And Related Products

2.8%

Electronic & Other Electric Equipment

9.5%

Transportation Equipment5.1%

Other Manufacturing Industries

0.6%

Based on organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html

Organization TypeBased on Primary Standard Industrial Classification (SIC) Code

Manufacturing21.0%

Services62.8%

1190

Page 10: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 10© 2007 by Carnegie Mellon University

Based on organizations reporting size data

25 or fewer12.0%

101 to 20020.2%

201 to 3009.5%

76 to 1009.0%

51 to 7512.5%

26 to 5014.7%

301 to 5008.5%

501 to 10007.2%

1001 to 20004.1%

2000+2.2%

Organization SizeBased on the total number of employees within the area of the organization that was appraised

1 to 10048.3%

201 to 2000+31.5%

2106

Page 11: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 11© 2007 by Carnegie Mellon University

Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised

8.3% 9.0%

6.1%

10.5

%

10.4

%

8.5%

5.6% 8.

6% 11.5

%

8.5%

2.0%

1.0% 1.5%

0.5% 1.4% 3.

5%

1.1%

1.3% 3.

4%

70.8

%

42.6

%

38.3

%

25.8

%

27.8

%

27.0

%

22.3

%

15.9

%

4.6%

4.3%

17.0

%

43.2

%

42.8

%

48.4

%

41.4

%

40.0

%

41.9

%

29.8

% 33.3

%

40.4

%

0.8% 1.3% 3.

8% 4.2% 4.9% 6.0% 6.7% 9.

3%

3.4%

1.2% 2.

9%

7.6% 10

.5% 14

.1%

15.0

%

22.3

%

35.1

%

43.7

%

42.6

%4.

3%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+

Not Given Initial Managed Defined Quantitatively Managed Optimizing

Based on organizations reporting size data2106

% o

f Org

aniz

atio

ns b

y S

ize

Page 12: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 12© 2007 by Carnegie Mellon University

Disciplines Selected for Appraisals (V1.1)

0

100

200

300

400

500

600

700

800

900

1000

1100

1200

1300

1400

SE/S

W

SW SE/S

W/S

S

SE/S

W/IP

PD

/SS

SE SE/S

W/IP

PD

SW

/SS

SW

/IPPD

SE/S

S

SW

/IPPD

/SS

SE/IP

PD

/SS

46.5%

Based on appraisals reporting discipline data2,364

SE = System Engineering SW = Software EngineeringIPPD = Integrated Product and

Process Development SS = Supplier Sourcing

Num

ber

of A

ppra

isal

s

For more information about Allowable Models & Combinations, visit: http://www.sei.cmu.edu/cmmi/background/aspec.html

50.9%

37.4%

3.4% 3.3% 2.0%1.3% 0.9% 0.7% 0.2% 0.1% 0.1%

Page 13: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 13© 2007 by Carnegie Mellon University

Countries where Appraisals have been Performed and Reported to the SEI

Red country name: New additions with this reporting

Argentina Australia Austria Bahrain Belarus Belgium Brazil BulgariaCanada Chile China Colombia Costa Rica Czech Republic Denmark Dominican RepublicEgypt Finland France Germany Hong Kong India Indonesia IrelandIsrael Italy Japan Korea, Republic Of Latvia Malaysia Mauritius MexicoMorocco Netherlands New Zealand Pakistan Peru Philippines Poland PortugalRomania Russia Singapore Slovakia South Africa Spain Sweden SwitzerlandTaiwan Thailand Turkey United Kingdom Ukraine United Arab Emirates United States UruguayViet Nam

Page 14: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 14© 2007 by Carnegie Mellon University

Based on USA organizations and Non-USA organizations reporting an organization category

USA and Non-USAReporting Organization Categories

12

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Military/GovernmentAgency

Contractor forMilitary/Government

Commercial/In-house

% of Organizations

USA: 100% = 704

Non-USA: 100% = 1427

1427

114

1289

71

410

223

704

24

Page 15: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 15© 2007 by Carnegie Mellon University

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Not Given Initial Managed Defined QuantitativelyManaged

Optimizing

USA: 100 % = 704

Non-USA: 100 % = 1436

Based on USA organizations and Non-USA organizations

% o

f Org

aniz

atio

ns

Maturity Profile by All Reporting USA and Non-USA Organizations

109

1436

236

10

78

7920

458

580

80

219

257

14

704

Page 16: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 16© 2007 by Carnegie Mellon University

Number of Appraisals and Maturity LevelsReported to the SEI by Country

CountryNumber of Appraisals

Maturity Level 1

Reported

Maturity Level 2

Reported

Maturity Level 3

Reported

Maturity Level 4

Reported

Maturity Level 5

Reported CountryNumber of Appraisals

Maturity Level 1

Reported

Maturity Level 2

Reported

Maturity Level 3

Reported

Maturity Level 4

Reported

Maturity Level 5

Reported

Argentina 26 No Yes Yes Yes Yes Malaysia 29 No Yes Yes No YesAustralia 26 Yes Yes Yes Yes Yes Mauritius 10 or fewerAustria 10 or fewer Mexico 29 Yes Yes Yes Yes YesBahrain 10 or fewer Morocco 10 or fewerBelarus 10 or fewer Netherlands 10 or fewerBelgium 10 or fewer New Zealand 10 or fewerBrazil 58 No Yes Yes Yes Yes Pakistan 10 or fewerBulgaria 10 or fewer Peru 10 or fewerCanada 38 No Yes Yes Yes Yes Philippines 17 No Yes Yes No YesChile 17 No Yes Yes No Yes Poland 10 or fewerChina 321 Yes Yes Yes Yes Yes Portugal 10 or fewerColombia 16 No Yes Yes Yes Yes Romania 10 or fewerCosta Rica 10 or fewer Russia 10 or fewerCzech Republic 10 or fewer Singapore 10Denmark 10 or fewer Slovakia 10 or fewerDominican Republic 10 or fewer South Africa 10 or fewerEgypt 25 No Yes Yes Yes Yes Spain 55 No Yes Yes Yes YesFinland 10 or fewer Sweden 10 or fewerFrance 94 Yes Yes Yes Yes Yes Switzerland 10 or fewerGermany 41 Yes Yes Yes Yes Yes Taiwan 71 No Yes Yes No YesHong Kong 10 Thailand 10 or fewerIndia 256 No Yes Yes Yes Yes Turkey 10 or fewerIndonesia 10 or fewer Ukraine 10 or fewerIreland 10 or fewer United Arab Emirates10 or fewerIsrael 12 No Yes Yes No Yes United Kingdom 57 Yes Yes Yes Yes YesItaly 12 No Yes Yes No No United States 859 Yes Yes Yes Yes YesJapan 197 Yes Yes Yes Yes Yes Uruguay 10 or fewerKorea, Republic Of 87 Yes Yes Yes Yes Yes Viet Nam 10 or fewerLatvia 10 or fewer

Page 17: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 17© 2007 by Carnegie Mellon University

Based on appraisals reporting a maturity level 1 rating

Process Area Profiles - 1Organizations Appraised at Maturity Level 1

% of Appraisals

59

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

REQM

PP

PMC

SAM

MA

PPQA

CM

RD

TS

PI

VER

VAL

OPF

OPD

OT

IPM

RSKM

ISM

DAR

OPP

QPM

OID

CAR

Fully Satisfied

Rated

Managed

Defined

QuantitativelyManaged

Optimizing

Page 18: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 18© 2007 by Carnegie Mellon University

Quantitatively Managed

Defined

Based on appraisals reporting a maturity level 2 rating

Process Area Profiles - 2Organizations Appraised at Maturity Level 2

822

% of Appraisals

0% 5% 10% 15% 20%

RD

TS

PI

Ver

Val

OPF

OPD

OT

IPM

RSKM

IT

ISM

DAR

OEI

QPM

OPP

Fully Satisfied

Rated

Page 19: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 19© 2007 by Carnegie Mellon University

Summary

2464 appraisals have been reported to the SEI in 64 months

Organization Category Commercial/In-house reports most of the appraisals

The highest percentage of Commercial/In-house reporting appraisals is from outside the USA

The highest percentage of Military/Government Agency /reporting appraisals is from the USA

Outside the USA: China, India, Spain, France and Malaysia reporting appraisals are increasing at a rapid rate

Additional information and charts will be added to this briefingas more appraisals are reported and more data is available to support the breakdowns

Page 20: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 20© 2007 by Carnegie Mellon University

Terms Used in this Report

Company - Parent of the appraised entityA company can be a commercial or non-commercial firm, for-profit or not for-profit business, a research and development unit, a higher education unit, a government agency, or branch of service, etc.

Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc.

Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States.

Page 21: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 21© 2007 by Carnegie Mellon University

Report your Appraisal Results to the SEI

The briefing is only possible due to the cooperation of organizations and individuals sending in their appraisal results to the SEI

In order to provide this information and service in the future, it will depend on this continued cooperation

Please visit:

http://www.sei.cmu.edu/appraisal-program/profile/index.html

for forms, information, and instructions on how to report appraisals to the SEI

Page 22: Carnegie Mellon CMMI Software Engineering …...The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense

Software Engineering InstituteCarnegie Mellon

CMMI® v1.1/V1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

September 2007 Process Maturity Profile - Page 22© 2007 by Carnegie Mellon University

Contact InformationPlease visit:

http://www.sei.cmu.edu/appraisal-program/profile/index.html

and review the information provided before contacting:

SEI Customer Relations (412) 268-5800SEI FAX number (412) 268-5758

Internet [email protected]

Mailing AddressCustomer RelationsSoftware Engineering InstituteCarnegie Mellon UniversityPittsburgh, PA 15213-3890