2011 sep cmmi process maturity report
DESCRIPTION
CMMI® for SCAMPISM Class A Appraisal Results 2011 Mid-Year UpdateTRANSCRIPT
CMMI® for SCAMPISM Cl A A i l R ltSCAMPISM Class A Appraisal Results 2011 Mid-Year Update
Software Engineering InstituteCarnegie Mellon UniversityCarnegie Mellon UniversityPittsburgh, PA 15213
September 2011September 2011
1
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
© 2011 Carnegie Mellon University
Outline
IntroductionCurrent StatusCommunity TrendsOrganizational TrendsSummary and Terms Used in this BriefingSummary and Terms Used in this Briefing
This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes.
The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority” of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only.
2
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Introduction - Purpose
Characterize the adoption of CMMI
Describe results from Standard CMMI Appraisal Method for ProcessDescribe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.2/v1.3 Class A appraisals using Capability Maturity Model® Integration (CMMI v1.2/ v1.3)*
* Organizations previously appraised against CMMI v1.0 /v1.1 and which have not reappraised against v1.2 or v1.3 are not included in this report.
* SVC,ACQ appraisals are included in this report, P-CMM appraisals are not included in this report,
3
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Introduction - Briefing Contents
This briefing includes three primary sections:
1 Current Status1. Current Status• Snapshot of the development community based on the most recent
appraisals, since SCAMPI V 1.2 release, of reporting organizations
2. Community Trends • Global distribution of appraisals
G th i th b f i l f d• Growth in the number of appraisals performed
• Shifts in the maturity profile over time
3 Organizational Trends3. Organizational Trends• Time to move up in maturity based on change in maturity level and time
between appraisals
4
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Process Maturity Profile by All Reporting Organizationsby All Reporting Organizations
3200
3400
3600
2400
2600
2800
3000
atio
ns
65.4%
1400
1600
1800
2000
2200
r of O
rgan
iza
600
800
1000
1200
1400
Num
ber
23.4%
0
200
400
Not Given Initial Managed Defined Quantitatively Managed
Optimizing
4.0%0.5% 1.6%
5.1%
5
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on most recent appraisal of organizations4220
Process Maturity Profile (SVC Only)by All Reporting Organizationsby All Reporting Organizations
50
40
niza
tions
20
30
ber o
f Org
an
42.9%
51.0%
10
20
Num
b
0Not Given Managed Defined
6.1%
6
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on most recent appraisal of organizations49
Reporting Organization Categories
Commercial/In-house 80.5%
Contractor for Military/Government 15.8%
Military/Government Agency 3.7%
0 1000 2000 3000 4000 5000
Number of Organizations
7
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
gBased on organizations reporting an organization category4220
Process Maturity Profile by Reporting Organization Categoriesby Reporting Organization Categories
90%
100%
C i l/I h 3356
70%
80%
90% Commercial/In-house = 3356
Contractor for Military/Government = 659
Military/Government Agency = 153
n C
ateg
ory
61.7%58.3%
43.1%39.9%
40%
50%
60%
atio
ns W
ithi
20.4%
27.6%
15.7%20%
30%
40%
% o
f Org
aniz
a
3.5%0.4% 1.9%
4.6%2.9%
0.2% 0.3%
5.8%
0.7% 1.3% 2.6%
0%
10%
Not Given Initial Managed Defined Quantitatively Managed
Optimizing
%
8
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on most recent appraisal of organizations reporting an organization category4168
Organization SizeBased on the total number of employees within the area of the organization that was appraisedBased on the total number of employees within the area of the organization that was appraised
501 to 10004 0%
1001 to 20001.9%
2000+1 6%
25 or fewer20.3%
301 to 5005.4%
4.0% 1.6%
101 to 20015 1%
201 to 3005.8%
1 to 10066 3%
201 to 2000+18.6%
26 0
15.1% 66.3%
26 to 5025.9%
51 to 7512 6%
76 to 1007.6%
9
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
12.6%Based on organizations reporting size data4197
Organization Size (SVC Only)Based on the total number of employees within the area of the organization that was appraisedBased on the total number of employees within the area of the organization that was appraised
501 to 100012 2%
1001 to 20002.0% 2000+
4.1%
25 f
12.2%
201 to 2000+32.7% 25 or fewer
49.0%301 to 5006.1%
32.7%
101 to 2002.0%
201 to 3008.2%
1 to 10065.3%
26 to 5010.2%
51 to 754.1%
76 to 1002.0%
10
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on organizations reporting size data49
Maturity Profile by Organization SizeBased on the total number of employees within the area of the organization that was appraisedBased on the total number of employees within the area of the organization that was appraised
90%
100%
72.4
%
69.8
%
68.5
%
68.3
%
0.2%
68.1
%
% 61.5
%70%
80%
s by
Siz
e
40.7
%53
.8%
60
57.2 6
54.5
%
39.4
%
40%
50%
60%
Org
aniz
atio
ns
3%
22.5
%
23.1
%
20.2
%
17.2
%
18.0
%
.1% 13.9
%
% 12.8
%
22.3
%
23.1
%
20%
30%
%
% o
f O
4.0%
2.6% 3.2%
2.5% 4.
7% 7.4%
5.3% 6.0%
10.
3.0%
0.6%
0.5%
0.4% 0.9%
0.4%
0.4%
11
5.1%
1.5%
0.4% 1.0% 1.5% 3.
5%
3.0% 4.1%
2.2%
0.6%
1.5%0.6% 1.1% 2.1% 5.
4% 5.8%
9.8% 1
0%
10%
25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+Not Given Initial Managed Defined Quantitatively Managed Optimizing
11
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on organizations reporting size data4197
USA and Non-USAReporting Organization CategoriesReporting Organization Categories
Commercial/In-316
Commercial/Inhouse 3040
Contractor for Military/Government 191
468
Military/Government Agency
USA: 100% = 864
Non-USA: 100% = 3304
73
80
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
% of Organizations
12
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Maturity Profile by All Reporting Organizations in the USAOrganizations in the USA
90%
100%
70%
80%
ons
40%
50%
60%
f Org
aniz
ati
317
453
20%
30%
40%
% o 317
0%
10%
Not Given Initial Managed Defined Quantitatively Managed
Optimizing
561 2
41
13
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
g
Based on organizations in the USA 870
Maturity Profile by All Reporting Organizations based outside the USAOrganizations based outside the USA
90%
100%
70%
80%
atio
ns 2305
40%
50%
60%
of O
rgan
iza
20%
30%
40%
%
672
0%
10%
Not Given Initial Managed Defined Quantitatively Managed
Optimizing
11119 67
176
14
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on organizations outside the USA3350
Section 2—Community Trends
Appraisals are conducted through June 2011 and reported to the SEI by July 2011
• 73 countries reporting appraisals– Most of the appraisals are from Asia and North America.
• 4612 Appraisals posted on PARS– Expired appraisals are removed from PARS and replaced with the newest
reappraisal result.
15
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Countries Where Appraisals Have Been Performed and Reported to the SEIPerformed and Reported to the SEI
Argentina Australia Austria Bahrain Bangladesh Belgium Brazil Brunei DarussalamBulgaria Canada Chile China Colombia Costa Rica Czech Republic DenmarkEgypt Finland France Germany Greece Guatemala Hong Kong HungaryIndia Indonesia Ireland Israel Italy Japan Jordan Korea Republic OfIndia Indonesia Ireland Israel Italy Japan Jordan Korea, Republic OfLatvia Lebanon Lithuania Luxembourg Macedonia Malaysia Mauritius MexicoMorocco Nepal NetherlandsNew Zealand Norway Pakistan Panama ParaguayPeru Philippines Poland Portugal Qatar Romania Russia Saudi ArabiaSingapore Slovakia South AfricaSpain Sri Lanka Sweden Switzerland TaiwanThailand Tunisia Turkey Ukraine United Arab E United Kingdom United States UruguayViet Nam
16
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Viet NamRed country name: New additions with this reporting since March 2011
Number of Appraisals Reported to the SEI by Continentby Continent
3500
4000
2660
2500
3000
3500
ppra
isal
s
1500
2000
500
umbe
r of A
p
580
1244
295500
1000
Nu
54 13
295
0Africa Asia Australia Europe North America South America
Based on appraisals North America includes Canada the USA and Mexico; South America includes Central America and the
4846
17
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
North America includes Canada, the USA, and Mexico; South America includes Central America and the Caribbean ; Australia includes New Zealand
Number of Appraisals and Maturity LevelsReported to the SEI by CountryReported to the SEI by Country
CountryNumber of Appraisals
Maturity Level 1
Reported
Maturity Level 2
Reported
Maturity Level 3
Reported
Maturity Level 4
Reported
Maturity Level 5
Reported CountryNumber of Appraisals
Maturity Level 1
Reported
Maturity Level 2
Reported
Maturity Level 3
Reported
Maturity Level 4
Reported
Maturity Level 5
ReportedArgentina 66 37 23 2 Malaysia 45 8 35 2Australia 11 3 3 Mauritius 10 or fewerAustria 10 or fewer Mexico 95 43 45 1 5Austria 10 or fewer Mexico 95 43 45 1 5Bahrain 10 or fewer Morocco 10 or fewerBangladesh 10 or fewer Nepal 10 or fewerBelgium 10 or fewer Netherlands 11 1 3 6Brazil 125 1 67 48 7 New Zealand 10 or fewerBrunei Darussalam 10 or fewer Norway 10 or fewerBulgaria 10 or fewer Pakistan 24 1 21 1 1Canada 30 1 9 12 3 Panama 10 or fewerChile 33 1 21 10 1 Paraguay 10 or fewerg yChina 1557 63 1409 43 35 Peru 18 10 7Colombia 40 1 15 8 3 5 Philippines 11 1 4 1 4Costa Rica 10 or fewer Poland 10 or fewerCzech Republic 10 or fewer Portugal 16 6 9 1Denmark 10 or fewer Qatar 10 or fewerEgypt 40 1 24 11 1 Romania 10 or fewerFinland 10 or fewer Russia 10 or fewerFrance 111 66 34 1 Saudi Arabia 11 2 6 1 1Germany 55 6 19 16 Singapore 14 4 8 1Greece 10 or fewer Slovakia 10 or fewerGuatemala 10 or fewer South Africa 10 or fewerHong Kong 10 or fewer Spain 186 1 106 62 2 4Hungary 10 or fewer Sri Lanka 15 2 13India 462 12 330 3 108 Sweden 10 or fewer
Indonesia 10 or fewer Switzerland 10 or fewerIreland 10 or fewer Taiwan 98 1 42 50 4Israel 13 7 4 Thailand 38 12 25 1Italy 45 18 23 Tunisia 10 or fewer
Japan 165 7 39 85 6 7 Turkey 22 19 3Jordan 10 or fewer Ukraine 10 or fewerKorea, Republic Of 128 49 59 10 4 United Arab Emirates 10 or fewerLatvia 10 or fewer United Kingdom 74 1 21 26 5Lebanon 10 or fewer United States 1119 5 417 550 3 60Lithuania 10 or fewer Uruguay 10 or fewer
18
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
g yLuxembourg 10 or fewer Viet Nam 17 14 1 2Macedonia 10 or fewer
Number of SCAMPI A Appraisals Reported to SEI by YearSEI by Year
1600
TOTAL 1375
1310 12991200
1400POSTED ON PARs
rais
als
1004
13751349
941
800
1000
mbe
r of A
ppr 1004
509542
400
600
Num 556 551
0
200
2006 2007 2008 2009 2010 2011
11
19
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on appraisals4846
Trends in the Community Maturity Profile
11
90%
100%
2006 11564
151627703,846
63.6
%
8.2%
62.9
%64
.6%
65.4
%
60%
70%
80%20062007200820092010za
tions
4,220
47.9
%58
40%
50%
60% 2011
% o
f Org
aniz
27.3
%31.4
%28
.2%
25.1
%23
.8%
23.4
%
20%
30%
%
9.1%
9.0%
1.2%
1.1%
9.4%
6.1%
0.8% 1.0%
5.7%
4.9%
0.5% 1.3%
5.2%
4.4%
0.4% 1.
6%
5.1%
4.0%
0.5% 1.6% 5.
1%
0%
10%
Not Given Initial Managed Defined Quantitatively ManagedOptimizing
20
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Based on a cumulative view of the most recent appraisals of organizations up through the year indicated
Time to Move Up
40
3025.5
Number of months to move tonext maturity level
75th Percentile
Median
2120 19
25th Percentile
10
Time Period of Initial
5
2006 to Present
1 to 2 2 to 3 3 to 4 3 to 5
7 146 31 40
Time Period of InitialAppraisal
Level
Orgs
21
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Summary -1
Since 2006, 4846 SCAMPI v1.2/1.3 appraisals have been reported to the SEI.
Appraisals report from China, Spain, Brazil, Argentina, and India are increasing at a rapid rate.
More than 66% of appraised organizational units have 100 or fewer employees. The percentage is increasing steadily.
The majority of reported appraisals are maturity level 2 and 3The majority of reported appraisals are maturity level 2 and 3 organizations.
The number of appraisals in the USA and China represent more than 55% f th t t l b f i l55% of the total number of appraisals.
China is now reporting more appraisals than USA
22
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Summary -2
For organizations that began their CMMI-based SCAMPI effort with V1.2 or later, the median time to move from
• maturity level 2 to 3 is 19 months
• maturity level 3 to 4 is 21 months
• maturity level 3 to 5 is 25.5 months
23
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Terms Used in this Report
Company - Parent of the appraised entityA company can be a commercial or non-commercial firm, for-profit or notfor-profit business a research and development unit a higher educationfor-profit business, a research and development unit, a higher educationunit, a government agency, or branch of service, etc.
Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraisedentity can be the entire company, a selected business unit, unitssupporting a particular product line or service, etc.
Non-USA - Appraised entity whose geographic location is not within the United States.The parent of the appraised entity may or may not be based within theUnited States.
PARS - Published Appraisal Results webpage contains CMMI® appraisalspublished at the request of the appraisal sponsor.
The link is: http://sas.sei.cmu.edu/pars/
24
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
Contact Information
SEI Customer Relations (412) 268-5800SEI Customer Relations (412) 268 5800
SEI FAX number (412) 268-5758
Internet Address [email protected]@
Mailing Address Customer RelationsSoftware Engineering InstituteCarnegie Mellon UniversityCarnegie Mellon UniversityPittsburgh, PA 15213-3890
25
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University
NO WARRANTY
THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHED ON AN “AS-IS" BASIS CARNEGIE MELLON UNIVERSITYMATERIAL IS FURNISHED ON AN AS IS BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT.
Use of any trademarks in this presentation is not intended in any way to infringe on the rights of the trademark holderrights of the trademark holder.
This Presentation may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at [email protected].
This work was created in the performance of Federal Government Contract Number FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software Engineering Institute, a federally funded research and development center. TheEngineering Institute, a federally funded research and development center. The Government of the United States has a royalty-free government-purpose license to use, duplicate, or disclose the work, in whole or in part and in any manner, and to have or permit others to do so, for government purposes pursuant to the copyright license under the clause at 252.227-7013.
26
CMMI-SCAMPI v1.2/v1.3 Class A Appraisal ResultsSeptember 2011© 2011 Carnegie Mellon University