october 20-24, 1996, tysons corner, virginia · 8th annual cost schedule performance management...
TRANSCRIPT
8th Annual Cost Schedule Performance Management Conference
October 20-24, 1996, Tysons Corner, Virginia
Conference Workshop Recommendations and Conclusions. (Added 6 Feb 97)
Gary Christle's Paper "Where Are We Going? How Do We Get There?" (Added 6 Nov 96)
Wayne Abba's Paper "OUSD(A&T) Initiatives Update" (Added 6 Nov 96)
Wayne Abba's Paper "The International Environment" (Added 6 Nov 96)
Sam Araki's Keynote Presentation on EV Management in Lockheed Martin is available fordownloading as a MS Powerpoint file. (Updated 20 Nov 96)
Linda Reiners' Presentation on reengineering EV Management in Lockheed Martin is availablefor downloading as a MS Powerpoint file. (Added 20 Nov 96)
Dr. Kelman's Keynote presentation was off the cuff, so no material is available.
1 of 1 06/20/2002 7:44 AM
1996 Cost Schedule Performance Management Conference http://www.acq.osd.mil/pm/paperpres/1096conf.htm
REPORT DOCUMENTATION PAGE Form Approved OMB No.0704-0188
Public reporting burder for this collection of information is estibated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completingand reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burder to Department of Defense, WashingtonHeadquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision oflaw, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS.
1. REPORT DATE (DD-MM-YYYY)20-10-1996
2. REPORT TYPEConference presentations and papers
3. DATES COVERED (FROM - TO)20-10-1996 to 24-10-1996
4. TITLE AND SUBTITLE8th Annual Cost Schedule Performance Management ConferenceUnclassified
5a. CONTRACT NUMBER5b. GRANT NUMBER5c. PROGRAM ELEMENT NUMBER
6. AUTHOR(S) 5d. PROJECT NUMBER5e. TASK NUMBER5f. WORK UNIT NUMBER
7. PERFORMING ORGANIZATION NAME AND ADDRESSOUSD(A&T)xxxxxxxxxx, xxxxxxx
8. PERFORMING ORGANIZATION REPORTNUMBER
9. SPONSORING/MONITORING AGENCY NAME AND ADDRESSOUSD(A&T),
10. SPONSOR/MONITOR'S ACRONYM(S)11. SPONSOR/MONITOR'S REPORTNUMBER(S)
12. DISTRIBUTION/AVAILABILITY STATEMENTAPUBLIC RELEASE,13. SUPPLEMENTARY NOTES14. ABSTRACTSee Report.15. SUBJECT TERMS16. SECURITY CLASSIFICATION OF: 17. LIMITATION
OF ABSTRACTPublic Release
18.NUMBEROF PAGES98
19. NAME OF RESPONSIBLE PERSONhttp://www.acq.osd.mil/pm/paperpres/1096conf.htm,(blank)[email protected]
a. REPORTUnclassified
b. ABSTRACTUnclassified
c. THIS PAGEUnclassified
19b. TELEPHONE NUMBERInternational Area CodeArea Code Telephone Number703767-9007DSN427-9007
Standard Form 298 (Rev. 8-98)Prescribed by ANSI Std Z39.18
OUSD(A&T) InitiativesUpdate
Wayne Abba
8th Annual International Cost SchedulePerformance Management Conference
October 27, 1996
OSD Initiatives
l MIL-HDBK-881 “Work BreakdownStructures Handbook”
l Electronic Data Interchangel Contractor Cost Data Reportingl Project Management Toolsl Earned Value Ownership
» Department of Defense» Industry
MIL-HDBK-881: Background
l Specs & Stds cancelled June 1994l Defense Stds Improvement Council-
December 1994» Approved retaining MIL-STD-881B» Until replaced by a guidance document
l Support contractor named in 1995
MIL-HDBK-881: Status
l Cited in DoD Regulation 5000.2-R» “Bridge Policy” in Deskbook» MIL-STD-881B remains in effect
l September 1996 Handbook Draft» Mandatory for Program WBS» Guidance for Contract WBS
l Coordinate in near future
Electronic Data Interchange:Background
l EDI is Federal Government policyl Implications seen by DoD in late 80’s
» Worked with NSIA» Formed working group» Incorporated in Performance Analyzer» USD(A&T) Policy Memo Jan. 95
– Mandatory for new contracts (CPR or C/SSR)– Incorporated in Data Item Descriptions
Electronic Data Interchange:Status
l Successful early implementation» Shipyards» V-22 at Boeing Helicopters» Encourage contractor participation
l Implementation Conventions» 839 (Cost), 806 (Schedule), 196 (CCDR)
l “Getting Started” Handbook issued
Contractor Cost DataReporting: Background
l CCDRs a problem-» 1991 DoD/Industry TQM Report» DoDIG Report» 1991-94 OSD RFP reviews
l Excessive WBS definition» “WBS vs. IPT”
l Too many reports, too much detail
Contractor Cost DataReporting: Status
l Study by Institute for Defense Analysesl Requirement reaffirmed after review
» USD(A&T), SAEs, DUSD(AR), D(PA&E)
l USD(A&T) Policy Memo Jan. 18, 1996» Fewer reports in less detail and less often» Central office for oversight» IPTs involve contractors when appropriate
Contractor Cost DataReporting: Status Cont’d
l OSD PA&E “high priority;” encouragesinquiries from anyone
l Points of contact-» Mr. Gary Bliss (703) 695-4348» Mr. Tom Coonce (703) 697-0374
Project Management Tools
l Risk management» IDA study--Risk Analysis & Cost Mgmt.
l NAVAIR initiatives» PEO(A) and PEO(T)» In-house Earned Value» IBR process» Integrated Technical Performance
l Performance Analyzer & COTS software
DoD Earned Value Ownership:Background
l Briefed Mr. Longuemare January 1994l SAE meeting September 1994l Executive Steering Group namedl Dr. Kaminski letters January 1995
» Support 1993 “Model Program” initiative» SAEs: Take ownership» Industry: Accept responsibility» DoD: Encourage value-added changes
DoD Earned Value Ownership:Background Cont’d
l C/SCSC reaffirmed» USD(A&T): “Tool of choice” Oct. 1995» DoD 5000.2-R issued March 15, 1996
l USD(A&T) Dec. 1995 Memorandum» Change C/SCSC implementation structure
from PMJEG to DCMC Executive– Simplify review & acceptance process– Encourage responsible, timely innovation
DoD Earned Value Ownership:Status
l SAEs took ownership in 1994l June 1996 SAE meeting with USD(A&T)
» Strongly endorsed reforms, especially theIntegrated Baseline Review process
» Air Force proposed assigning C/SCSC“compliance responsibility” to DCMC
» DCMC agreed to accept responsibility
DoD Earned Value Ownership:Status Cont’d
l 3 alternatives offered to USD(A&T):(1) Transfer compliance and 1 billet per
Service(2) Transfer compliance without billets; API
to provide for budget adjustments(3) Do not transfer compliance
l All Services concurred with Alt. 2l USD(A&T) signed Memo Oct. 1, 1996
Compliance ResponsibilityMemorandum
l DCMC assume responsibility as soon aspossible, not later than end FY 1997
l Dir, API take necessary budget actionsl Emphasize data integrity for PMsl Applies to C/SCSC compliance reviews
» Not to IBRs and related PM support» Components implement earned value» DCMC improve support to program offices
Whose Idea Was This?
l The idea is not new-» Recommended by DoDIG in 1993 report» OSD did not agree» DoDIG agreed to forbear
l So why is it OK now?» Earned Value accepted throughout DoD» DCMC ready to take it on
– “Center of Excellence”
Industry Earned ValueOwnership: Background
l Long history with NSIA» ADL Study» TQM Study
l Mr. Longuemare Sep. 94 letter to NSIA» Offered partnership for industry standard» Possible ISO 9000 approach
l 1st meeting in Phoenix, April 18, 1995
Industry Earned ValueOwnership: Status
l Industry accepting responsibility» Boeing Defense & Space Group» Lockheed Martin Missiles & Space» McDonnell Douglas» Northrop Grumman» General Electric Aircraft Engines» and many more...
Industry Earned ValueOwnership: Status
l Industry standard issued Aug. 96» Signed by AIA, EIA, NSIA, ASA, SCA
l Ball belongs to industry» DoD will borrow it for 5000.2-R
l OSD role is to protect public interest» 5000.2-R, DFARS clauses, guidance being
revised» Workshops to identify & address issues
DRAFT Policy Memorandum
l Adopts 32 EVMS guidelines asimmediate replacement for 35 C/SCSC» New 5000.2-R baseline requirement
l Reserves right for appropriate reviews» As determined by DCMC and/or DoD PM» Does not accept self-certification
l Encourages evolution to “true” standard» Industry (ANSI) and/or International (ISO)
Evolution of EVMS
1967 1989 1993 1996
C/SCSC(COMPTROLLER)DO
D
I
ND
US
TR
Y/
CO
NT
RA
CT
S
IN
TE
RN
AT
ION
AL
C/SCSC EVMS(PROGRAM MANAGEMENT)
MODELPROGRAMVISION
EVMSINDUSTRYSTANDARD
Conceptual Models
l Reconciling government andcommercial practices
l “Who certifies?”
Government/CommercialPractices
3 LEVELS:
• “Core”• “Enterprise”• “Public Sector”
“Industry Standard Guidelines for EVMS” suggests there are no major differences in the principles that shouldbe used for management of complex projects in governmentand industry. We should shift our attention to the practices.
C/SCSC
EVMS
EVMS
DoDContracts
OtherGov’t
Commercial
Reconciled Practices
Who Certifies?3 Possible Scenarios
1) Rely on 3rd party and/or industry certification
WorldClass
Suppliers
ISO10006
Self-Cert DoD
BusinessBase
BS6079
Who Certifies?3 Possible Scenarios--Cont’d
2) Grant DoD Certification (Status quo)
WorldClass
Suppliers
DoDBusiness
Base
DoDCertification
Who Certifies?3 Possible Scenarios--Cont’d
3) Include 3rd party, industry, and/or DoD EVMS at time of each acquisition
WorldClass
Suppliers
DoDBusiness
Base
Source SelectionCriteria- BS 6079- ISO 10006- DoD EVMS- Self-Cert.- Other?
“You hold the key…”
Reaching New Dimensions InPerformance Management
Where Are We Going?How Do We Get There?
DoD Integrated Program Management Initiative
Executive Steering GroupOctober 28, 1996
C/SCSC IS DEAD
Long Live
Earned Value
Transfer ofCompliance Responsibility for C/SCSC
l SAE/DAE meeting June 11,1996n Integrated Program Management Initiative
l Growing acceptance of earned valuen Declining review activity
– Need to ensure a minimal core of expertise
l Approved October 1, 1996n Effective ASAPn NLT September 30, 1997
Transfer ofCompliance Responsibility for C/SCSC
l Each Component required to:n Implement earned value effectively on
contracts;n Ensure management systems reviews are
requested when necessary;n Ensure DCMC is supported with
appropriate program office and functionalpersonnel when reviews are required.
Industry Standard Guidelines for EarnedValue Management Systems (EVMS)
l DoD Requests Industry to developstandard, September 1994n ISO 9000 “Model”
l Industry responded with EVMS“Guidelines,” August 19, 1996n NSIA, AIA, EIA, SCA, ASA
Industry Standard Guidelines for EarnedValue Management Systems (EVMS)
l Proposed DoD response:n Adopt EVMS guidelines as replacement for
C/SCSC;n “Self certification” not acceptable;
– Reserve the right to review “for cause”l Break the direct link between contract award and reviews;l Joint surveillance;l Focus on specific identified deficiencies
n Continue evolution toward a true “standard.”– ANSI, ISO, etc.– Big world: BS 6079; ISO 10006
The Proposed Processes
Contract Award
Did theypropose to
self-certify?
Implement system &conduct self-evaluation
Acceptable toGovernment?
AdvanceAgreement/ Letter
of Acceptance
Self-Certificationcomplete
Yes
Yes
GovernmentReview &Validation
Yes
No
No
Did they proposeThird Party
Certification?
Yes
No
Obtain 3rd PartyCertification
Surveillance
Previous LOA, AAor 3 rd PartyCertification?
No
1
2
34
56
7
8
9
10
11
Contactordevelops system
change
Notify Governmentof changes
Implementchanges
Advise Ktr ofproblems
Are problemsfixed?
No
Terminate AA & takecontractual remedies
Yes
Compliantwith Criteria?
No
Yes
Return toAcceptance
Process
RoutineSurveillance
FocusedSurveillance
Review
Reviewfindingscleared?
Yes
No
1
4
5
7
6
8
9
10
11
12
13
ACO changewaiver?
Yes
Submit changefor approval
2 week
lag
23
No
Determine magnitudeof problem (FocusedSurveillance Review )
Advise Ktr ofproblems
Are problemsfixed?
No
Terminate AdvanceAgreement and takecontractual remedies
Yes
IBR PM ConcernsRoutine
Surveillance
Apparent SystemProblems
Compliantwith Criteria?
No
YesResume routine
Surveillance
1 2 3
4
5
6
7
8
9
10
FIGURE 3-1 SURVEILLANCE PROCESS
AWARD SURVEILLANCE CHANGES
System Reviews
l For contractors with current Letter ofAcceptance, Advance Agreement, or “3rdparty” certification, only two ways totrigger a review:n Surveillance
– IBR– PM– Plant rep
n System change
l Today’s process OR the proposedprocess!!
So What is the Big Problem?
l Contract clause requires prior approvalof system changes!
l Proposed process allows ACO waiver ofprior approval.
Work Shop Focus
l The surveillance process.
l Considerations in determining waiver ofprior change approval.n If EVMS is a real “standard,” it should be
plant-wide.
USD(A&T) DirectionJuly 9, 1996
l Expand Integrated Project Management InitiativeExecutive Steering Group to include otherDefense and non-Defense agencies;
l Establish metrics;
l Priority emphasis on EDI to include relationship toCALS/CITIS; implications of “on-line” access;
l Develop and implement a plan of action that willlead to the availability of tools to better integratecost, schedule, technical performance, and riskmanagement.
M0435K60011
LMMS
Earned ValueEarned ValueManagementManagement
8th Annual International8th Annual InternationalCost/ScheduleCost/Schedule
Performance ConferencePerformance Conference
27-31 October 1996
M0435K60021
Lockheed ExecutiveLockheed ExecutiveCommitmentCommitment LMMS
“The use of earned value management process . . . evenwhere no contractual requirement exists. I intend toexpand this practice and to make earned value the basisfor management of all our efforts.”
“Our programs must continue to improve theirperformance management practices and skills and we mustintensify efforts to eliminate activities that do not add valueto the program management process.”
Sam Araki Lockheed Martin Missiles & Space
M0435K60031
EVM InitiativeEVM Initiative LMMS
August, 1995 Sam Araki formed the EVMAugust, 1995 Sam Araki formed the EVMTask Force with the following objective:Task Force with the following objective:
Extend to all enterprise activities a costcosteffective, effective, earned value system thatsatisfies minimal requirementsminimal requirements consistentwith prudent business practice andessential to both the intent of C/SCSCintent of C/SCSC andbest commercial practicecommercial practice
M0435K60041
OSD CommitmentOSD Commitment LMMS
Unprecedented SupportUnprecedented Support
“Task Force activities will not prejudice recognitionby the Department of Defense of the Lockheed MartinSunnyvale Performance management System as compliantwith Cost/Schedule Control Systems Criteria (C/SCSC).”
“The commendable initiative shown by Lockheed Martin,Sunnyvale and by DPRO is consistent with the objectives ofAcquisition Reform, and provides an opportunity to minimizeor eliminate differences between military and commercialmanagement requirements.”
Dr. P. G. Kaminski,Under Secretary of Defense,(Acquisition and Technology)
M0435K60051
EVM Task ForceEVM Task Force LMMS
Implementation Team
Exec. Task Force
Steering Committee• LMMS and DCMCExec. Mgmt
• Cross FunctionalTeam
LMMS Office of the PresidentDCMC Commander
Key Program Vice PresidentsDivision Directors of Business OpsDCMC Deputy Commander
• Business, DCMC,and ProgramSenior Mgmt
Task Force ManagerDCMC C/SCSC Focal PointProgram RepsProcess RepsInformation Systems RepsFunctional Reps
M0435K60061
DCMC’s EpectationsDCMC’s Epectations LMMS
• Government and company program managerownership of EVM
• Standardization of EVM process across theenterprise
• Cost effective and meaningful joint surveillance• Eliminate non-value-added activities associated
with EVM
M0435K60071
Perform a RequirementPerform a RequirementAnalysisAnalysis LMMS
Identify and remove impedimentsIdentify and remove impediments
Top DownTop Down
Criteria
“Guidance”
Company
Folklore
Sound principlesSome clarification and redundancyWhite Paper
Rewrite I/PExpected outcome good
Rewrite for all programsIntegrate with othersystems - WEB
Get the message out,retrain!!!
• Professionalinterpretersdeveloped
• Lack of real“user”involvement
• Mistakesgeneratedrules
• Professionalinterpretersdeveloped
• Lack of real“user”involvement
• Mistakesgeneratedrules
M0435K60081
Pilot ProgramPilot Program LMMS
Benchmark - IRIDIUM®
Pilot - Milstar Best-DemonstratedPractices
Process ChangeFlow
Process ChangeFlow
Program Implementations
M0435K60091
EVM Change StatusEVM Change Status LMMS
Process changes resulted from commercial benchmarking andbest demonstrated practices
Process changes resulted from commercial benchmarking andbest demonstrated practices
EAC Triggers
Variance Analysis
Work Authorization
Baseline Management
Consistent OBS/WBS
Level of CAM
Business Support Role
Process Change CandidatesProcess Change Candidates
EV Technique
Streamlined Material EV
Use of Metrics
Meetings/Information
COTS
Surveillance
EDI
M0435K60101
Eliminate Non-Value-AddedEliminate Non-Value-AddedActivityActivity LMMS
Coopers & Coopers & Lybrand Lybrand Study Study
VarianceAnalysis
AnnualEAC
WorkAuth
1,000
2,000
3,000
4,000
6,000
7,000
5,000
Annual estimated uniquepieces of paper generatedbefore and after processchange for single program
• C/SCSC 3rd-highestregulatory cost driver
• Two-thirds effortassociated withpushing paper
Paper Generated Pre-EVM Chg
Paper Generated Post-EVM Chg
Capitalize on internal program management processCapitalize on internal program management process
M0435K60111
Use the “Real Info”Use the “Real Info” LMMS
LMMS ActionLMMS Action
• Eliminate costaccount variancereports
• Develop standardstatus reviewcharts for teamswith graphics
• Encouragecustomerparticipation onIPTs
IPT StatusMeeting
Total Float +15CV (100)SV 75SPI 1.02CPI .95
I’ve gotto getthese
varianceanalysisreportswritten
“Beans RUs”
••
••
•
M0435K60121
The Value of JudgmentThe Value of Judgment LMMS
Substitute Analysis For Arbitrary RulesSubstitute Analysis For Arbitrary Rules
“All Traffic Must Stop”
OR“Yield”
Focus on the Message Driver’s Intent
LMMS ActionsLMMS ActionsEAC triggers SPI CPI TCPI Risk
Replacethresholds withsignificantindicators
– Risk Areas– PDT Concerns– WBS
Use analysisrealtime
M0435K60131
Develop a Quality AssuranceDevelop a Quality AssuranceProgramProgram LMMS
Key Features•Non-interface•Look for trends and significant discrepancies•Replace CAM Interviews with “training” where indicators exist•Focus includes value of information provided
“Contractor Ownership Includes Methods toEvaluate and Ensure the Quality of the EVM System”
•Product
•Process
• Data reviewed by senior management• CPR data analysis• Independent EAC analysis• Program reviews
• Statistical process control approach• Use diagnostics and metrics• Program take responsibility for
generation and response
Monitor
M0435K60141
Teamed for the FutureTeamed for the Future LMMS
Must Break Down Stovepipes for Common ProcessesMust Break Down Stovepipes for Common Processes
• AdoptedThroughoutLMMS
• CorporateHandbook
AirForce
Army Navy NASA
Engr Mfg Test
Vendors
IntegratedProduct Teams
SingleProcesses
• Working w/Gov’t &Industry
• DCMC Key
ILS
Com-mercial
M0435K60151
Combine Surveillance NeedsCombine Surveillance Needs LMMS
Program A
CORLAC
DCMC Local
DCMC District
DCMC Hdqtrs
InternalCompliance
Customer PO DCAA
Customer’sCustomer
Service Focal Pt.
Program A
InternalCompliance
DCMC Local
Customer PO
Teaming Approachto Ongoing
Surveillance
DCAA
Joint SurveillanceTeam
M0435K60161
Benefits to the GovernmentBenefits to the Government LMMS
Potentially adversarial relationships transformed intoproductive partnership – renewed emphasis placed on
importance of cross-functional teaming
Potentially adversarial relationships transformed intoproductive partnership – renewed emphasis placed on
importance of cross-functional teaming
• Public funds are at risk on large cost basedcontracts – a joint Program Office, DCMC, & LMMSprocess will exist to manage resources wisely
• Atmosphere created that capitalizes strengths ofparticipants in surveillance process to developprograms with opportunity of success
• Environment fosters active and constructiveparticipation of DCMC, DCAA, and ProgramOffices with LMMS to develop a sound earnedvalue management strategy
M0435K60171
Contractor BenefitsContractor Benefits LMMS
• The integration of system surveillance, datasurveillance and program surveillance
• Focus on quality and utility of reports• Tailor processes to the way the contractor
naturally manages• Focus on prevention of management system
deficiencies rather than “find and fix”• Conduct government reviews only when
surveillance and reporting indicate systemintegration and discipline deficiencies aredistorting the presentation of program status
M0435K60181
Joint BenefitsJoint Benefits LMMS
• Early teaming yielded end-game success• Developed mutual respect for
government/contractor perspectives• Both parties feel positive about eliminating non-
value added activitiy• Mutually able to attack real issues – avoided
“Committee Fluff”
Gain of Company ownership is a win-win for government andcontractor
Gain of Company ownership is a win-win for government andcontractor
M0436K6001
Sam ArakiRetired PresidentLockheed Martin Missiles & Space
Sam ArakiSam ArakiRetired PresidentRetired PresidentLockheed Martin Missiles & SpaceLockheed Martin Missiles & Space
“Reaching New Dimensions“Reaching New Dimensionsinin
Performance Management”Performance Management”
Earned Value Management (EVM)Earned Value Management (EVM)October 28, 1996October 28, 1996
M0435K60021
Lockheed ExecutiveLockheed ExecutiveCommitmentCommitment LMMS
“The use of earned value management process . . . evenwhere no contractual requirement exists. I intend toexpand this practice and to make earned value the basisfor management of all our efforts.”
“Our programs must continue to improve theirperformance management practices and skills and we mustintensify efforts to eliminate activities that do not add valueto the program management process.”
Sam Araki Lockheed Martin Missiles & Space
M0435K60031
EVM InitiativeEVM Initiative LMMS
August, 1995 Sam Araki formed the EVMAugust, 1995 Sam Araki formed the EVMTask Force with the following objective:Task Force with the following objective:
Extend to all enterprise activities a costcosteffective, effective, earned value system thatsatisfies minimal requirementsminimal requirements consistentwith prudent business practice andessential to both the intent of C/SCSCintent of C/SCSC andbest commercial practicecommercial practice
M0435K60041
OSD CommitmentOSD Commitment LMMS
Unprecedented SupportUnprecedented Support
“Task Force activities will not prejudice recognitionby the Department of Defense of the Lockheed MartinSunnyvale Performance management System as compliantwith Cost/Schedule Control Systems Criteria (C/SCSC).”
“The commendable initiative shown by Lockheed Martin,Sunnyvale and by DPRO is consistent with the objectives ofAcquisition Reform, and provides an opportunity to minimizeor eliminate differences between military and commercialmanagement requirements.”
Dr. P. G. Kaminski,Under Secretary of Defense,(Acquisition and Technology)
M0435K60051
EVM Task ForceEVM Task Force LMMS
Implementation Team
Exec. Task Force
Steering Committee• LMMS and DCMCExec. Mgmt
• Cross FunctionalTeam
LMMS Office of the PresidentDCMC Commander
Key Program Vice PresidentsDivision Directors of Business OpsDCMC Deputy Commander
• Business, DCMC,and ProgramSenior Mgmt
Task Force ManagerDCMC C/SCSC Focal PointProgram RepsProcess RepsInformation Systems RepsFunctional Reps
M0435K60061
DCMC’s EpectationsDCMC’s Epectations LMMS
• Government and company program managerownership of EVM
• Standardization of EVM process across theenterprise
• Cost effective and meaningful joint surveillance• Eliminate non-value-added activities associated
with EVM
M0435K60071
Perform a RequirementPerform a RequirementAnalysisAnalysis LMMS
Identify and remove impedimentsIdentify and remove impediments
Top DownTop Down
Criteria
“Guidance”
Company
Folklore
Sound principlesSome clarification and redundancyWhite Paper
Rewrite I/PExpected outcome good
Rewrite for all programsIntegrate with othersystems - WEB
Get the message out,retrain!!!
• Professionalinterpretersdeveloped
• Lack of real“user”involvement
• Mistakesgeneratedrules
• Professionalinterpretersdeveloped
• Lack of real“user”involvement
• Mistakesgeneratedrules
M0435K60081
Pilot ProgramPilot Program LMMS
Benchmark - IRIDIUM®
Pilot - Milstar Best-DemonstratedPractices
Process ChangeFlow
Process ChangeFlow
Program Implementations
M0435K60091
EVM Change StatusEVM Change Status LMMS
Process changes resulted from commercial benchmarking andbest demonstrated practices
Process changes resulted from commercial benchmarking andbest demonstrated practices
EAC Triggers
Variance Analysis
Work Authorization
Baseline Management
Consistent OBS/WBS
Level of CAM
Business Support Role
Process Change CandidatesProcess Change Candidates
EV Technique
Streamlined Material EV
Use of Metrics
Meetings/Information
COTS
Surveillance
EDI
M0435K60101
Eliminate Non-Value-AddedEliminate Non-Value-AddedActivityActivity LMMS
Coopers & Coopers & Lybrand Lybrand Study Study
VarianceAnalysis
AnnualEAC
WorkAuth
1,000
2,000
3,000
4,000
6,000
7,000
5,000
Annual estimated uniquepieces of paper generatedbefore and after processchange for single program
• C/SCSC 3rd-highestregulatory cost driver
• Two-thirds effortassociated withpushing paper
Paper Generated Pre-EVM Chg
Paper Generated Post-EVM Chg
Capitalize on internal program management processCapitalize on internal program management process
M0435K60111
Use the “Real Info”Use the “Real Info” LMMS
LMMS ActionLMMS Action
• Eliminate costaccount variancereports
• Develop standardstatus reviewcharts for teamswith graphics
• Encouragecustomerparticipation onIPTs
IPT StatusMeeting
Total Float +15CV (100)SV 75SPI 1.02CPI .95
I’ve gotto getthese
varianceanalysisreportswritten
“Beans RUs”
••
••
•
M0435K60121
The Value of JudgmentThe Value of Judgment LMMS
Substitute Analysis For Arbitrary RulesSubstitute Analysis For Arbitrary Rules
“All Traffic Must Stop”
OR“Yield”
Focus on the Message Driver’s Intent
LMMS ActionsLMMS ActionsEAC triggers SPI CPI TCPI Risk
Replacethresholds withsignificantindicators
– Risk Areas– PDT Concerns– WBS
Use analysisrealtime
M0435K60131
Develop a Quality AssuranceDevelop a Quality AssuranceProgramProgram LMMS
Key Features•Non-interface•Look for trends and significant discrepancies•Replace CAM Interviews with “training” where indicators exist•Focus includes value of information provided
“Contractor Ownership Includes Methods toEvaluate and Ensure the Quality of the EVM System”
•Product
•Process
• Data reviewed by senior management• CPR data analysis• Independent EAC analysis• Program reviews
• Statistical process control approach• Use diagnostics and metrics• Program take responsibility for
generation and response
Monitor
M0435K60141
Teamed for the FutureTeamed for the Future LMMS
Must Break Down Stovepipes for Common ProcessesMust Break Down Stovepipes for Common Processes
• AdoptedThroughoutLMMS
• CorporateHandbook
AirForce
Army Navy NASA
Engr Mfg Test
Vendors
IntegratedProduct Teams
SingleProcesses
• Working w/Gov’t &Industry
• DCMC Key
ILS
Com-mercial
M0435K60151
Combine Surveillance NeedsCombine Surveillance Needs LMMS
Program A
CORLAC
DCMC Local
DCMC District
DCMC Hdqtrs
InternalCompliance
Customer PO DCAA
Customer’sCustomer
Service Focal Pt.
Program A
InternalCompliance
DCMC Local
Customer PO
Teaming Approachto Ongoing
Surveillance
DCAA
Joint SurveillanceTeam
M0435K60161
Benefits to the GovernmentBenefits to the Government LMMS
Potentially adversarial relationships transformed intoproductive partnership – renewed emphasis placed on
importance of cross-functional teaming
Potentially adversarial relationships transformed intoproductive partnership – renewed emphasis placed on
importance of cross-functional teaming
• Public funds are at risk on large cost basedcontracts – a joint Program Office, DCMC, & LMMSprocess will exist to manage resources wisely
• Atmosphere created that capitalizes strengths ofparticipants in surveillance process to developprograms with opportunity of success
• Environment fosters active and constructiveparticipation of DCMC, DCAA, and ProgramOffices with LMMS to develop a sound earnedvalue management strategy
M0435K60171
Contractor BenefitsContractor Benefits LMMS
• The integration of system surveillance, datasurveillance and program surveillance
• Focus on quality and utility of reports• Tailor processes to the way the contractor
naturally manages• Focus on prevention of management system
deficiencies rather than “find and fix”• Conduct government reviews only when
surveillance and reporting indicate systemintegration and discipline deficiencies aredistorting the presentation of program status
M0435K60181
Joint BenefitsJoint Benefits LMMS
• Early teaming yielded end-game success• Developed mutual respect for
government/contractor perspectives• Both parties feel positive about eliminating non-
value added activitiy• Mutually able to attack real issues – avoided
“Committee Fluff”
Gain of Company ownership is a win-win for government andcontractor
Gain of Company ownership is a win-win for government andcontractor
M0436K60031
Downsizing – A Reality of the NewDownsizing – A Reality of the NewEnvironmentEnvironment
$B
600
500
400
300
200
100
01980 1982 1984 1986 1988 1990 1992 1994 1996 1998
(Constant FY 1994 Dollars)
Source: DoD budgetNote: DoD is a nonprophet organization
5-Year Defense Plans
Last Reagan PlanFY 1989
Last Bush PlanFY 1993
ClintonFY 1994 Plan
ClintonFY 1995 Plan
Fiscal Year
ActualAppropriations
M0436K60051
Acquisition Reform Leads theAcquisition Reform Leads theWay to the Use of CommercialWay to the Use of CommercialPractice and Products forPractice and Products forDefenseDefense
• Standard Products• A2100 → A2100M
Competitive LMMSCompetitive LMMS
CommercialComponents
• Earned ValueManagement
• ISO 9000• Commercial
Specs• Electronic data
Management• Outsourcing
Initiative
CommercialProcesses
• Mil SpecReplacement
• ContractRequirementsCommonality
CommonProcesses
DoDAcquisition
Reform
Earned Value TimeEarned Value Time
1994 1995 1996J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D
Kaminskiendorsment
Arakideclaration
Other Key DatesC/S DoD Policy - 1996Move to Acquisition - 1989
EVM implementationTeam formed
LMMS EVM Initiative
Customerkickoff
Commercialbenchmarkcomplete Pilot
complete
NOW
Customerfeedback
Systembuy-off
complete
NSIA takes upchallenges todevelop industrystandard
Industrystandard
released forcomment
Industry Standard Development
Industry& JIC
team meet
AcquisitionreformIBR policy
Specs & standardsabolished
Gov’t offer to industry to develop industry standard
DoD Changes
Kaminski announcesCooper & Lybrand
study results
Longmaureletter to SAEs
PMJEGabolihed
responsibilitytransferred to
DCMC
Draft ofJIG version Hreleased
5000 2Rissued
Draft ofJIG version H
updated
M0436K60041
M0436K60061
EVM InitiativeEVM Initiative
August, 1995 Sam Araki formed theAugust, 1995 Sam Araki formed theEVM Task Force with the followingEVM Task Force with the followingobjective:objective:
Extend to all enterprise activities a costcosteffective, effective, earned value system thatsatisfies minimal requirementsminimal requirementsconsistent with prudent businesspractice and essential to both the intentintentof C/SCSCof C/SCSC and best commercialcommercialpracticepractice
M0436K60071
Lockheed ExecutiveLockheed ExecutiveCommitmentCommitment
“The use of earned value management process . . . evenwhere no contractual requirement exists. I intend toexpand this practice and to make earned value the basisfor management of all our efforts.”
“Our programs must continue to improve theirperformance management practices and skills and we mustintensify efforts to eliminate activities that do not add valueto the program management process.”
Sam ArakiPresident, Lockheed Martin Missiles & SpaceAugust 1995
M0436K60081
OSD CommitmentOSD Commitment
Unprecedented SupportUnprecedented Support
“Task Force activities will not prejudice recognitionby the Department of Defense of the Lockheed MartinSunnyvale Performance Management System as compliantwith Cost/Schedule Control Systems Criteria (C/SCSC).”
“The commendable initiative shown by Lockheed Martin,Sunnyvale and by DPRO is consistent with the objectives ofAcquisition Reform, and provides an opportunity to minimizeor eliminate differences between military and commercialmanagement requirements.”
Dr. P. G. Kaminski,Under Secretary of Defense,(Acquisition and Technology)September 1995
M0436K60091
Pilot ProgramPilot Program
Benchmark – IRIDIUM®
Pilot – Milstar Best-DemonstratedPractices
Process ChangeFlow
Process ChangeFlow
Program Implementations
19931993
19951995
19911991
• Imposed a challenge to program team to create a paradigm shiftto achieve shorter cycle time, reduced cost, and higher qualitynever achieved in the space business
• Empowered program team to take the best program managementpractices and eliminate all non-value-added policy, procedures,and work
• Applied special program “Skunkwork” approach (IPT) and SixSigma quality
• Provided the best motivated people, facility equipment and toolsto get the job done
• IRIDIUM® program manager chose to strip down the C/SCSCEarned Value Management tool to manage cost scheduleperformance and achieved excellent program managementresults
• Earned Value Management system developed on IRIDIUM®
became the best commercial practice benchmarkM0436K6010
1
“The IRIDIUM“The IRIDIUM®® Challenge” Challenge”
Would commercial business practicessatisfy our government customers?
Would commercial business practicessatisfy our government customers?
M0436K60111
What are the MinimumWhat are the MinimumRequirements?Requirements?
Premise:Premise:
• If commercial business had no requirements,and
• If management believes they are successfullymanaging those programs, and
• If we are motivated to be cost effective,
• Then commercial business practices are theminimum requirements
• Use Milstar program as a pilot
• Use IRIDIUM® program as a commercial benchmark
• Apply benchmark program practices and concepts topilot
• Analyze results and cost effectiveness
Objective: To demonstrate a government program can besatisfied with current LMMS commercial business practicesObjective: To demonstrate a government program can be
satisfied with current LMMS commercial business practices
M0436K60121
Pilot Program ApproachPilot Program Approach
Identify and remove impedimentsIdentify and remove impediments
M0436K60131
Performed a RequirementsPerformed a RequirementsAnalysisAnalysis
Top DownTop Down
CriteriaCriteria
“Guidance”“Guidance”
CompanyCompany
FolkloreFolklore
Sound principlesSome clarification and redundancyWhite Paper
Rewrite internal proceduresExpected outcome good
Rewrite for all programsintegrate with othersystems – WEB
Get the message out,retrain!!!
• Professionalinterpretersdeveloped
• Lack of real“user”involvement
• Mistakesgeneratedrules
• Professionalinterpretersdeveloped
• Lack of real“user”involvement
• Mistakesgeneratedrules
M0436K60141
Culture ChangeCulture Change
“The Biggest Challenge of All”“The Biggest Challenge of All”
Rigid Control Rigid Control ++
Slow ReactionSlow Reaction
Flexible Control Flexible Control ++
Quick ReactionQuick Reaction
Training is KeyTraining is Key
• •
ConceptConcept
SARSARvsvs
IBRIBR
RefocusRefocus
••
••
OUSDCo. Surv.
DCAADCMC
Customer
Program Manager“Oversight”“Oversight”
••••
••••
••••
•• ••••
“Insight”“Insight”Customer
Program Manager
DCMC
Co. Surv.
M0436K60151
Combine Surveillance NeedsCombine Surveillance Needs
Program AProgram A
CORPCORP
DCMC DCMC LocalLocal
DCMC DCMC DistrictDistrict
DCMCDCMC HdqtrsHdqtrs
InternalInternalComplianceCompliance
Customer POCustomer PO DCAADCAA
Customer’sCustomer’sCustomerCustomer
Service Service Focal PointFocal Point
Program AProgram A
InternalCompliance
DCMCLocal
Customer POCustomer PO
Teaming ApproachTeaming Approachto Ongoingto Ongoing
SurveillanceSurveillance
DCAADCAA
Joint SurveillanceJoint SurveillanceTeamTeam
M0436K60161
Eliminate Non-Value AddedEliminate Non-Value AddedActivityActivity
Coopers andCoopers and Lybrand Lybrand Study Study
VarianceAnalysis
AnnualEAC
WorkAuth
1,000
2,000
3,000
4,000
6,000
7,000
5,000
Annual estimated uniquepieces of paper generatedbefore and after processchange for single program
• C/SCSC 3rd-highestregulatory cost driver
• Two-thirds effortassociated with pushingpaper
Paper Generated Pre-EVM Chg
Paper Generated Post-EVM Chg
M0436K60171
The Value of JudgmentThe Value of JudgmentSubstitute Analysis For Arbitrary RulesSubstitute Analysis For Arbitrary Rules
“All Traffic Must Stop”
OR“Yield”
Focus on the Message Driver’s Intent
LMMS ActionsLMMS ActionsEAC triggers SPI CPI TCPI Risk
Replacethresholds withsignificantindicators
– Risk Areas– PDT Concerns– WBS
Use analysisrealtime
M0436K60181
Teamed For The FutureTeamed For The Future
Must Break Down Stovepipes for Common ProcessesMust Break Down Stovepipes for Common Processes
AirForce
Army Navy NASA
Engr Mfg Test
IntegratedProduct Teams
SingleProcesses
• Working withGovernmentand Industry
• DCMC Key
• AdoptedthroughoutLMMS withcustomers
• Corporatehandbook
ILS
Co
mm
erci
al
Ven
do
rs
M0436K60191
Established Common CoreEstablished Common CoreProcessProcess
Tailor for Fit by Providing aTailor for Fit by Providing aCommon ToolboxCommon Toolbox
Phase out 3 of 4 majormainframe systems
Adding 1 PC-based EVMtool
Down selecting multipleschedule packages
Adding key interfaces
Focus on COT solutions
Use TheUse TheRightRight
Tool ForTool ForThe JobThe Job
One SizeDoes Not
Fit All
Ask yourself WHY are yourprocesses too “unique” to useCOTS
M0436K60201
Developed a Quality AssuranceDeveloped a Quality AssuranceProgramProgram
“Contractor Ownership Includes Methods to“Contractor Ownership Includes Methods toEvaluate and Ensure the Quality of the EVM System”Evaluate and Ensure the Quality of the EVM System”
• Product
• Process
• Data reviewed by senior management• CPR data analysis• Independent EAC analysis• Program reviews
• Statistical process control approach• Use diagnostics and metrics• Program take responsibility for generation
and response
MonitorMonitor
Key FeaturesKey Features• Non-intervention• Look for trends and significant discrepancies• Replace CAM interviews with “training” where indicators exist• Focus includes value of information provided
M0436K60211
Use The “Real Info”Use The “Real Info”
LMMS ActionLMMS Action
• Eliminate costaccount variancereports
• Develop standardstatus reviewcharts for teamswith graphics
• Encouragecustomerparticipation onIPTs
Total Float +15Total Float +15CV (100)SV 75SPI 1.02CPI .95
I’ve gotto getthese
varianceanalysisreportswritten
“Beans R“Beans RUs”Us”
••
Capitalize on internal program management processCapitalize on internal program management process
IPT StatusMeeting•
•
•
• Acquisition reform has been an enabler
• Lockheed Martin Missiles and Space
–Customer/product diversity
–Consolidation managed as a program(EVM)
• EVM summary
–Enterprise commitment
–Get back-to-basics
–Company and program ownership
–Insight vs oversight
–Minimum requirements
–Metric quality assurance program
M0436K60221
EVM ThemesEVM Themes
M0436K60231
One-Year EnlightenmentOne-Year Enlightenment
• Precepts of EV are sound– Implementation was off-track
• Program definition and planning is key ingredient• User friendly mechanism
– Ultimate user involvement– COTS/people/process
• Institutionalize/standardize– EVM
• DoD• Civil• Commercial• Internal jobs
• IPT’s involvement– Realtime progress focus– Management focus not reporting– Insight vs oversight