army cost review board office mort anvari [email protected]

73
1 Army Cost Review Board Office Mort Anvari [email protected] Steve Loftus [email protected]

Upload: toya

Post on 15-Jan-2016

67 views

Category:

Documents


0 download

DESCRIPTION

Army Cost Review Board Office Mort Anvari [email protected] Steve Loftus [email protected]. Cost Analysis for Non-Costers. Financial Operations. HQ Department of the Army. Secretary of the Army. Chief of Staff, Army. Under Secretary of the Army. Vice Chief of Staff, Army. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

1

Army Cost Review Board OfficeMort Anvari [email protected]

Steve Loftus [email protected]

Page 2: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

2

HQ Department of the ArmyHQ Department of the Army

Financial Management

& Comptroller

Cost & Economics Cost & Economics

Secretary of the Army

Under Secretary of the Army

BudgetFinancial Operations

Chief of Staff, Army

Vice Chief of Staff, Army

Civil WorksAcquisition, Logistics & Technology)

Manpower & Reserve Affairs

Installations & Environment

Assistant Secretaries of the Army

G8

Page 3: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

3

Weapon Systems

Chief,Cost Review

Board

Cost Management

InstallationCosting

UnitMission Costing

DASA,Cost & Economics

Director Acquisition Costing

Cost Policy & Research

C4ISR Costing

DirectorPrograms & Strategy

Page 4: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

4

The CRB Reviews Major Weapon & Information Systems at Their Critical Acquisition Decision Points. All ACAT I Programs & Programs of Special Interest Must Have a Recommended ACP Briefed to the CRB.

• The ASA(FM&C) Formed the Army Cost Review Board to review Cost Estimates for Major Weapon & Information Systems

• Created in Response to the Need for: A Comprehensive Army Cost Position, Acceptable to Acquisition & Financial Management Communities & Supports PPBES

Cost Review Board (CRB)Cost Review Board (CRB)

Assurance Process in Support of Acquisition and PPBES CRB is Cost

Analysis Quality Decisions

PM develops Program OfficeEstimate (POE)

DASA-CE developsIndependent

Cost Estimate

RecommendedACP Briefed toCRB Principles

CRB-WG Reconciles &RecommendsACP to CRB

ASA(FM&C)Approves

ArmyCost Position

• ASARC• OSD• PPBES• APB• CAIV• AOA

Assurance Process in Support of Acquisition and PPBES CRB is Cost

Analysis Quality Decisions

PM develops Program OfficeEstimate (POE)

DASA-CE developsIndependent

Cost Estimate

RecommendedACP Briefed toCRB Principles

CRB-WG Reconciles &RecommendsACP to CRB

ASA(FM&C)Approves

ArmyCost Position

• ASARC• OSD• PPBES• APB• CAIV• AOA

PM develops Program OfficeEstimate (POE)

PM develops Program OfficeEstimate (POE)

DASA-CE developsIndependent

Cost Estimate

RecommendedACP Briefed toCRB Principles

RecommendedACP Briefed toCRB Principles

CRB-WG Reconciles &RecommendsACP to CRB

ASA(FM&C)Approves

ArmyCost Position

• ASARC• OSD• PPBES• APB• CAIV• AOA

Page 5: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

5

Cost Analysis Requirement

BA ConceptExploration

Concept & Technology Development

System Development& Demonstration

Production & Deployment

Pre-SystemsAcquisition

Systems Acquisition(Engineering and Manufacturing

Development, Demonstration, LRIP &Production)

Support

C

Sustainment

ReviewReviewReview

ComponentAdvanced

Development

SystemIntegration

SystemDemo

ProductionReadiness & LRIP

Rate Production &DeploymentN

EW

OLD

ConceptExploration

Program Definition &

Risk Reduction

Engineering & Manufacturing Development

(EMD)

Production, Fielding/

Deployment

MS 0 MS I MS II MS III

Cost Estimates Needed

Page 6: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

6

Cost Estimating Process

Final Document

Data CollectNormalize

EstimateFormulation

Review/ Presentation

DefinitionPlanning

DOCUMENTATION

Page 7: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

7

Develop Cost EstimateStructure and WBS

Data/CERsLCC EstimatesCost Drivers

EstablishGround

Rules andAssumptions

Prepare CostEstimatesfor EachElement

Test TotalSystem

Estimate

Prepare Documentation

EngineeringAnalogy

ParametricsExpert Opinion

ReasonablenessSensitivityAnalysisCost-Risk

Assessment

CompileData Base/

CERs/Models

Cost Analysis Model

Start

Page 8: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

8

Situation

• You have just been tasked to develop a cost estimate, that is, a professional opinion about the cost of an item, a service or a thing.

• Let’s discuss a process for organizing and developing this estimate.

Page 9: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

9

Definition and Planning

• Influences the success of the estimate

• Understanding the requirements and how you approach the process will establish the guidelines and procedures for the estimate.

• Ask lots of questions…They help you understand the requirement.

Page 10: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

10

Questions

• Why is this cost estimate needed?• What decisions are pending on the results of this

estimate?• Will the estimate be briefed and to whom?• Will the results be incorporated into some

document?• What does the recipient expect to have included or

excluded?• What excursions or variations from the baseline

are anticipated?

Page 11: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

11

Questions Continued

• What are the program and funding constraints especially if the program is a Joint Program?

• What are the time constraints for this estimate?• What is the acquisition phase of the program?• Is the program definition mature?• Does technology exist today to design, develop, test

and manufacture the system?• What is the interrelationship with other systems?• Are there previous contracts? How many? What type?• How have the contractors performed to date?

Page 12: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

12

Definition and PlanningKnow Purpose of the Estimate

• Main purposes of estimates:

– Budget Formulation

– Comparative Studies

– Source Selection

Page 13: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

13

Purpose of EstimateBudget Formulation Estimates

• Program Office Estimate (POE)• Component Cost Analysis (CCA)• Independent Cost Estimate (ICE)• What-if exercises• Rough Order of Magnitude (ROM)• Should Cost Estimates• CAIV

Page 14: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

14

Purpose of EstimateComparative Studies Estimates

• Making cost & benefit comparisons between alternatives– Economic Analysis (EA)– Analysis of Alternatives (AoA)– Force Structure– Trade-off Studies– Source Selection– Prioritization

Page 15: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

15

Definition and PlanningDefining the System

• Adequate description of the technical and program characteristics of the system

• What are the physical and performance characteristics?

• What are the development, production, and deployment schedules?

• How many systems are to be produced?• How will the systems be supported: contract, in-

house, two or three levels of maintenance?

Page 16: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

16

ACTIVITY J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D

1993 1994 1995 1996 1997 1998 1999 2000J A S O N D

PROGRAM REVIEWS

ENGINEERING & MANUFACTURING DEVELOPMENT

TEST & EVALUATION

LIVE FIRE TEST

LOG DEMO II

PROD VER TEST

ENHANCED PRODUCIBILITY PROGRAMLOW RATE INITIAL PRODUCTION

FY94

FY95

FY96

MULTIYEAR I & II (3 YR CONTRACT)

FY97

FY98

FY99

FIELDING

LLTI PEO IPR LRIP DECISION MILESTONE III

IOTE

TECH SUPPORT

QLFTT

QUAL

UE

FUE FUEUSMC

MSLS - 3316 741 CLUs - 423 133

MSLS - 1080 194 CLUs - 270 140

MSLS - 1020 141 CLUs - 206 48

MSLS - 1015 CLUs - 108

MSLS - 872 CLUs - 97

MSLS - 698 CLUs - 55

CA CA

CA

CA

CA

LEAD TIME PRODUCTION

PRODUCTION

LEAD TIMELLTI

LD II

LFT (A)(26)

(3)LUT

CA

LEGEND

QL - QUICK LOOK FTT - FIELD TACTICAL TRAINER UE - USER EVALUATION LUT - LIMITED USER TEST CA - CONTRACT AWARD MRRB - MATERIEL RELEASE

REVIEW BOARD

(6)

TODAY

MRRB

PRODUCTION

LFT (B,C) (8,4)

USA

LEAD TIME

LEAD TIME

AWEHANDOFF NTC

PRODUCTION

PVT(25 MSL + 10 CLU)

FT. HOOD

RANGER COMPL

82nd FIELDING BEGINS

82nd COMPLETE

ARMY USMC

LETHALITY ENHANCEMENT

LITE I / WARHEAD / LOW COST BST

DEVELOPMENT

CA MYII

(9)CLU

(28)MSL

II, III, FLIGHTI

Defining the SystemIntegrated System Schedule

Page 17: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

17

Defining the System Work Breakdown Structure (WBS)

• WBS defined in MIL-HDBK-881 as:– product-oriented breakdown of hardware,

software, services, data and facilities that define the system.

• WBS breaks a total job down into manageable pieces & portrays the way work is to be done.

• WBS displays a company’s reporting structure.• Program managers may cite MIL-HDBK-881 “for

guidance only” in contract solicitations.

Page 18: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

18

MIL-Handbook-881 (WBS)

Page 19: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

19

Defining the System Cost Element Structure (CES)

1.0 Research Development Test & Evaluation (RDT&E)

2.0 Production

3.0 Military Construction (MILCON)

4.0 Military Pay and Allowances (MPA)

5.0 Operating and Maintenance Army (OMA)

Page 20: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

20

Defining the System COST ELEMENT STRUCTURE – 1.0 RDT&E

CES# ELEMENT: FY00C$M TY$M1.01 DEV. ENG.

1.02 PEP

1.03 DEV. TOOL.

1.04 PROTO MFG.

1.05 SEPM

1.06 SYS T&E

1.07 TRAINING

1.08 DATA

1.09 SUPP EQUIP.

1.10 DEV. FACILITIES

1.11 OTHER

$ 39.039M $38.260M

0.408 0.386

0.457 0.450

110.421 107.724

78.266 76.363

11.112 10.927

1.989 1.954

3.439 3.413

4.897 4.758

0.0 0.0

0.968 0.928

Page 21: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

21

CES# ELEMENT: FY00C$M TY$M2.01 NON REC PROD. 2.02 REC. PROD 2.03 ENG. CHG2.04 SEPM2.05 SYS T&E2.06 TRAINING2.07 DATA 2.08 SUPP. EQUIP. 2.09 OPER./SITE/ACT. 2.10 FIELDING 2.11 TRAIN. AMMO/MSLS 2.12 WAR RESV. 2.13 MODS 2.14 OTHER

$ 16.110M $ 16.583M 1,169.348 1,312.377 0.0 0.0 116.637 132.258 12.564 14.437 28.880 31.499 2.073 2.300 146.460 158.304 0.0 0.0 89.525 101.635 59.001 79.482 0.0 0.0 236.619 280.729 51.739 64.129

Defining the System COST ELEMENT STRUCTURE – 2.0 PROCUREMENT

Page 22: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

22

CES# ELEMENT: FY00C$M TY$M3.01 DEVELOP. CONSTRUCTION 3.02 PRODUCT. CONSTRUCTION 3.03 OPERATION/SITE ACTIVATION3.04 OTHER MILCON

Defining the System COST ELEMENT STRUCTURE – 3.0 MILCON

Page 23: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

23

CES# ELEMENT: FY00C$M TY$M4.01 CREW 4.02 MAINTENANCE 4.03 SYSTEM SPECIFIC SUPPORT4.04 SEPM4.05 REPLACEMENT PERSONNEL4.06 OTHER MPA

Defining the System COST ELEMENT STRUCTURE – 4.0

Military Pay&Allowances (MPA)

Page 24: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

24

CES# ELEMENT: FY00C$M TY$M5.01 FIELD MAINT., CIV LABOR5.02 SYS. SPECIFIC BASE OPS 5.03 REPLENISHMENT DLRs5.04 REPLEN. CONSUMMABLES5.05 POL5.06 END ITEM MAINTENANCE5.07 TRANSPORTATION 5.08 SOFTWARE5.09 SEPM 5.10 TRAINING

5.11 OTHER OMA

Defining the System COST ELEMENT STRUCTURE – 5.0

Operating & Maintenance Army (OMA)

Page 25: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

25

Defining the System Cost Analysis Requirements Description

(CARD)

• Source of a system’s description• Describes important features• Is provided to other groups preparing cost

estimates• Helps ensure all groups are costing out the same

“program.”• Prepared by program office; approved by

DoD Component Program Executive Officer

Page 26: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

26

Defining the System Cost Analysis Requirements Description

(CARD) Continued1.0 System Overview1.1 System Characterization

1.1.1 System Description1.1.2 System Funcitonal Relationships1.1.3 System Configuration1.1.4 Government Furnished Equipment/Information

1.2 System Characteristics1.2.1 Technical/Physical Description 1.2.1.1 Subsystem Description 1.2.1.2 Functional and Performance Description 1.2.2 Software Description

1.3 System Quality Factors1.3.1 Reliability1.3.2 Maintainability1.3.3 Availability1.3.4 Portability and Transportability1.3.5 Additional Quality Factors

1.4 Embedded Security1.5 Predecessor/Reference System2.0 Risk

Page 27: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

27

Defining the SystemCARD Continued

3.0 System Operational Concept3.1 Organizational Structure3.2 Basing and Deployment Description3.3 Security3.4 Logistics

4.0 Quantity Requirements5.0 System Manpower Requirements6.0 System Activity Rates7.0 System Milestone Schedule8.0 Acquisition Plan or Strategy9.0 System Development Plan

10.0 Element Facilities Requirements11.0 Track to Prior Card12.0 Contractor Cost Data Reporting Plan

Page 28: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

28

Definition and PlanningGround Rules & Assumptions

• State the conditions which must take place in order for the estimate to be valid

• Ground rules and assumptions must be documented since changes in these areas provide an audit trail for changes in the cost estimate.

Page 29: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

29

Data Collection and Analysis

• Collection and analysis represent a significant amount of the overall estimating task in terms of time. The analysis will include decisions on what programs to include in the data set to whether to truncate lot data on a program for which you are calculating a learning curve.

• Document data in your analysis, and any assumptions you make

Page 30: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

30

Data Collection and Analysis

• The direction we take in collecting historical data will be determined by our choice of estimating methodologies.

• This step may also dictate a change in estimating approach due to the availability or non-availability of certain data.

• Data collection is not limited to cost data. We must also collect technical and program data if we want the total picture of the historical systems. This will help us ensure the comparability of the systems that we are collecting data on with the system we are estimating.

Page 31: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

31

Data Collection and Analysis Most Difficult Task in Cost Estimating

• Data Sources– Data Types: Cost/Resource, Technical, Program– Categories: Primary, Secondary

• Data Problems– Wrong Format – Matching up – Definition– Temporal Factors - comparability

• Normalization• Data Location

Page 32: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

32

Army Tools for Total Ownership Cost Estimating

Life Cycle Cost Management Tools

APPN ACEIT PRICE SEER ACDB AMCOS OSMIS SBC/ISR CO$TAT

RDT&E X X X X X X

PROC X X X X X X

MILCON X X X X X

MILPERS X X X X X

O&M X X X X X X X

Page 33: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

33

Definition and PlanningSelect the Estimating Approach

• Techniques available– Analogy– Parametric– Engineering– Extrapolation– Expert OpinionSelect the technique that is most applicable

to a specific WBS element

Page 34: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

34

Definition and PlanningEstimating Methods

• Analogy– Basic Comparison– Factors

• Parametric– Regression Analysis

• Engineering– Detailed

• Expert Opinion– Committee– Delphi

Page 35: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

35

ConceptRefinement

TechnologyDevelopment

System Development& Demonstration

Production &Deployment

Operations& Support

Life Cycle Cost Estimates

• Cost estimates based on confidence intervals• Parametric analysis based on similar systems and similar attributes (regression)• Engineering data based on reliability projections used for bottoms-up estimate• Actual system costs used to extrapolate future system costs• Cost estimate revised every two years after production• Weights associated with non-actuals decrease as system matures• MS B is a true hard stop for systems

A B C D

Cost Estimating Model

Disposal

ParametricEngineeringActuals

xy0

ParametricEngineering

xy0

ParametricEngineering

xy0

ParametricEngineeringActuals

xy0

ParametricEngineering

xy0

ParametricEngineering

xy0

ParametricEngineering

xyz

ParametricEngineering

xyz

ParametricEngineeringActuals

xyz

ParametricEngineering

xyz

ParametricEngineering

xyzActuals

ParametricEngineeringActuals

0yz

ParametricEngineering

Page 36: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

36

Cost Estimating MethodsAnalogy Method

• Based on direct comparison with historical information of similar existing activities, systems, or components.

• Compares new system with one or more existing similar systems where there is accurate cost and technical data.

• Analyst must show validity of comparison.

Page 37: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

37

Cost Estimating MethodsAnalogy Method

• Based on known costs of a similar program• Adjustments for complexity, technical, physical• Strengths

– Based on representative experience– Less time consuming than others– Can be used as a check on other techniques

• Weaknesses– Small sample size– Heavy reliance on judgment– Sometimes difficult to identify analogy and associated

costs

Page 38: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

38

Analogy Estimating with Factors

Element Old Sys1 Old Sys2 Old Sys3 New Sys

Airframe $500/lb $250/lb $750/lb 1.25*S1

Engine 2M/Unit 3M/Unit 5M/Unit .8*S3

Avionics $3K/lb $2K/lb $4K/lb 1.0*S2

Payload 6M/Unit 8M/Unit 7M/Unit .65*S1

Cost(New) = Cost(Old) x Adjustment Factor

Page 39: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

39

Cost Estimating MethodsParametric Method

• Known as Statistical Method or Top Down Method

• Relates cost to physical attributes or performance characteristics

• Uses database of elements from similar systems• Uses multiple systems• Most beneficial in earlier stages of the system or

project life cycle

Page 40: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

40

Cost Estimating MethodsParametric Method

• Statistical relationships between cost and physical or performance parameters of past systems.

• Strengths– Captures major portion of cost– Quick what if type estimates

• Weaknesses– Less detailed– Getting accurate data

Page 41: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

41

Cost Estimating MethodsParametric Method

(Extrapolation)

• Use historical values to establish a trend for the future.

• Example problem: Given the actual productivity and labor rates in the given table. How much will it take to complete a 3-year software development project of 10K lines of code, if 50% is completed in the second year and 25% is completed in first and third years?

Page 42: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

42

Cost Estimating MethodsEngineering Method

• Known as bottom up method• Requires extensive knowledge of system

characteristics• Divide into segments; estimate costs for each

segment• Combine segments plus integration cost• Uses a combination of cost estimating methods• Detailed knowledge of new technologies may not

be available.

Page 43: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

43

Cost Estimating MethodsEngineering Method

• Strengths– Detailed

• Best when long stable production process

• Weaknesses– Requires a lot of time– Cost– Cannot be used until system well defined

Page 44: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

44

Cost Estimating MethodsExpert Opinion Method

• Subjective judgment of an experienced individual or group

• Use if time does not permit a more thorough analysis

• Document source(s) of opinion of experts• List attributes of the source(s) Example: Delphi Technique

Page 45: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

45

Cost Estimating MethodsExpert Opinion Method

• Consulting with one or more experts who use their knowledge and experience to arrive at an estimate

• Group techniques include– Consensus (Committee)– Delphi

• Strengths and weaknesses

Page 46: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

46

Expert Opinion MethodDelphi Technique

• Query expert opinion from group• Seek information from each expert• Summarize the results• Send report to each expert• Gather second opinion after each individual

reviews report• Summarize results• Iterative process continues until the experts reach

a consensus, or near‑consensus.

Page 47: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

47

Expert Opinion Method Example

Labor typeHours Needed

Hourly Rate% of Total Hrs

%*rate

Senior Engineer 1000 $13 10.5 $1.37

Design Engineer 3000 $11 31.6 $3.48

Tool & Die 500 $11 5.3 $.58

Machinist5000 $9 52.6 $4.73

Totals 9500 $10.16

Page 48: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

48

As the quantity of a product produced doubles, the man-hours- per-unit expended to produce the product decreases at a fixed rate or constant percentage (usually 10% to 15%).

Learning Curve Theory

Page 49: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

49

• Job familiarization by both production workers and supervisory personnel.• Changes in product design which do not materially affect the product, but result in increased ease and speed of production.• Changes in tooling, machinery, and equipment which simplify or speed up the production process.• Improved production planning and scheduling, and improvements in production techniques and operational methods.• Improvements in shop organization, engineering coordination and liaison.• Improvements in the handling and flow of materials, and in the materials and parts supply systems

Learning Curve TheoryFactors Contributing to Efficiency

Page 50: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

50

TABLE FOR FIGURESF-1-1 and F-1-2

Unit No. Unit Person-hours

1 100.002 80.004 64.008 51.2016 40.9632 32.7764 26.21

The table is based on the assumption that the first unit required 100 person-hours to produce. The table indicates a constant rate of reduction of 20% for each doubling of the unit number; the value of the second and each succeeding item in the table is 80% of the value of the preceding item.

Learning Curve Theory

Page 51: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

51

80% Unit Curve on Arithmetic Paper

                                                        

        

Learning Curve Theory

Page 52: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

52

Learning Curve Theory

1

10

100

1000

1 10 100 1000 10000

90%

85%

80%

70%

Production Unit Number (LOG)

UnitCost

(LOG)

Page 53: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

53

Learning Curve TheoryUses

– Evaluating contract production costs.– Assessing impact of production interruptions, product

changes and production rate change. – Rate of improvement experienced by a particular contractor

on a prior product may be indicative of rate of improvement expected on new product of similar size, complexity, and construction.

– Improvement curve pattern experienced in the production of past item can be extended to calculate costs of future items.

Page 54: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

54

Estimate Formulation

• We have defined our tasks, planned the estimate, assigned cost responsibilities, and performed data collection and analysis.

• Here we apply our estimating methodologies and tools: develop the factors, analogies, CERs, and learning curves.

• We will aggregate the various cost elements into development, production, and O&S estimates, fiscally spread the costs, and apply inflation.

Page 55: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

55

Cost Estimating MethodsLaying Out the Estimating Approach

Aircraft System – sum of level II elements (cross-check with analogy)Air Vehicle – sum of level III elements

Airframe – CERsAir Vehicle Software – Expert OpinionPropulsion – CERsAvionics – AnalogyArmament – Catalog Price

System Eng/Program Mgt – Factor of Air VehicleSystem Test & Evaluation – Factor of Air VehicleTraining – Factor of Air VehicleData – Factor of Air VehiclePeculiar Support Equipment – Factor of Air VehicleInitial Spares – Factor of Air Vehicle

Page 56: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

56

Review and Presentation

• We want to ensure that the estimate is reasonable, realistic, and complete.

• Reasonableness addresses areas such as: using appropriate and acceptable methodologies; presenting methodologies systematically; the use of relevant data; and ensuring that assumptions are valid and clearly stated.

Page 57: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

57

Review and Presentation (Continued)

• The realism test checks to see if the assumptions and ground rules are consistent with the statement of work and if the costs are in line with historical data.

• We evaluate completeness by determining whether the estimate includes all the work stated in the request for proposal and whether the costs are traceable and reconcilable.

Page 58: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

Risk and Uncertainty AnalysisRisk and Uncertainty Analysis

Risk Analysis Approaches

Detail

Eff

ort

• Detailed Network & Stochastic

• Detailed Monte Carlo Simulation (each WBS)

• Bottom Line Monte Carlo Simulation

• Add a Risk Factor/Percentage

• Discrete Technical, Schedule, and Estimating Risks

Page 59: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

Risk and Uncertainty AnalysisRisk and Uncertainty Analysis

Probability DistributionsWBS Cost Distribution Total Cost

P.E.

P.E.

P.E.

+

+

+ Many More

=

Sum PE MLC (Mode)

PDF

CDF

Con

fide

nce

50%

20%

Fre

quen

cy

Sum PE MLC

Page 60: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

Risk and Uncertainty AnalysisRisk and Uncertainty Analysis

Probability Density Function

Cell B28 Frequency Chart

Mean = $2,198

4,978 Trials Shown

.000

.006

.012

.018

.024

0

29.2

58.5

87.7

117

$1,250 $1,750 $2,250 $2,750 $3,250

Forecast: Results=

Page 61: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

Risk and Uncertainty AnalysisRisk and Uncertainty Analysis

Cumulative Distribution Functions

Cell B28 Cumulative Chart 4,977 Trials Shown

.000

.249

.498

.747

.995

0

4977

$1,250 $1,750 $2,250 $2,750 $3,250

Forecast: Results=

Page 62: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

62

Reasons for RiskReasons for Risk

Technical Programmatic Cost Schedule

PhysicalProperties

MaterialAvailability

Sensitivity toAssumptions

Degree ofConcurrency

Materialproperties

SkillRequirement

Sensitivity toTechnical Risk

Sensitivity toTechnical Risk

SoftwareComplexity

EnvironmentalImpact

Sensitivity toProgrammaticRisk

Sensitivity toProgrammaticRisk

IntegrationInterface

ContractorsStability

Sensitivity toSchedule Risk

Number ofCritical Path

RequirementChanges

Funding Profile EstimatingErrors

EstimatingErrors

OperationalEnvironment

PoliticalAdvocacy

Page 63: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

63

Development Schedule

Lif

e C

ycle

Cos

t

Min Optimal

Typ

ical

Cost Schedule Curve Cost Schedule Curve

Parallel EffortMore ECPLess Mature Design

Fixed CostTechnology Outdate

Page 64: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

64

Development ScheduleDevelopment Schedule

DoD

Pre-1992 Starts 132 months (11 years)

Post-1992 Starts 89 months (7.4 years) on-going

F-22 216 months (18 years) IOC 2004

Comanche 264 months (22 years) IOC 2006

Commercial

Boeing 777 54 months (4.5 Years)

Mean Cycle Time to IOC

Page 65: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

65

Defense

Schedule GoalsSchedule Goals

Development Schedule

Cos

t

Commercial Drivers• Technology Drives Schedule• Constraint Schedule• Goal is ROI Maximization

DoD Drivers• Funding Drives Schedule• Unconstrained Schedule• Goal is Cost Reduction

Commercial

Page 66: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

66

DoD Program Schedule DriversDoD Program Schedule Drivers

Development Schedule

Cos

t

Cycle Time Reduction Goal

Funding Allocation

Acquisition Process

Program Execution

Page 67: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

67

Final Documentation

• Provide the means for other analysts to get the same results that we have in our cost estimate.

• Providing good directions and a clear trail to follow are essential in having an estimate that can be replicated.

• Provide step-by-step documentation of the methodologies, supporting data, ground rules, and assumptions, equations, examples, etc.,

• Ability to interpret or evaluate someone else’s cost documentation is as important as ability to prepare good cost documentation.

Page 68: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

68

Life Cycle Management Changes

Balanced process that considers investment and sustainment: Informed decision makers

Future State

Current State

Unbalanced process that emphasizes procurement over sustainment: Large unplanned costs

S&T

Procurement

Construction

Training

Operations

Support

RDT&E

OPA

MCA

OMA/MPA

Initial Cost

Estimate

MS A

MS B

Revised Cost

Estimate

MS C

Revised Cost

Estimate

SRR Disposal

Defined, Refined, & Fairly Accurate

Program forEquipment

Develop SSP

Program forO&S Costs

O&S Cost

Estimate

Multiple bill payerdrills to offset actual costs

ICD

Only compete procurement costs against Army Investment Strategy over the EPP. Impact of sustainment on Army program ignored.

S&T

Procurement

Construction

Training

Operations

Support

RDT&E

OPA

MCA

OMA

ICD/DOTMLPF Change Request

Initial Cost

Estimate

MS A

MS B

Revised Cost

Estimate

SRR

Revised Cost

EstimateDisposal

Develop Supportability Sustainability Plan

Program forEquipment

Plan for Sustainment

POM for Sustainment

Periodic Cost

Estimate

FOC

Prioritizers DASC M1 DASC M2 DASC MTV …

Core TeamsUEx xUEy xTOC xSignal Bde xBFSB xMI Bde x

FCS xHVY X X xMED xSBCT xLT xSust UA (UEx) XSust UA (UEy) xHVY xLT xUEy xHVY xMED xLT xAEB x

MUA xEngineer Bde xMP Bde x

Other x

MACOM

Resource Providers

C4ISR

BCT

T*

Integrated Capability (IC)MM OO S*

G1/

G3/

G8

/G4

II

Sustainment

Fires UA

AVN UA

Maneuver

Capability Providers

Capabilities Based Programming

Compete total cost against Army TOA extended over EPP.

Personnel MPA

Personnel MPA

L C M D W

18 Fe bruary 2005 5C L O S E H O L D – P R E D E C IS I O N A L – F O R O F F I C I A L U S E O N L Y – D O N O T D I S T R IB U T E

L ife C y c l e C o s tC o ncep t

R efi ne me ntTech no lo gy

D evel op m entS ystem D evelo pm e nt

& D e m ons tra t io nPr od ucti on &D ep lo ym en t

O per at io ns& S u pp ort

R e s e a r c h a n d d e v e l o p m e n t c o s t st r a c k e d b y M D E P

I n v e s t m e n t C o s t s : M C A , P r o d u ct i o n a n d D e p lo y m e n t

C o s t s ( t ra c k e d b y M D E P )

O & S C o s t s :

M P , O & M , a n d d is p o s a l c o s t s

60 -8 0% O & M c os tsal read y tra ck ed!

T r a c k e d b u t n o t r e p o r te d b y w e a p o n s y s t e m

• E n d It e m S u p p ly & M a in t en an c e (e xc e p t o ve rh a u l)• S o ft w ar e• T ran s p o rt at io n• S T& E• S ys t e m E ng /P M• T rai nin g• F u el U s a g e (c a n b e e s tim a te d )

T r a c k e d & r e p o r t e d b y w e a p o n s y s te m

• D e p o t L e ve l R ep ara b l es ( b y O S M I S )• R e p a ir P a r t s( b y O S M IS )• R E C A P (b y P M )

T r a c k e d b u t n o t b y u n i t• O ve rh a u l (b y A M C )

N o t tr a c k e d• C L S (m u s t b e c a p tu r ed )• S ys te m S p ec ific B A S O P S (C a n b e e st im a te d )

18 Fe bruary 2005 5C L O S E H O L D – P R E D E C IS I O N A L – F O R O F F I C I A L U S E O N L Y – D O N O T D I S T R IB U T E

L ife C y c l e C o s tC o ncep t

R efi ne me ntTech no lo gy

D evel op m entS ystem D evelo pm e nt

& D e m ons tra t io nPr od ucti on &D ep lo ym en t

O per at io ns& S u pp ort

R e s e a r c h a n d d e v e l o p m e n t c o s t st r a c k e d b y M D E P

I n v e s t m e n t C o s t s : M C A , P r o d u ct i o n a n d D e p lo y m e n t

C o s t s ( t ra c k e d b y M D E P )

O & S C o s t s :

M P , O & M , a n d d is p o s a l c o s t s

60 -8 0% O & M c os tsal read y tra ck ed!

T r a c k e d b u t n o t r e p o r te d b y w e a p o n s y s t e m

• E n d It e m S u p p ly & M a in t en an c e (e xc e p t o ve rh a u l)• S o ft w ar e• T ran s p o rt at io n• S T& E• S ys t e m E ng /P M• T rai nin g• F u el U s a g e (c a n b e e s tim a te d )

T r a c k e d & r e p o r t e d b y w e a p o n s y s te m

• D e p o t L e ve l R ep ara b l es ( b y O S M I S )• R e p a ir P a r t s( b y O S M IS )• R E C A P (b y P M )

T r a c k e d b u t n o t b y u n i t• O ve rh a u l (b y A M C )

N o t tr a c k e d• C L S (m u s t b e c a p tu r ed )• S ys te m S p ec ific B A S O P S (C a n b e e st im a te d )

W eapon S ystem f lee t M D E P V S E (a) V S E (b) V S E © E O H

M D E PS ystem /W IC /L INyearinsta lla tionM A C O M

Lifecyc le ac tiv it ies: acqu istionL ike ly F eeds: P R O B E

p lan O S M IS m anua l da ta feedsex ecu tion T R M IM M C da ta feeds-susta inm ent M M IS S A M A S-depo t O H D M O P S E D D S 2-rese t/recap M D S F LO W

F O R C E S LID BR E Q V A L/C B S -x A W P SLM P A R T IS

IND

EX

Key

s

U se rs

In it ia l d e s ig n c o n c e p t: 5 m a jo r k e y s s h o u ld a llo w u s to s u p p o r t u s e rs w ith th re e p e rs p e c t iv e s :

th e W e a p o n S y s te m F le e t V ie wth e M D E P v ie wth e e m e rg in g V a lu e S tre a m M a n a g e r

T h e D W w il l e n c o m p a s s

a ll m a jo r c o m p o n e n ts

o f th e l ife c y c le .

In it ia l d a ta s o u rc e ta rg e ts (d ra f t! )

I te ra t iv e a n d in c re m e n ta l

d e v e lo p m e n t .

A B C D

Cost Estimating Model

DisposalA B C D

Cost Estimating Model

Disposal

TT

DASC

LSOSSO

Tri-Chairs of WSR

OO Rep

G-3Requirements

TT RepPAE Rep

II Rep

MM Rep

Page 69: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

69

CAIV Process

• Set realistic but aggressive cost objectivesearly in acquisition program

• Manage risks

• Track progress using appropriate metrics

• Motivate Government and industrymanagers to achieve program objectives

• Incorporate incentives to reduce O&S costsfor fielded systems

Page 70: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

70

Cost As An Independent Variable (CAIV)

• Best time to reduce cost is early in the process.

• Involves the stakeholders in the process.• Cost tradeoffs must be addressed early in

the acquisition process and embedded in program requirement documents, Request For Proposals (RFPs), contract provisions, and source selection process.

Page 71: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

71

Cost Analysis ProcessDatabases, Tools, & Models

Requirements Acquisition Assumptions

Design Parameters Risk Assessment

ASARCCAIG, DABAPBPPBESAOA

Inputs (Descriptions) Process (Models) Outputs (Costs)

Types of Cost StudiesStudies Should be Known Unknown Class

Cost Estimating Descriptions, Models Costs Analysis

CER DevelopmentDescription, Historical

CostsModels Synthesis

Needed Capability CAIV Cost Goals, Models

Descriptions ( Design and Performance Parameters)

Control

Current Capability

Performance Based and Design Based Cost Models Currently do not Exist

Cost Analysis Domain

Page 72: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

72

Analysis of Alternatives

• Set realistic, aggressive cost objectives earlyin development

• Manage risks

• Track progress with appropriate metrics

• Motivate government/industry managersto achieve program objectives

• Incorporate incentives to reduce O&S costsfor fielded systems.

Page 73: Army Cost Review Board Office Mort Anvari  Mort.Anvari@US.Army.mil

73

Cost Analysis

Art or Science?