warren.d.harrison.g

Taking Care of BusinessTaking Care of Business

Implementing EVM on the Constellation Program (CxP)Implementing EVM on the Constellation Program (CxP)

Speakers: David Warren and Glen HarrisonSpeakers: David Warren and Glen Harrison

Taking Care of Business 1

1. Background1. Background1. Background

2. Meeting the Challenges2. Meeting the Challenges2. Meeting the Challenges

3. Tools for Success3. Tools for Success3. Tools for Success

4. Building the Constellation Team 4. Building the Constellation Team 4. Building the Constellation Team

5. Enhancing Communication5. Enhancing Communication5. Enhancing Communication

AgendaAgenda

6. Conclusion6. Conclusion6. Conclusion


BackgroundBackground

MSFC OSAC – Office of Strategic Analysis & Communications

OSAC was created to integrate information between and among the program/project and institutional organizations.

CS40 – Performance and Capabilities Management Office

Provides support and assistance to sustain capabilities in key competencies such as program planning and control and program/project management. (EVM and Scheduling being the key competency areas…)



Collaborated with Upper Stage Business OfficeEstablished a process to format and collect their dataProvided tools to transfer data compatible with wInsightGuidance toward a sound WBS and OBS structureProvided training and support for wInsight (e.g., User training,Custom reports and charts, etc.)Enhanced earned value reporting with (elements of cost) options.

Once Upper Stage established this process, other Ares elements began to implement it. (e.g., Vehicle Integration, J-2X)After implementing this process with the entire Ares project, data integration was then established.

Collaboration with the Constellation Program Office (CxP) was then established, once the Ares Project Office began to report earned value using the processes provided.CxP then requested the data integration and roll up of all projects at the program level.CS40 worked with the individual projects under Constellation to provide a road map to accomplish the program’s objectives.



Taking Care of Business 5Taking Care of Business 5

Meeting the ChallengesMeeting the Challenges

EVM Spreadsheet (Excel)

WBS Number TitleCrew Launch Vehicle ProjectProject ManagementProject Mgmt and AdministrationBusiness ManagementContractor RelationshipsTechnical ReviewsInformation Technology MgmtAdv Planning & Special StudiesVehicle IntegrationSystems Integration and ControlSystems Requirements and VerificationFlight Test IntegrationIntegrated Design and AnalysisVehicle Integration and OperationsAvionics Integration and Vehicle Systems TestS&MAScience & TechnologyPayloadsAircraft/SpacecraftMission Operations SystemLaunch VehicleFirst Stage

136905.08.01.01 Element Management136905.08.01.02 First Stage Structure & Mech. Systems136905.08.01.03 Electrical/Instrumentation136905.08.01.04 SE&I136905.08.01.05 Operations Support 136905.08.01.06 RSRM (Shuttle Legacy)136905.08.01.07 Booster (Shuttle Legacy)136905.08.01.08 First Stage Prime Contractor136905.08.01.09 Flight Test

Upper Stage136905.08.02.01 Element Management 136905.08.02.02 Integrated Upper Stage136905.08.02.03 Structures & Thermal Systems136905.08.02.04 Main Propulsion System (MPS) 136905.08.02.05 Upper Stage Reaction Control System (RCS) 136905.08.02.06 First Stage Reaction Control System (RCS)136905.08.02.07 Thrust Vector Control (TVC)136905.08.02.08 Avionics 136905.08.02.09 Flight Software System136905.08.02.10 Integrated Test Hardware136905.08.02.11 Logistics136905.08.02.12 Manufacturing and Assembly136905.08.02.13 Reserved136905.08.02.97 Prime Contract

Upper Stage Engine136905.08.03.01 Element Management136905.08.03.02 Systems Engineering and Integration136905.08.03.03 RS-25xUS and RS-25 Upper Stage Conversion Kit 136905.08.03.04 RS-25e Engine 136905.08.03.05 Manufacturing Capacity Increase and Optimization136905.08.03.06 Production and Assembly136905.08.03.07 Test and Checkout136905.08.03.97 Prime Contract

Ground System(s)Systems Integration and Testing

136905.09136905.10

136905

136905.01.03136905.01.02136905.01.01

136905.01

136905.02136905.01.06136905.01.05136905.01.04

136905.02.06136905.02.05

136905.02.01136905.02.02136905.02.03136905.02.04

136905.08.03

136905.08.02

136905.08.01136905.08136905.07

136905.03136905.04136905.05136905.06

Flight Systems & GroundSupport Projects standard WBS

per: NPR 7120.5D

Flight Systems & GroundSupport Projects standard WBS

per: NPR 7120.5D

Project WBSDictionary

Project WBSDictionary

Project WBSloaded into MDM System

Project WBSloaded into MDM System

Project Schedules (MS Project)

Schedule will be Resource Loaded by Organization Code,

Procurements & Travel

Project WBS loaded into WebTADS, Travel Mgr, Etc.

Project WBS loaded into WebTADS, Travel Mgr, Etc.

Actual Costfrom IEMP (ACWP)

Actual Costfrom IEMP (ACWP)

IEMPIEMP

Scheduled (BCWS) &Performance (BCWP)Scheduled (BCWS) &Performance (BCWP)

Core Financial (SAP)

Core Financial (SAP)

Project WBS per: NSMNumber Scheme

Project WBS per: NSMNumber Scheme

BusinessWarehouseBusiness

Warehouse

Work Package Definition:What does it take to do the scope?What are the deliverables?How much does it cost?How long will it take?Funding allocation adjustment

Work Package Definition:What does it take to do the scope?What are the deliverables?How much does it cost?How long will it take?Funding allocation adjustment

136905.8 Crew Launch Vehicle

136905.8.1 1st Stage This element contains all the 1st Stage elements defined below.136905.8.1.1 1st Stage Element

ManagementThis element includes the management and procurement support needed to develop and deliver CLV specific 1st Stage hardware and flight support.

136905.8.1.2 1st Stage SE&I This element includes the engineering and Project support for 1st Stage development and flight support. Included in this element are the requirement definition, specifications, interface definition, verification, and qualification. This element also includes the integrated analysis for structures, loads, thermal environments and development of 1st input to vehicle integrated math models. This element encompasses flight engineering support and engineering support for integrated vehicle testing. This element is envisioned to be primarily the responsibility of the prime contractor with Government support for requirement and specification development.

136905.8.1.3 Aft Assembly This element contains the development and evaluation engineering for the CLV 1st Stage Aft Skirt. It is anticipated that the current Shuttle SRB Aft skirt designs will have to be modified for the CLV separation system, avionics, and possibly TVC modification. It is anticipated that all aft skirt hardware (reusable) will be obtained as required from the Shuttle Program at no cost to CLV. This element includes all the aft skirt hardware, touch labor, and engineering to support any sub-scale testing, static testing, vehicle system testing, and flight tests (flight test engineering included in SE&I). The prime contractor will be responsible for this element.

136905.8.1.4 Forward Adapter136905.8.1.5 Motor This element contains the development and evaluation engineering for the CLV 1st Stage nozzle. It is anticipated that the current RSRM nozzle design will

remain virtually the same. It is anticipated that nozzle metal hardware (reusable) will be obtained as required from the Shuttle Program at no cost to CLV. Although the current Shuttle Program has sponsored an obsolescence program for replacement of the nozzle rayon material (Primary nozzle material), it is anticipated that Shuttle stockpiles of the current material (NARC) are sufficient for the CLV missions. This element includes all the nozzle hardware, touch labor, and engineering to support any sub-scale testing, static testing, vehicle system testing, and flight tests (flight test engineering included in SE&I. The prime contractor will be responsible for this element.This element contains the development and evaluation engineering for the CLV 1st Stage case, seals and joints. It is anticipated that the current RSRM case, seal and joint designs will remain virtually the same. It is anticipated that case metal hardware (reusable) will be obtained as required from the Shuttle

136905.8.1.6 1st Stage GSE & Tooling

This element contains the development and evaluation engineering for the CLV 1st Stage GSE and unique non-recurring tooling. It is anticipated that the current Shuttle GSE and tooling will remain virtually the same and be available to CLV as required from the Shuttle Program at no cost to CLV. This element encompasses any development and manufacturing of new or modified design for GSE or tooling to support 1st Stage. This element includes all the GSE and tooling hardware, touch labor, and engineering to support any sub-scale testing, static testing, vehicle system testing, and flight tests. The prime contractor will be responsible for this element.

136905.8.1.7 Final Assembly Components

This element contains the development and evaluation engineering to support the CLV 1st Stage final assembly. This includes assembly of the motor and assembly of the 1st systems (such as aft skirt, systems tunnel, TVC, TPS). It is anticipated that the current Shuttle facilities, GSE, and tooling will remain virtually the same and be available to CLV as required from the Shuttle Program at no cost to CLV. This element includes all the final assembly touch labor and engineering to support any sub-scale testing, static testing, vehicle system testing, and flight tests. The prime contractor will be responsible for this element.

136905.8.1.8 1st Stage Test This element includes the engineering and touch labor for the defined static qualification testing for CLV 1st Stage solid motor testing. No test facility upgrades are anticipated nor included in the planning for this WBS element. The testing defined in the element will occur in conjunction with Shuttle RSRM testing and the schedule of required tests will be negotiated with the Shuttle Program. The prime contractor will be responsible for this element.

136905.8.1.9 Risk Reduction Flight-1 Integration

This WBS element includes all activities required for Risk Reduction Flight 1 (RRF-1) support to the CLV Project.

136905.8.2 Upper Stage This element contains all the Upper Stage elements defined below.136905.8.2.1 Upper Stage Project

ManagementThis element contains activities required for to manage the cost, schedule, and technical resources, schedule, and risk.

136905.8.2.2 Integrated Upper Stage

Functions associated with the overall upper stage system design engineering, analysis, and integration. This provides the integration between other external launch elements as well as inter-stage subsystem integration.

136905.8.2.3 Structures & Thermal Includes the design, development, integration, test, and verification of all upper stage primary and secondary structural elements required for the upper stage including all thermal functions required due to impacts from external environments as well as internally induced effects and conditioning requirements

136905.8.2.4 Main Propulsion System (MPS)

Includes the design, development, integration, test, and verification of all propulsion elements required to provide propellants to the upper stage engine including fill, feed, repress systems, and actuation and purge systems.

136905.8.2.5 Reaction Control System (RCS)

Includes the design, development, integration, test, and verification of all propulsion elements required to provide attitude control, separation, and settling to the upper stage and includes thrusters, fill, feed, and press systems.

136905.8.2.6 Thrust Vector Control (TVC) System,Hydraulic Power Unit (HPU) & Hydraulics

Includes the design, development, integration, test, and verification of all elements required to provide hydraulic power for engine gimballing and control of the main engine valves for stage GN&C and engine control.

136905.8.2.7 Interstages All elements required for design, development, integration, test and verification for the Interstages hardware which comprise of the Forward Frustum, Interstage, Spacecraft/Payload Adapter, Systems Tunnel and Flight Termination System.

136905.8.2.8 Avionics This WBS element contains all software and associated hardware for the Crew Launch Vehicle including both the 1st Stage and the Upper Stage.

136905.8.2.9 Upper Stage GSE & Tooling

Includes the design, development, integration, test, and verification of all elements required for manufacturing and assembly ground support equipment and tooling.

136905.8.2.10 Upper Stage Level Integration & Test

Includes the assembly/integration, test, and verification of all subsystems under the Upper Stage WBS. Additionally, all integrated hardware testing STA, EMC, and PTA are included under this element.

Project informationloaded into wInisghtMgmt Reporting & Data Analysis

Contractor suppliedCPR data

Contract Setup Default Project/Contract Dollar Scale - (in Thousands of Dollars k$)

Project/Contract Name *Period Ending * e.g, Feb-05 = 0205 Format (mmyy)Calendar Type*

Contractor Options

Contractor/Center Name *AbbreviationAddress 1Address 2City

Note: If no contractor applicable to project, then enter in the Contractor Name field theresponsible NASA Center or any name associated with your project.

Contract Options

Contract Number or In-House*Project/Contract TypeProgram NameProgram NumberProgram TypeManager NameFinancial/Contract Analyst NameProgram Office NameNegotiated CostProject/Contract Target PriceTarget Fee in DollarsProject/Contract Ceiling AmountProject/Contract Start Date *Project/Contract Compl Date*Report Start Date*

Country Code

Proj/Cntr Est. Compl Date

USA

StatePostal Code

Approval Name

Project/Contr Budget BaseTotal Allocated Budget

Submission Date*Major Program*Element Program*

Approval Title

NASA Center*Technical Theme*

Report End Date *EAC - Best Case*EAC - Most Likely*EAC - Worst Case*

After finishing the information above please continue by entering data into each tab below. When finished with all dataentry including, the Future - WBS information you may select the Finish button on the "Finish-Page" tab. Otherwise

make all required changes in order to continue successfully.

EVM (Cobra - XML Connect)

In-House Performance Measurement Process



In-House Performance Measurement ProcessCurrently, there is not a fully validated EVM system in-place for projects to use in satisfying the performance requirements placed on NASA and the Constellation Program (CxP).The processes and tools CxP selected will outline a recommended approach that will enable projects to satisfy the requirement of applying EVM principles.The process itself is modular so as to enable it to be applied to any size of project, any type of earned value engine, and can beused with any type of financial system in place.It is also flexible enough so as the contract, program or project grows the process will be able to accommodate this growth with little or no impact to the work currently in progress.

CxP EVM Data Analysis and IntegrationOne of Constellation’s goals was to be able to integrate, view, and analyze both the in-house effort and contractor’s data.

This is being achieved by working with the contractors and the NASA leads to define parameters in the WBS and OBS structures along with the different elements of cost.

Contractor’s data and in-house data are being integrated and rolled-up at the project level.

The data from the various projects, including in-house and contractor data, are being rolled-up to the Program level.

This gives Constellation the ability to have a one-stop shop for consolidated reporting and analysis of the various projects and elements.



Program Roll-up



ConstellationConstellation

Program IntegrationProgram Integration OrionOrion AresAres EVAEVA Ground OpsGround Ops

In-HouseIn-House

ContractorContractor

In-HouseIn-House First StageFirst Stage

J-2XJ-2X

Project MgmtProject Mgmt

Upper StageUpper Stage

In-HouseIn-House In-HouseIn-House

In-HouseIn-House


In-HouseIn-House




136905 ARES 136905 ARES136905.08 Launch Vehicle 136905.08 ARES Program Of136905.08.05 Upper Stage 136905.08.05 Upper Stage136905.08.05.01 Mgmt 136905.08.05.01 Mgmt136905.08.05.01.97 Mgmt 136905.08.05.01.03 GRC-Elem Mgmt136905.08.05.02 Integrated Uppe 136905.08.05.01.04 LaRC-Elem Mgmt136905.08.05.02.97 Integrated Uppe 136905.08.05.01.08 MSFC-Elem Mgmt136905.08.05.03 Structures and 136905.08.05.01.20 SEB136905.08.05.03.97 Structures and 136905.08.05.01.21 Ste Res Off136905.08.05.04 Main Propulsion 136905.08.05.01.22 Reserved136905.08.05.04.97 Main Propulsion 136905.08.05.01.23 US - S&MA136905.08.05.05 Upper Stage Rea 136905.08.05.01.97 Mgmt136905.08.05.05.97 Upper Stage Rea 136905.08.05.02 Integrated Uppe136905.08.05.06 First Stage Rol 136905.08.05.02.01 SE&I Mgmt136905.08.05.06.97 First Stage Rol 136905.08.05.02.02 Rqmts & Verif136905.08.05.07 Thrust Vector C 136905.08.05.02.03 Config Mgmt136905.08.05.07.97 Thrust Vector C 136905.08.05.02.04 Systems Design136905.08.05.10 Component & Int 136905.08.05.02.06 SE&I MPTA136905.08.05.10.97 Component & Int 136905.08.05.02.97 Integrated Uppe136905.08.05.11 Log Supoort Inf 136905.08.05.03 Structures and136905.08.05.11.97 Log Supoort Inf 136905.08.05.03.01 Integ Struct136905.08.05.12 Manufacturing a 136905.08.05.03.02 Instrumentation136905.08.05.12.97 Manufacturing a 136905.08.05.03.03 Core Stage136905.08.05.13 Small Solids 136905.08.05.03.04 Interstage136905.08.05.13.97 Small Solids 136905.08.05.03.05 Struct & Therm

136905.08.05.03.06 Purge System136905.08.05.03.07 HAZGAS System136905.08.05.03.08 S&T MPTA/GVT136905.08.05.03.97 Structures and

Contractor’s WBS NASA WBS





Tools SelectedThe tools selection involved a mix of COTS (wInsight and Cobra) and internally developed software (XML Connect) by Constellation support personnel.The knowledge and experience gained from the support and guidance of other projects led to additional insight into Constellation’s challenges.

Training ProvidedTraining established to help bring CxP up to speed on EVM, Scheduling and specific tools that were needed to meet their specific needs.

Reports CreatedCustom reporting requirements were outlined and defined providing CxP with a clear direction for communication.


Tools for SuccessTools for Success

XML ConnectXML Connect is an Excel based program designed to transfer raw EVM data into wInsight. XML Connect was designed for use by NASA programs or projects that do not have a EV management system to enter Earned Value information into wInsight.

Deltek wInsight *Deltek wInsight™ is used for analyzing, sharing, and reporting earned value management data. wInsight's standard set of reports provide early warning indicators to quickly identify variances in project performance, enabling organizations to proactively identify potential problems before they occur.Custom ReportsCustom ChartsCustom Programming Support

* Available via ICE

-30

-20

-10

0

10

20

30

-30 -20 -10 0 10 20 30 40

MEGA HERZ ELEC & VEN F04695-86-C-0050 FPI RDPRElement: 1000 Name: MOH-2Bull's-eye Chart - As of: JAN 04

BEHIND SCHEDULE, UNDER COST AHEAD OF SCHEDULE, UNDER COST

BEHIND SCHEDULE, OVER COST AHEAD OF SCHEDULE, OVER COST

SV% CUM Percent of Dollars

CV

% C

UM

Percent of D

ollars

9

8

7 6

5

4

32

100

0.0

1.0

2.0

3.0

4.0

5.0

6.0

7.0

8.0

2003APR MAY JUN JUL AUG SEP OCT NOV DEC

2004JAN

MEGA HERZ ELEC & VEN F04695-86-C-0050 FPI RDPRElement: 1000 Name: MOH-2Snake Chart

Dollars in M

illions

BCWS 7.2795.6334.1942.5172.2311.4150.9860.5810.3450.123BCWP 6.8515.3423.7842.7422.2161.3760.9330.5300.2470.123ACWP 7.3505.6434.2473.0272.1911.4850.9450.5320.2350.107

MEGA HERZ ELEC & VEN F04695-86-C-0050 FPI RDPRElement: 1000 Name: MOH-2CPI Guage

0.90

0.95

1.10

CPIIndex of Dollars

JAN 040.932

0.90

0.95

1.10

SPIIndex of Dollars

JAN 040.941

XML Connect creates the xml data file which is then imported XML Connect creates the xml data file which is then imported automatically into wInsightautomatically into wInsight

Example charts produced by wInsight for analysisExample charts produced by wInsight for analysis

XML ConnectXML Connect wInsightwInsight





CxP Monthly Program Review Report Generator *The MPR Report Generator was developed so that all projects thatreported to the Constellation Program (CxP) could provide EVM data from wInsight into a PowerPoint Presentation automatically. Program defined format.

Deltek Cobra *Deltek Cobra is a project costs management tool, measuring earned value, and analyzing budgets, actuals and forecasts. It offers seamless integration with leading scheduling tools and unmatched flexibility to meet even the most exacting cost management requirements.

NASA 5-Page Analysis ReportInternally developed Excel based workbook that pulls data from wInsight and produces a customized PowerPoint Presentation based on certain earned value thresholds and other criteria that communicate the status of a contract, program or project.

Training* Available via ICE



Deltek wInsight - Background Initially wInsight was setup at MSFC in 2000 to support MSFC projectsChosen as Analysis and Reporting tool by ESMD in 2003

• wInsight can easily import contractor’s EVM reports - Contractor Performance Reports (CPR) in the form of xml, or x12 transaction set.

• wInsight is the tool of choice for Government Agencies and Contractors performing Earned Value Management (EVM) analysis and reporting on programs, projects and contracts with EVM requirements.

The one database serves as a reservoir or ‘one stop shop’ for the Agency’s EVM data;

• Rollup reporting can be accomplished• Historical reference for data mining, such as cost estimates; • One administrator for the Agency instead of multiple ones for different

projects and Centers.• Ensures the safeguarding of the data with daily backups of the data for the

Agency.Currently, the wInsight database resides at the CxPO ICE (ICE) and is being used by multiple NASA projects.

NASA wInsight ICE Architecture

MSFC

AMES LaRCGRC

KSCSSC

DFRC

HQ

JSC

JPL




Building the Constellation TeamBuilding the Constellation Team

Constellation TrainingwInsight User Training

wInsight Admin Training

CxP Monthly Report Generator Training

XML Connect Training

Basic EVM Training

IBR Training


Enhancing CommunicationEnhancing Communication

Reporting RequirementsAbility to show earned value data at specific levels.Ease of Use/Understanding.Flexible/Stable.

Custom Reports GeneratedwInsight Charts and ReportsCxP Monthly Program Review ReportEnhanced 5-Page ReportElement of Cost reporting enhancements (COM/OBS)

CxP Report GeneratorCxP Report Generator


Level 2 Status

R Worse than -10% G Better than -5%Y Between -10% and -5% Change Threshold = 10% Improving Worsening

WBS Description SV CV VAC BCWS BCWP ACWP SV SV % CV CV % BAC EAC Vac

1 2000 PROJ MANAGEMEN ↓ ↓ ↔ 882.6 869.4 930.6 -13.2 -1.50 -61.2 -7.04 1,384.6 1,418.6 -34.02 3000 PRIME EQUIP ↓ ↓ ↓ 4,809.2 4,424.4 4,792.0 -384.8 -8.00 -367.6 -8.31 14,606.4 20,927.6 -6,321.23 4000 SPARES ↑ ↑ ↔ 133.8 135.0 142.8 1.2 0.90 -7.8 -5.78 755.6 761.8 -6.24 5000 DATA ↔ ↓ ↔ 98.8 92.2 110.0 -6.6 -6.68 -17.8 -19.31 127.0 143.0 -16.05 6000 TEST & EVAL ↔ ↑ ↔ 692.2 706.8 706.2 14.6 2.11 0.6 0.08 1,633.0 1,635.0 -2.0




Variances (Cum to Date) - January 2008

Cost Variances

Schedule Variances

These elements exceed the Format 5 Thresholds and require a Variance Analysis Report

R Worse than -10% G Better than -5%Y Between -10% and -5% Change Threshold = 10% Improving Worsening

WBS DESCRIPTION SV CV VAC BCWS BCWP ACWP CV CV% CPI LRE

1 3600 PCC ↓ ↑ ↓ 1,692.8 1,681.4 1,977.6 -296.2 -17.62 0.850 12,000.02 3200 COMMUNICATIONS↑ ↓ ↔ 910.6 707.4 838.2 -130.8 -18.49 0.844 2,130.0

WBS DESCRIPTION SV CV VAC BCWS BCWP ACWP SV SV% SPI LRE

1 3200 COMMUNICATIONS↑ ↓ ↔ 910.6 707.4 838.2 -203.2 -22.31 0.777 2,130.02 3700 DATA DISPLAY ↑ ↔ ↔ 272.6 159.6 159.6 -113.0 -41.45 0.585 388.0



♦ Explanation of Variance/Description of Problem:

♦ Impact:

♦ Corrective Action:

Variance Analysis


Artificial Intelligence Report

• This element represents 100.0 percent of the total contract.• Earned value data indicates that this effort is about 32.94% complete.• Work in process is behind schedule.• A significant amount of management reserve was allocated this period.• Beware of problems in this element; the budget has been increasing routinely.• Period actuals are running at 1,707.0.• There has been a significant increase in the rate of expenditures recently. • This effort has an unfavorable cost variance of -7.28%.• Performance is holding relatively steady at 0.932 per unit expended (Dollars).




ConclusionConclusion

Constellation: meeting the challenges1. Meet the EVM requirements set forth by the ANSI/EIA-748

and lay the ground work for a future validated Earned Value Management System.

2. Provide the tools needed to more efficiently produce the needed data and identify where concerns are in the life cycle of a contract, project or program.

3. Training the management and the projects in earned value and tools specific to meet the challenges.

4. Build a process that will help the Constellation Program or any other NASA Program reach the ultimate goal of having a fully validated EVM system.

warren.d.harrison.g

Business

aft skirt hardware

vehicle system testing

propulsion elements required

upper stage

stage rol 136905

static testing

scale testing

shuttle program