software metrics training additional handouts

Software Metrics Training Additional Handouts

Instructor: David Longstreet [email protected]

www.SoftwareMetrics.Com

of 2 Longstreet Consulting Inc.




Estimating

Questions Agree (1) Neither (2) Disagree (3) 1. Estimates are made using

formal methods.

2. The process to create estimates is consistent between team members within a single team

3. The process of creating estimates between teams or functional groups is done consistently.

4. Our estimates include a detail listing and explanation of our estimating.

5. Our estimating model was created using empirical data gathered internally..

6. Our estimating model was created using industry wide data.

7. We collect heuristic information on our projects.

8. We maintain a “blue book” of historical data and heuristics.

9. We produce and study reports to analyze where we spend project time.

10. We study how project time varies from one project to the next.

11. We produce formal analyze reports explaining variations in estimates to actual.

12. We update our estimating model based upon actual results.



How do you view your IT environment?

Questions Agree (1) Neither (2) Disagree (3) 13. Policies are not clearly defined 14. We are always in a crisis mode 15. We reward fixing problems

more than good management.

16. Project Managers do not manage closely to project plans

17. There is a lot of overtime required

18. We seem to adopt the “flavor” of the month methodology.

19. Coding methods are inconsistent.

20. Terminology used in design documents is consistent.

21. Everyone writes technical documentation a variety of ways.

22. IT management is not open to new ideas.

23. We are not able to stick to one way to do something.



Quality and Productivity

Questions Agree (1) Neither (2) Disagree (3) 24. If quality is improved

productivity will not increase.

25. Customers are not willing to pay more for high quality products

26. IT is an art not a science 27. Measurement data will not be

used or it will be miss used.

28. IT can not be measured 29. If quality is improved, then cost

to produce software products will not decrease.

30. Productivity and Quality have inverse relationships

31. It is possible to accurately estimate with out complete functional requirements.

32. Comparing past projects cannot help us understand how to improve future projects.

33. Gathering historical data is not useful information in predicting future performance.

34. Software can not be sized 35. There are no quantitative

relationships between phases of a software project.

36. It is possible to estimate environments that are unstable?



Project Evaluations

Questions Agree (1) Neither (2) Disagree (3) 37. We never update our

requirements documents during the project

38. Our requirements documents from one project to the next are very similar.

39. We create our analysis documentation after the project is complete.

40. When comparing one requirements document to another, within the same project, there is a lot of differences in terminology.

41. Milestone reporting and tracking is done on a limited basis.

42. We do not revise estimates based upon phase completions.

43. We do not consider user involvement critical to project success.

44. Overtime is the nature of our projects.

45. There is less pain providing unrealistic estimates compared to missing schedules.

46. Our staff members work on two or more projects at one time.

47. We normally start coding the first day of the project (or as soon as possible).



Project Specific Information How often is the following information updated?

Daily Weekly Bi-Monthly

Monthly End of

Phase

End of Project

Never Updated

Not Done

Effort Cost Schedule Dates

Milestone Updates

What is the typical size of the lowest level of task or activity that is estimated and performed?

Less than 4 hours 4- 8 hours (1 day) 8-20 hours (2 days) 20-40 hours (3-4 days) 1 week 2 weeks 3 weeks 4 weeks Never

How far ahead are projects planned?

Not planned Less than a month 1-2 months 2-4 months 4-6 months 6 months to a year Over 1 year.

How often is the proper level of user involvement in projects?

Never Seldom Often How often new things or projects added to a release at the “last minute”?

Never Seldom Often



Estimating You are required to estimate a new project written in language that your organization has no experience. Your historical delivery rate is 1 hour per function point. You create a small project and it is developed in 40 hours and the size is of the project is 20 function points. What is your delivery rate on the new project? The new project is 500 function points. Estimate the total hours required to deliver the project.



Problems

1. Your historical productivity is 100 function points per work month. Your manager tells you that project must be done in 6 months. What is the maximum number of function points that can be delivered in 6 months?

2. Your historical percent breakdown is as follows.

a. Historical Numbers i. Requirements 20%

ii. Design is 20% iii. Coding 30% iv. Testing is 20% v. Implementation is 10%

vi. Your historical delivery rate is 10 hours per function point. vii. Project size is 1,000 function points

b. What is the total amount of time estimated for the project? c. How many hours are you estimating for each phase of the project?

i. Requirements _______ hours ii. Design _______ hours

iii. Coding _______ hours iv. Testing _______ v. Implementation_______ hours

vi. Should sum up to same amount as in b. vii. How did your come up with your numbers?

d. The actual number of hours to complete requirements was 30 hours. i. How many hours do you expect the project to be now?

ii. Revise the following table iii. Without resizing the project what do you expect the size of the

project to be after requirements?

Phase Estimated After Requirements Difference Requirements Design Code Testing Implementation Totals



Typical Task Plan By Deliverables % of Effort Concept 2.0% Concept Phase Project Concept Document Change Request Concept Document Change Request Review Preliminary 2.0% Level of Effort (LOE) LOE Review Requirements 20.0% Initial Change Order Initial Change Order Requirements Requirements Test Plan Draft Test Plan Requirements Phase Requirements Phase Bid Specification Review Function Point Counts Project Plan Review Project Schedule Review Functional 20.0% Functional Specification System Impact Spreadsheets Draft Logical Database Design Updated Function Point Counts Functional Estimate Functional Phase Bid Updated Change Order Project Plan Updated Change Order Project Plan Functional Specification Review Updated Change Order Project Plan Review Updated Change Order Project Schedule Review Design 25.0% Design Specification



Initial Integration Test Specification Initial Integration Test Plan Data Flow Diagrams Logical Database Design Stored Procedure Design Change Order Build Matrix Initial System Test Initial System Test Plan Updated Change Order Project Plan Updated Change Order Project Schedule Initial Release Project Plan Initial Release Project Requirements Traceability Matrix Updated Function Point Counts Updated Functional Estimate Design Review Logical Database Design Review Updated Change Order Project Plan Review Updated Change Order Project Schedule Review Initial Release Project Plan Review Initial Release Project Schedule Review Development 15.0% Development Tested Code Updated System Test Specification Updated System Test Plan Unit Tested Code or Code Review Checklist Draft User Documentation Draft Interface Control Documentation Draft Database Documentation Release Build Matrix Support and Maintenance Guide Draft Customer Training Final Integration Test Specification Code Review Integration Test Specification Review Integration Test Plan Review Updated Change Order Project Plan Review Integration 5.0% Test Phase Updated Quality Metrics Defect Reporting Updated Release Project Plan Updated Release Project Schedule



Operational Integration Integration Test Post- Executed Integration Test Integration Test Checklist Integration Tested Software Final System Test Specification Final System Test Plan Installation Kit Installation Guide Release Implementation Plan Patch Kits Initial Job Dependency Maps Updated Customer Training System Test Specification Review Release Implementation Plan Review System Test Readiness Review System Test Plan Review Updated Release Project Plan Review Updated Release Project Schedule Review System Test Phase 11.0% Updated Quality Metrics Updated Release Project Plan Updated Release Project Schedule Operational System Test Environment System Test Post- Installation Checklist Executed System Test - Plan System Test Checklist System Tested Release System Test Output Release Kit System Test Runtime Statistics Updated Job Dependency Maps Final User Documentation Final Interface Control Documentation Customer Release Training Production Readiness Review Updated Release Project Production Customer Training Defect Reporting Change Order Project Folder Creation of Change Orders Maintenance Schedules



Project Plans Based Upon Detail Tasks

Area Metrics Tasks PM Project Management PM Conduct Project Management Activities PM Develop project team,indentify Project resource requirements PM Determine External Resource Needs PM Create/Maintain Project Repository & GTO issues Db PM Cross Training PM Metrics Defect Reporting and Tracking PM Provide project Status Report(s) PM Attend Project Status Meetings PM Metrics Create/maintain Function Points Counts/Assessments PM Metrics Collect and Make Assumptions on Project Heuristics

Metrics Create Initial Estimates (including all assumptions) PM Bus Owner/Member Support PM Project Repository Established

Analysis Analysis Analysis Identify Project Initiation/Feasibility Analysis Preliminary Idea Discussions/CRF Analysis CRF Complete/Submitted to Business Owner/BCRT Analysis Create Business Case Analysis Gather Business Information Analysis Gather Technical Information Analysis Review Business Case Analysis Business Case Completed Analysis High-level Requirements Analysis Create High-level Requirements Analysis Create First Estimate/Project Plan Analysis Initial Plan/First Estimate Complete Analysis Prepare Functional Requirements Document Analysis Create Functional Requirements Document Analysis Complete Project Participant Responsibilities Checklist Analysis Assemble, Publish & Distribute Functional Requirements Document Analysis Conduct Review of Functional Requirements Analysis Review/Walk Through Functional Requirements Analysis Revise Functional Requirements Document Analysis Functional Requirements Document Complete/Signed Off Analysis Metrics Complete Initial Function Point Count Analysis Metrics Conduct Function Point Maturity Assessment Analysis Create Estimate Using FTP's Analysis Prepare Impact Analysis Document Analysis Create Impact Analysis Document Analysis Create Individual Project Plans Analysis Individual Project Plans Complete Analysis Create Analysis Estimate



Analysis Analysis Estimate Complete Analysis Create Hardware/Network Capacity Plan Analysis Assemble Publish & Distribute Impact Analysis Document Analysis Develop/Walk Through Risk Document Analysis Risk Document Completed Analysis Conduct Review of Impact Analysis Document Analysis Consolidation Impact Analysis Document Completed Analysis Create Release Masterplan Analysis Project/Release Closure (Business Owner/BCRT) Analysis Release Masterplan Complete/Sign Off Analysis Conduct Peer Review Meeting Analysis Peer Review Meeting Complete Analysis Acquire Hardware & Software Analysis Complete MASC Request Analysis Negotiate with Vendors Analysis Purchase and Take Delivery Analysis Initiate Acquisition of all Necessary Hardware & Software Analysis Review Requirements with Members Design Design Design Design(Design Document) Design Create Design Document Design Assemble, Publish & Distribute Design Document Design Conduct Review of Design Document Design Review/Walkthrough Design Document Design Revise Design Document Design Design Document Complete/Signed Off Design Metrics Update Function Point Count Design Metrics Update Heuristics Design Metrics Update Estimates Design Metrics Report variations of estimates including root cause to management Design Create Program Specs/Unit Test Cases Design Develop Program Specs Design Begin Unit Test Plan and Test Cases Creation Design Create User Acceptance Test ( UAT) Plans and Test Cases Design UAT Test Plans And Test Cases Completed/Signed Off Design Create System and Integration Test Plan & Test Cases Design Develop System an Integration Test Plans & Test Cases Design System and Integration Test Complete/Signed Off Design Create Implementation Plan Design Prepare Individual implementation Plans Design Individual Implementation Plan Complete Design Create Member Test Plan/Test environment Design Define Member Test Plan/Approach Design Customize The Member Test environment Design Create Member Test Plan environment UAT Plan Design Create Backup & Recovery Plans/Data Design Prepare Backup and Recovery plans



Design Prepare Backup and recovery Test Cases/Data Design Review of Backup & Recovery Plans Complete Design Create Member Documentation Design Create member Documentation Design Create member Notification Design Create Release of Enhancement Guide Design Initiate User Training/Documentation Design Create/Publish Master Test Approach (strategy)/SPOC Design Create/Publish Master Test Approach (strategy)/SPOC Design Prepare The DTF environment Design Customize the DTF Environment Design Design The Build/Install Scripts an Procedure Design Design Operations Scripts an Procedures Design Conduct Phase Level Review(PLR) Design Attend Phase Level Review

Development Development Development Metrics Update Function Point Counts Development Metrics Update Heuristics Development Metrics Update Estimates Development Metrics Report variations of estimates including root cause to management Development Prepare The ITF environment Development Customize ITF Environment Development Design the Build/Install Scripts an Procedures Development Design Operations Scripts an Procedures Development Conduct Phase Level Review (PLR) Development Attend Phase Level Review Development Install Development Architecture Development Install Hardware & Software Development Create Directory Tree and Archive environment Development Prepare Samples and shell Files Development Identify Training Needs/Requirements Development Conduct Walkthrough With Development Team Development Development Architecture Complete Development Conduct Programming Development General initial Databases Development Update/Review Program Logic (specs) for Each Program Module Development Conduct Walk through Of Program Logic/Specs Development Code Modules & Programs Development Conduct Walkthrough of Program Code Development Integrate/Apply Maint/ Synchronize Maint Fixes & SCRs Development Code Complete Development Conduct Unit Test Development Update Unit Test Plans, Test Cases, & Test Data Development Install & Test Software Package Development Perform Unit Tests Development Conduct Walkthrough Of Unit Testing Results Development Technical Lead- Build & Check-in Release



Development Construction Complete/ Sign off Complete (includes Code & unit Test Development Create/ Review Consolidated Implementation Plan Development Consolidation Implementation Plan Complete Development Move Modules to DTF Development DTF Modules Move Complete Development Conduct System an integration Tests Development Create System and Integration Test Data Development Conduct System and Integration Tests Development Revise/Update Code and Test Plans and Test Cases Development Conduct Walk Through of System an Integration Test Results Development system Test Complete/Signed off Development Integration Test Complete/Signed off Development Prepare for Performance/Stress/Security/Multi-site Testing Development Prepare volume and Stress Test Cases/Data Development Prepare Security and controls Test Cases/ Data Development Prepare multi-site Test Cases/Data Development Conduct Performance/Stress/Security/ Multi-site Testing Development Conduct Volume and Stress Test Development Conduct Security Test Development Conduct Multi-site Test Development Conduct Walkthrough of Performance Test Results Development Performance Test Sign Off Development Prepare For Member an MTE Testing Development Create Member Test Plans/Test Cases Development Create MTE User Acceptance Test Cases Development Member Test Plan/MTE Test Plan Complete Development Prepare For User Training Development Define Training Requirements/Schedule Training Development Prepare Training Guides and Materials Development Set Up Training files/Databases Development Training Instructor Kof Member Or Internal Class On New Release Development User Training Perpetration Complete Development Induction into ITF (integrated Test Faculty) Development prepare for ITF Induction Development ITF Induction Meeting/Checklist Complete Development ITF Setup

Testing Testing Testing Update Function Point Counts Testing Update Heuristics Testing Update Estimates Testing Report variations of estimates including root cause to management Testing Conduct Implementation Test Testing Perform Implementation Test Testing Implementation Test Complete/ITF Induction Complete Testing Conduct Security Test Testing Test Security Systems Testing Conduct Baseline/Regression Test



Testing Perform Baseline/Regression Test Testing Development Support Of Regression Tests Testing Baseline/Regression Test Complete Testing Conduct Backup and Recovery Tests Testing Conduct Backup Procedures Test Testing Conduct Recovery and/or Contingency Test Testing Backup/Contingency Test Complete Testing Conduct User Acceptance Test (UAT) Testing Perform User Acceptance Test Testing Development Support of UAT Tests Testing Conduct Review/Walkthrough of UAT Results Testing User Acceptance Test Complete/Signoff Testing Conduct Member Beta Testing Testing Update Member Beta Testing Environment Testing Complete User Acceptance of Member Test Environment Testing Perform Member Beta Testing Testing Complete User Training /Documentation Testing Prepare Member Announcements of Changes/Enhancements Testing Update MasterCard Manuals to Reflect Changes/ Enhancements Testing User Documentation Complete Testing Conduct Internal Training Testing Conduct Member Training Testing Metrics Develop Metrics for Testing Testing Training complete Testing Contingency for Project Testing Project Contingency Testing Contingency complete/Allocated Testing Conduct Phase Level Review(PLR) Testing Attend Phase Level Review

Implementation Implementation Implementation Update Function Point Counts Implementation Compare Heuristics Assumed v. Actual Implementation Compare Estimates with Actual Results Implementation Develop Post Project Estimating Report Implementation Perform Member Testing Implementation Install Member Testing Environment Implementation Conduct User Acceptance of the Member Test Environment Implementation Perform Member Testing Implementation Update Library of Reusable Code Implementation Member Testing complete Implementation Prepare Production Environment Implementation Move system to Production Implementation Schedule Post Project Review Implementation Implementation Date/Project Ready Implementation Conduct Member Migration to Production Implementation Conduct Beta Member Implementation Implementation Global implementation Complete



Production Post-Implementation Production Conduct Post Project Review (PPR) Production Prepare for Post Project Review/Complete PPR Document Production Initiate GTO Internal Customer Satisfaction Survey Process Production Attend PPR Meeting/Finalize Post Project Review Production Post Project Review Complete/Distributed Production Metrics Develop Metrics for Defects Production Wrap Up the Project Production Ensure Completeness of System Documentation Production Close Out the Project in Project Workbench Production Metrics Conduct Final Function Point Count Production Metrics Update Function Point Estimate Production Metrics Review Function Point Maturity Assessment



Heuristic Analysis The following items impact productivity and quality within organizations.

Project Management • Project Organization • Project Team Roles and Responsibilities • Project Team Morale • Project Managerial and Technical Cohesiveness • Project Management Experience • Project Management Methods • Project Management Tools

Developmental Personnel Experience

• Development Personnel Functional Business Knowledge • Development Personnel Application Experience • Developmental Personnel Tool and Method Experience • Developmental Personnel Analysis and Design Experience • Development Personnel Programming and Language Experience • Developmental personnel hardware experience • Pre-Test Defect Removal Experience • Testing Defect Removal Experience

User Personnel

• User Personnel Functional Business Knowledge • User Personnel Experience with Software Projects • User Personnel Experience with Application Type • User Involvement During Requirements • User Personnel Involvement in Requirements Walkthroughs • User Involvement During Design Reviews • User Involvement During Acceptance Testing

Development Methods

• Type of Software Development Methodology Used • Consistency of Software Development Methodology Used • Experience Levels of Software Development Methodology Used • Requirements Clarity • Requirement Methods • Requirements Consistency • Prototyping Methods • Analysis Methods • Data Analysis Methods • System Development Methodology • Structured Estimating Methods • Consistent Estimating Methods



• Productivity Measurements

Quality Assurance Process • Design Defect Removal Training • Code Defect Removal Training • Pre-Test Defect Removal Training • Pre-Test Defect Removal Facilities • System Development Methodology • Testing Function • Testing Methods • Testing Training • Test Planning • Quality Assurance Function • Quality Assurance Process • Quality and Defect Measurement

Defect Removal Effectiveness

• Business Functionality Reviews • Defect Prevention Training • Non-Testing Defect Removal Training • Non-Testing Defect Removal Activities • Testing Defect Removal • Post- Release Defect Removal

Environment • Legal and Statutory Restrictions • Security Restrictions • Product Performance or Execution Speed Restrictions • Functional Novelty • Individual Office Environment • Office Noise and Interruption Environment • Development Geography • Number of Development Locations • Multiple Languages (spoken languages)

Project Risk

• Risk of staff turnover and attrition • Risk of management disagreements • Risk of high project novelty • Risk of unstable user requirements • Risk of change in project architecture • Risk of inadequate processing speed. • Risk of poor quality and reliability • Risk of significant usability problems



• Risk of schedule overruns • Risk of cost overruns • Risk of insufficient project staffing • Risk of insufficient project skill levels • Risk of excessive schedule pressures

Project Value

• Competitive Pressures • Project is mandatory due to law or regulatory policy • Value to human life or safety • Value to security or national defense • Value to morale and human relations • Value to Enterprise prestige • Value to competitive advantage • Value to market share • Value to quality and reliability • Value to direct revenues from project • Value to indirect revenues from project • Value to enterprise strategic plans • Value to enterprise operating costs • Value to enterprise operation speed • Value to future projects

Communication Effectiveness

• Communication of project information • Formal communication method • Effectiveness of “grapevine” • Employment security

Responsibility Clarity

• Requirements Standards • Roles and Responsibility • Clarity • Requirements process consistency

software metrics training additional handouts

Documents