Download - software
Second Progress PresentationOn
Test Effort Estimation In Regression Testing
Presented By: Supervisor:Abhilasha, Mr. Ashish Sharma,M. Tech, Department of CEA,Enroll :118150001. GLA university.
04/12/2023 2
Outline
Problem Statement Literature review Critical Analysis Conclusion References
04/12/2023 3
Problem Statement:
“Test Effort Estimation In Regression Testing”
04/12/2023 4
Literature review
The research work is formulated in two modules :
-Test Effort Estimation-Regression Testing
04/12/2023 5
Module I :Test Effort Estimation
• Test effort estimation is the estimation of the testing size, testing cost and testing schedule for a specified software test project by defined methods, tools and techniques[1].
• The test effort is defined as the sum of the effort spent on test activity and the effort spent on debug activity [2].
04/12/2023 6
Literature Review
Paper#1Title: Test Effort Estimation Models Based On Test Specifications
Author: Eduardo Aranha,and Paulo Borba, IEEE Testing: Academic and Industrial Conference - Practice And Research Technique,pp.67-71,2007.
Proposal
In this paper, a test execution and a test automation effort estimation model are discussed.
04/12/2023 7
Literature Review…
Methodology Strength Weakness
Test effort estimation model
Reducing ambiguity. Here difficult to evaluate team capacity .
This paper gives an idea how to estimate test effort of test suite.
04/12/2023 8
Literature Review…
Paper # 02Title: Software Test Effort Estimation Author: D.S.Kushwaha and A.K.Misra, ACM SIGSOFT Software Engineering Notes, vol.33,no.3,pp.1-6,2008.
Proposal
In this paper proposed approach is for software test effort estimation.
04/12/2023 9
Literature Review…
Methodology Strength weakness
CICM(Cognitive Information Complexity Measure)
CICM is a more robust metric and estimating the software testing effort.
Not use for large project.
In this paper CICM can be used as a tool to estimate the test effort when a new component is added to existing software.
04/12/2023 10
Literature Review…
Paper#3Title: An Experience-Based Approach For Test Execution Effort Estimation
Author: X.Zhu, B. Zhou, L.Hou, J.Chen and Lu Chen,IEEE The 9th International Conference for Young Computer Scientists,pp.1193-1198,2008.
Proposal
This paper characterize a test suite as a 3-dimensions vector.
04/12/2023 11
Literature Review…
Methodology Strength Weakness
Test Suite Execution Vector Low costNot Predict Test Case Number from early time based in requirements.
In this paper estimating test execution effort for both new tests and regression tests.
04/12/2023 12
Literature Review…
Paper#4Title: Software Testing Effort: An Assessment Through Fuzzy Criteria Approach
Author: P. R.Srivastava, S.Kumar, A.P. Singh and G.Raghurama ,Journal of Uncertain Systems,vol.5,no.3,pp.183-201,2011.
Proposal
This paper makes an attempt to estimate software testing effort using fuzzy logic.
04/12/2023 13
Methodology Strength Weakness
Fuzzy logicBy this process software testing efforts can be evaluated more accurately
Determining of fuzzy rules which depends on the experience of the decision maker.
In this paper test driven are used which are useful for test effort estimation.
Literature Review…
04/12/2023 14
Literature Review…Paper#5Title: Applying Requirement Based Complexity For The Estimation Of Software Development And Testing Effort.
Author: A.Sharma and D.S.Kushwaha ,Computer Science & Information Technology, pp.393–415, 2012.
Proposal
This paper presents a systematic and an integrated approach for the estimation of software development and testing effort on the basis of improved requirement based complexity (IRBC) of the proposed software.
04/12/2023 15
Literature Review…
Methodology Strength Weakness
RBTEE(Requirement based test effort estimate )
Reducing rework by delivering maximum coverage with minimum number of test cases for improving the testeffectiveness.
If the result of IRBC is incorrect than RBTEE estimation also produce incorrect result.
This paper gives an idea How to estimate test effort on the basis of requirement.
04/12/2023 16
Parameters of evaluation
Test Effort Estimation Models Based on Test Specification[1]
Software Test Effort Estimation [2]
An Experience-Based Approach for Test Execution Effort Estimation[3]
Software Testing Effort: An Assessment ThroughFuzzy Criteria Approach[4]
Applying Requirement BasedComplexity For The Estimation Of Software Development And Testing Effort[5]
LOC less more less more more
Requirement no no no yes yes
Time high medium high high low
Cost high medium high high less
Critical analysis of test effort estimation
04/12/2023 17
Module:2 Regression testing
“Regression testing is an important and necessary activity that can maintain the quality of modified software”[8].
“Regression testing detecting newly introduced faults in modified software, is
an expensive part of the software maintenance process”[9].
04/12/2023 18
Literature Review
Paper#(1)Title: Code Coverage Based Technique For Prioritizing Test Cases For Regression Testing
Author: K.K.Aggrawal, Y.Singh and A.Kaur, ACM SIGSOFT Software Engineering Notes , vol.29 ,no.5,pp.1-4,2004.
proposal
In this paper discussed, A model that achieves 100% code coverage optimally during regression testing.
04/12/2023 19
Literature Review…
Methodology Strength Weakness
Code coverage basedIt save the cost and effort by removing extra test cases.
Use literature for test case prioritization.
This paper gives an idea of test case prioritization which is technique of regression testing.
04/12/2023 20
Literature Review…Paper#(2)Title: Historical Value-Based Approach for Cost-cognizant Test Case Prioritization To Improve The Effectiveness Of Regression Testing.
Author: H.Park, H.Ryu and J.Baik, IEEE The Second International Conference on Secure
System Integration And Reliability Improvement ,pp.39-46,2008.
Proposal
In this paper authors proposed the Historical Value-Based Approach.
04/12/2023 21
Literature Review…
Methodology Strength weakness
HVBA (Historical value based approach)
Useful and effective Only give priority for test case not for fault severity.
04/12/2023 22
Literature Review…
Paper#(3)Title: Automating Regression Test Selection Based On UML Designs
Author: Automating regression test selection based on UML designs , Information and Software Technology, pp.16-30, 2009.
Proposal
In this paper author proposes a formal mapping between design changes and a classification of regression test cases.
04/12/2023 23
Literature Review…
Methodology Strength Weakness
UML tool to track the regression test selection at architecture level.
Higher efficiency in test selection
UML design information ,test selection may not be precise as it was detailed code analysis.
04/12/2023 24
Literature Review…
Paper#(4)Title: A Hybrid Approach For Regression Testing In Interprocedural Program
Author: Y.Singh, A.Kaur and B.Suri, Journal of Information Processing Systems, Vol.6, No.1,pp.22-32,2010.
Proposal
The proposed hybrid approach is based on the selection and prioritization of the test cases.
04/12/2023 25
Literature Review…
Methodology Strength
Weakness
Hybrid approach Produce less no of test case Not build the new test case.
04/12/2023 26
Literature Review…
Paper#(v)Title: Spectrum-Based Fault Localization in Regression Testing
Author: S.Tiwari. K. K. Mishra, A.Kumar and A.K. Misra, Eighth International Conference
on Information Technology: New Generations IEEE,pp.191-195,2011.
proposal
This paper addresses the fundamental limitations of conventional regression testing approach.
04/12/2023 27
Literature Review…
Methodology Strength
Weakness
Spectrum-Based Fault Localization
Simple Oracle problem
04/12/2023 28
Critical Analysis Of Regression TestingParameters of evaluation
Code Coverage Based Technique For Prioritizing Test Cases For Regression Testing [1]
Historical Value-Based Approach for Cost-cognizant Test Case Prioritization to Improve theEffectiveness of Regression Testing[2]
Automating regression testselection based on UML designs[3]
A Hybrid Approach for Regression Testing in Interprocedural Program[4]
Spectrum-Based Fault Localization in Regression Testing[5]
Time Medium Medium Low High Low
Cost Medium Medium Low High Low
complexity Less High Less High Less
04/12/2023 29
Conclusion
• Methods discussed are based on test effort estimation and regression testing.
• We will work on the approach for regression test selection which is a technique of regression testing.
04/12/2023 30
References
[1] O.Mizuno,E.Shigematsu ,Y.Takagi, and T.Kikuno “On Estimating Testing Effort Needed to Assure Field Quality in Software Development” IEEE Proceedings of the 13 the International Symposium on Software Reliability Engineering , vol. 54, no. 2, pp.1-8, 2002.
[2] E.Aranha and P.Borba “Test Effort Estimation Models Based on Test Specifications” , IEEETesting: Academic and Industrial Conference - Practice And Research Techniques ,pp.67-71,2007.
[3] D.S.Kushwaha and A.K.Misra “ Software Test Effort Estimation ”, ACM SIGSOFT Software Engineering Notes, vol.33 ,no.3,pp.1-6,2008.
[4] X.Zhu, B. Zhou, L.Hou, J.Chen and Lu Chen “An Experience-Based Approach for Test Execution Effort Estimation”, IEEE The 9th International Conference for Young Computer Scientists ,pp.1193-1198,2008.
[5] P. R.Srivastava, S.Kumar, A.P. Singh and G.Raghurama “Software Testing Effort: An Assessment Through Fuzzy Criteria Approach”, Journal of Uncertain Systems ,vol.5, no.3, pp.183-201,2011.
[6].A. Sharma and D.S.Kushwaha “Applying Requirement Based Complexity For The Estimation Of Software Development And Testing Effort", Computer Science & Information Technology ,pp. 393–415,2012.
[7]Y.C.Huangc ,K.L.Pengaand and C.Y. Huanga,b “A history-based cost-cognizant test case prioritization technique in regression Testing” ,The Journal of Systems and Software 85 , vol.05,no.02,pp.626– 637,2012.
[8] Xiao Qu “Configuration Aware Prioritization Techniques in Regression Testing ”,Indian Computer Education Society,vol. 42,no.6,pp.1-4,2009.
04/12/2023 31
References
[9] K.K.Aggrawal, Y.Singh and A.Kaur “Code Coverage Based Technique For Prioritizing Test Cases For Regression Testing ” ,ACM SIGSOFT Software Engineering Notes , vol.29 ,no. 5,pp.1-4,2004. [11] H.Park, H.Ryu and J.Baik“Historical Value-Based Approach for Cost-cognizant Test Case Prioritization to Improve the Effectiveness of Regression Testing”,IEEEThe Second International Conference on Secure
System Integration and Reliability Improvement IEEE,pp.39-46,2008.[10] L.C. Briand,Y. Labiche,and S. Hea “Automating regression test selection based on UML designs ”
Information and Software Technology,pp.16-30,2009[12] Y.Singh, A.Kaur and B.Suri “A Hybrid Approach for Regression Testing in Interprocedural” Program
Journal of Information Processing Systems ,vol.6, no.1,pp.22-32,2010[13] S.Tiwari. K. K. Mishra, A.Kumar and A.K. Misra “ Spectrum-Based Fault Localization in Regression
Test”,IEEE Eighth International Conference on Information Technology: New Generations ,pp.191-195,2011.