166 - ISBSG variables most frequently used for software effort estimation: A mapping review
0 likes402 views
The document examines the use of ISBSG variables for software effort estimation from 2000 to 2013, analyzing data from 167 papers, of which 133 produced effort estimates and 107 listed independent variables. It identifies that out of 118 ISBSG variables, 71 were utilized, and emphasizes the impact of missing values on the relevance and usage of these variables. The findings provide a systematic mapping of the most frequently used variables and suggest guidelines for selecting them in future effort estimation models.
166 - ISBSG variables most frequently used for software effort estimation: A mapping review
- 1. ISBSG variables most frequently used for software effort estimation: A mapping review Fernando González-Ladrón-de-Guevara Marta Fernández-Diego
- 2. Introduction •The International Software Benchmarking Standards Group (ISBSG) is a non-profit organization that designed and maintains an international public repository. •This dataset makes it possible to estimate a project’s size, effort, duration, and cost. •It is important that ISBSG users have a sound knowledge of the ISBSG data prior to analyzing or using it. 2
- 3. Aim •Analyze the ISBSG variables that have been used by researchers for software effort estimation –from 2000, when the first papers were published –until the end of 2013 3
- 4. Research questions •RQ1: What are the most used variables to generate effort estimation models? •RQ2: What are the most relevant features of these variables? 4
- 7. Data collection •A systematic mapping study was applied to over 167 papers obtained after the filtering process. •133 out of 167 papers produce effort estimates. •Only 107 list the independent variables used in the model. 7
- 8. RQ1 •RQ1: What are the most used variables to generate effort estimation models? –ISBSG includes 118 variables but only 71 (60.2%) of them have been used in the set of papers analyzed. 8
- 9. RQ1: Frequency distribution of the ISBSG variables 9
- 10. RQ1: ISBSG variables most frequently used in the papers 10
- 11. RQ1 •RQ1: What are the most used variables to generate effort estimation models? –All ISBSG variables form part of a group of variables that include related data fields according to the ISBSG criteria. 11
- 12. RQ1: The ISBSG groups of variables 12
- 13. RQ2 •RQ2: What are the most relevant features of these variables? –This work has also synthesized and described the most used ISBSG variables, the concept they represent and their relationships. –Also this paper discusses the nature of the variables and has placed particular emphasis on their properties, specially the issue of missing data. 13
- 14. RQ2: Most frequently used nominal variables 14
- 15. RQ2 (nominal variables) •RQ2: What are the most relevant features of these variables? –The more missing values a variable has, the less used this variable is when compared to the rest of variables within its own group. –Usually LT is most used than PPL except for cases where more information about the specific used programming language is required. –The variables OT, AT, and BAT present many different discrete values. 15
- 16. RQ2: Most frequently used continuous variables 16
- 17. RQ2 (continuous variables) •RQ2: What are the most relevant features of these variables? –FS is preferred to AFP. –The group Size attributes includes five fields that breakdown the FS into inputs, outputs, enquiries, files, and interfaces. The percentage of missing values is around 65% in all cases. –The reason ATS may not be used more is because it has a high number of missing values (88%). 17
- 18. Results •A collection of 107 selected references •A matrix that shows a mapping of the 20 top- ranked most used variables in the estimation models of such references •The 71 ISBSG variables that have been used to construct effort estimation models •The 20 most used variables have been described arranged by groups along with their relationships and some underlying dependencies 18
- 19. Conclusions •This work presents the results of a systematic mapping study about the usage of ISBSG variables until 2013. •The analysis is a first approximation to how and to what extent ISBSG variables and groups of variables have been used in software engineering to build effort estimation models. •New RQ: How the level of usage of the most frequent variables is influenced by the type of estimation methods that have been used in the papers? –The paper under review even suggests a prospective guide for selecting the variables to be used in effort estimation models. 19
- 20. Thanks for your attention! Any question? 20