SlideShare a Scribd company logo

AN AUTOMATED APPROACH TO ASSIGN SOFTWARE CHANGE REQUESTS (Ph.D. Presentation)

Y
yguarata

This document summarizes a Ph.D. thesis on an automated approach to assign software change requests. It begins with an introduction to change management and change requests in software development. It then discusses the importance of properly assigning change requests and the challenges of doing so manually at scale. The document outlines the research objective to propose an automated approach using information retrieval models and rule-based expert systems. It also describes conducting a literature review, survey, experiment, and conclusions. The literature review involves a systematic mapping study to classify current challenges and tools. The survey aims to understand the time and complexity of current manual assignment strategies.

Software
Related topics:
Software Engineering
1 of 64
Downloaded 15 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
An Automated Approach to Assign Software Change Requests Ph.D. Thesis Yguarat˜a Cerqueira Cavalcanti Centro de Inform´atica – UFPE March 20, 2014
Agenda 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Change Management Every software project changes (1st Lehman’s law) user needs defects new functionalities Changes are made during software development or after release (software maintenance and evolution) Changes need to be managed, instead you lose control component versions software versions (different clients) 1/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Change Requests (CRs) CR describes a defect to be fixed, an adaptive or perfective change, or a new functionality. CRs are stored and managed through CR Repositories. 2/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions CR Assignment 3/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project However, dozens to hundreds CRs daily 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project However, dozens to hundreds CRs daily Labor-intensive and time consuming Susceptible to mistakes 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project However, dozens to hundreds CRs daily Labor-intensive and time consuming Susceptible to mistakes 37%-44% of CRs did not reach the right developer Reassignments (rework!) 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Objective To propose an automated approach for CR assignment Information Retrieval (IR) models Rule-based expert systems Context-aware information 5/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Methodology 6/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Systematic Mapping Study The process 1 Research questions 2 Searches in the literature (protocol) 3 Selection of papers, tools, and services 4 Classification (two schemes) 5 Analysis and synthesis of the results 7/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Questions Defined two questions for the mapping study 8/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Questions Defined two questions for the mapping study Question 1 – What are the current challenges and opportunities regarding CR repositories and how do they impact software development? 8/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Questions Defined two questions for the mapping study Question 1 – What are the current challenges and opportunities regarding CR repositories and how do they impact software development? Question 02 – Do the tools and online services for CR management address any of the challenges pointed out as a result of the answers to Question 01? If so, how do they address such challenges? 8/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Criteria Inclusion: Theory, practice, and approaches CR artifacts written in natural language Unique studies Exclusion: summaries of tutorial or workshop posters keynotes studies with no scientific analysis studies published in unknown sources 9/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Searches SEARCH ENGINES Automated: Google, ACM, IEEE, Citeseer, Elsevier, Scirus, ScienceDirect, Scopus, ISI, SpringerLink, and Wiley Manual: DBLP KEYWORDS Bug report, change request, modification request, defect track, software issue, bug tracking STUDIES SELECTION 1150 → superficial reading → 321 → full reading → 142 10/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Tools Selection and Analysis Tools Online Services Bugzilla http://www.bugzilla.org SourceForge http://www.sourceforge.net MantisBT http://www.mantisbt.org Launchpad http://www.launchpad.net Trac http://trac.edgewall.org Code Plex http://www.codeplex.com Redmine http://www.redmine.org Google Code http://code.google.com Jira http://www.atlassian.com GitHub http://www.github.com Do they address any of the challenges? How? 11/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Classification Schemes Classification Scheme 1: created a taxonomy for Research areas and topics Classification Scheme 2: used a taxonomy for Information Retrieval models 12/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Classification Scheme 1 Taxonomy for Challenges and Opportunities 13/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Classification Scheme 2 Information Retrieval (IR) Taxonomy Representation Reasoning Repository Query Document With logic With uncer- tainty With learning CRs(e.g.Bugzilla) CommitLog(e.g.CVS,SVN) SourceCode Keyword-based Pattern-based Structural StreamofCharacters VectorSpace Structural Logic Algebra GraphTheories ProbabilityTheories FuzzySetTheories NeuralNetwork SymbolicLearning SupportVectorMachines DecisionTrees/Table LazyLearning BayesianStatistics GeneticAlgorithms RegressionAnalysis LearntoRank Table: Taxonomy for the classification of the IR models and techniques used in each approach. This is an extension of the taxonomy created by Canfora and Cerulo [1]. 14/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Concluding Remarks from the Review Automated and Semi-Automated approaches for CR challenges Combinations of software repositories Possibility of mixing up the approaches Lack of contextual information in the approaches I.e.: CR assignment needs workload, developer knowledge, priority, and politics issues Difficulty in assessing the approaches State-of-the-art still far from the state-of-the-practice 15/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Survey’s Research Questions RQ1. How much time does the CR Assignment activities take? (amount of CRs, individual time, and reassignments) RQ2. What are the strategies used to assign CRs to the appropriate developers? RQ3. What is the complexity involved in assigning CRs to developers? 16/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Questionnaire 38 questions 8 open-ended 30 closed-ended (most Likert-scaled) 17/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Questionnaire 38 questions 8 open-ended 30 closed-ended (most Likert-scaled) Three steps validation 17/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Population Sample Around 400 software developers from Brazilian Federal Organization for Data Processing (SERPRO) From three main sites in the south of Brazil Porto Alegre, Florian´opolis, and Curitiba 18/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Responses Periodically remainder emails 38 responses out of 400 (9%) Is it enough? Yes! In SERPRO, project leaders and managers are likely to have the desired profile 19/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Data Analysis I RQ1. How much time does a CR assignment take? It is common to assign almost 20 CRs per day Each CR takes around 5 to 10 minutes to be assigned Reassigning CRs is not so frequent in the SERPRO organization 20 CRs ∗ 10 min = 3.3 hours (per developer/day) Plus reassignments (±10 minutes) For bigger projects and open source it gets worse 20/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Data Analysis II RQ2. What are the strategies used to assign CRs? 1 Consider workload 2 Severity and criticality 3 Talk to developers before assignment 4 Select developers with more familiarity on the problem 5 Select developers who have solved similar CRs 6 Developers with better knowledge on the project 7 Developers who master the tools 8 Affinity 21/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Data Analysis III RQ3. What is the complexity involved in assigning CRs? According to the strategies, CR assignments require: Good knowledge on the project(s) The ability of communicating to other people The ability of information seeking in different repositories The capability to retain the knowledge that is acquired during this cognitive process Assign CRs to different teams Assign CRs to different projects 22/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Survey Replication Application of the same survey design Dataprev Instituto Recˆoncavo de Tecnologia (IRT) Confirmation of initial results 23/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions The Solution An Automated Approach to Assign Software Change Requests 24/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Requirements CRs must be assigned according to their severity and criticality workload of developers developers experience interpersonal relationships rely on contextual information (software repositories) 25/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Strategy to Automated CR Assignment 26/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Rule-Based Expert System (RBES) rule "Critical CRs, or CRs for module C" when $cr: ChangeRequest (severity == CRITICAL || module =="C") then $cr.assignTo(developer(" johndoe@fakedev .com")) end rule "Change Requests for modules A and B" when $cr: ChangeRequest (module =="A" || module =="B") then $cr.assignTo( availableDeveloper (Workload.WEIGHTED )) end 27/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Information Retrieval Model With Learning Support Vector Machine (SVM) Training (Black arrows) Recommendation (Gray arrows) 10-fold cross-validation 28/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Questions Q1: What is the accuracy of the proposed approach for automated CR assignment? Q2: What is the necessary effort to setup the approach in a software development project? Q3: Does the achieved accuracy pay the necessary effort needed in the setup? 29/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Experiment Design Proposed approach versus pure SVM Proposed approach: SVM, expert system and context 30/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Experiment Design Proposed approach versus pure SVM Proposed approach: SVM, expert system and context 30/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Hypotheses Null Hypothesis H0: µ(accuracy with our approach) <= µ(accuracy with SVM) µ(payoff with our approach) <= µ(payoff with SVM) 31/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Hypotheses Null Hypothesis H0: µ(accuracy with our approach) <= µ(accuracy with SVM) µ(payoff with our approach) <= µ(payoff with SVM) Alternative Hypothesis H1: µ(accuracy with our approach) > µ(accuracy with SVM) µ(payoff with our approach) > µ(payoff with SVM) 31/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Testing dataset CRs from two modules of Novo SIAFI project (SERPRO) Module A = 781 CRs Module B = 1031 CRs 32/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Context information Assignment strategy configuration 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Interviews with 4 workers and analysis of CR samples Total of 14 rules Context information Assignment strategy configuration 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Interviews with 4 workers and analysis of CR samples Total of 14 rules Context information developers vacation developers project allocation developers experience Assignment strategy configuration 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Interviews with 4 workers and analysis of CR samples Total of 14 rules Context information developers vacation developers project allocation developers experience Assignment strategy configuration 1 execute simple rules 2 execute complex rules 3 SVM (instead of manual assignment) 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Results I Q1. What is the accuracy of the proposed approach for automated CR assignment? New approach: Module A = 45% and Module B = 34% SVM: Module A = 38% and Module B = 23% An improvement of 18% on Module A and 48% on B Null hypothesis refuted 34/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Results II Q2. What is the necessary effort to setup the approach in a software development project? 38 hours (rule extraction, context information, strategy) Q3. Does the achieved accuracy pay the necessary effort needed in the setup? 10 minutes for each CR assigned SVM saved 89 hours New approach saved 117 hours Economy of 28 hours vs. 38 hours for setup Null hypothesis not refuted (for this context!) 35/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Threats to the Validity Generalization of the results (only CRs from one project) Variety of metrics (Precision, Recall, and F-measure) SVM learning process (quality of text data) Difficult to assess the configuration time (trial and error for rules extraction) Implementation of the approach (bug-free?) 36/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Conclusions I Research Contribution Mapping study on CR repositories investigation Questionnaire-based survey with practitioners An approach for automated CR assignment Validation of the approach Tools Prototype and plugins Test bed for new research 37/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Conclusions II Academic Contributions Cavalcanti, Y. C., Neto, P. A. D. M. S., Machado, I. D. C., de Almeida, E. S., and de Lemos Meira, S. R. (2013b). Towards Understanding Software Change Request Assignment: A survey with practitioners. In Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering (EASE’2013), pages 195–206 Cavalcanti, Y. C., da Mota Silveira Neto, P. A., do Carmo Machado, I., Vale, T. F., de Almeida, E. S., and de Lemos Meira, S. R. (2013a). Challenges and Opportunities for Software Change Request Repositories: a systematic mapping study. Journal of Software: Evolution and Process. Online first More publications are under work: CBSoft’2014 tool session, ICSME’2014, JSEP journal 38/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Conclusions III Future work Investigate new algorithms for workload balancing Investigate methods and techniques for automatic extraction of assignment rules Perform new experimental studies Address other issues of CR management 39/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
An Automated Approach to Assign Software Change Requests Ph.D. Thesis Yguarat˜a Cerqueira Cavalcanti Centro de Inform´atica – UFPE March 20, 2014
References Lotka’s Law Few developers fix the most of CRs 1/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
References The Problem’s Characteristics There are complex factors which influence CR assignment Factors vary from one organization to another Such as developers’ workload, CRs attributes, interpersonal relationships, and developers know-how Consider different rules for the assignments Thus, automated approaches should be context-aware 2/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
References Component Diagram of the Solution 3/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
References Prototype Tool Architecture 4/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
References References I [1] Canfora, G. and Cerulo, L. (2004). A taxonomy of information retrieval models and tools. Computing and Information Technology, 12(3), 175–194. [2] Cavalcanti, Y. C., da Mota Silveira Neto, P. A., do Carmo Machado, I., Vale, T. F., de Almeida, E. S., and de Lemos Meira, S. R. (2013a). Challenges and Opportunities for Software Change Request Repositories: a systematic mapping study. Journal of Software: Evolution and Process. Online first. [3] Cavalcanti, Y. C., Neto, P. A. D. M. S., Machado, I. D. C., de Almeida, E. S., and de Lemos Meira, S. R. (2013b). Towards Understanding Software Change Request Assignment: A survey with practitioners. In Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering (EASE’2013), pages 195–206. 5/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests

More Related Content

PDF
Apresentação TCC - Engenharia de Produção (2016)
Diego Stedile
 
PDF
06 - TERMINOLOGIA DE SOLDAGEM.pdf
julianocorrea17
 
PDF
Apostila completa desenho tecnico mecânico senai
marello2011
 
PPTX
eeMba ii rm unit-3.1 measurement & scaling a
Rai University
 
PPT
Sinalízação Viária
Ivan Roberto
 
PDF
Simbologia
Tuane Paixão
 
PDF
Simbologia fluxograma processo
Vismael Santos
 
PPT
Metrologia
Caio César
 
Apresentação TCC - Engenharia de Produção (2016)
Diego Stedile
 
06 - TERMINOLOGIA DE SOLDAGEM.pdf
julianocorrea17
 
Apostila completa desenho tecnico mecânico senai
marello2011
 
eeMba ii rm unit-3.1 measurement & scaling a
Rai University
 
Sinalízação Viária
Ivan Roberto
 
Simbologia
Tuane Paixão
 
Simbologia fluxograma processo
Vismael Santos
 
Metrologia
Caio César
 

Viewers also liked (20)

PPTX
PIERS Specialty Chemicals 2013 - Insights from Trade Data
UBMGT PIERS
 
PDF
RPP corporation brochure
Michael Audy
 
PDF
Proyecto escuelas sustentables EDOMEX
clocsc
 
PDF
Programacion octubre Escuela de Innovación para el Comercio (Vivero de Empres...
Escuela de Innovación para el Comercio
 
PDF
Catalogue of Nano Companies in Spain 2016
Phantoms Foundation
 
PDF
北陸エンジニアず　自己紹介資料
Yuuki Kojima
 
PDF
Selex ES @ Innovation Lab 2014-Smart Energy Innovation
Leonardo
 
PPTX
Nancy patricia quevedo ruiz
patriciaquevedoudes
 
PDF
Catálogo mobiliario (n)oriental
Sámago Uruguay
 
PDF
IDF News From the Front: What our Soldiers Did in May 2013
IsraelDefenseForces
 
PDF
Escuela 95 EspañA Dic2009
Angela Behrendt, PhD
 
DOCX
Dispositivo modificación. abriendo caminos1
Bruno Ferreyra
 
PDF
SEAT Winter 2011
Jared Frank
 
PDF
valoracion impactos ambientales
Angela María Zapata Guzmán
 
PPT
Palotai - Maszlik - "Kevesebből többet" - az MTM és a Lean együttműködése a R...
mtmhu
 
PPTX
Teaching practice of ICT student teachers
MirkaCernochova
 
DOCX
Red Bull ONE FINAL PAPER
Ryan Castro
 
PDF
Plc 20013
Alejandro Ezequiel Nicolini
 
PDF
CONFERENCIA ESPAITEC-UJI: APLICACIÓN DE LAS TECNOLOGÍAS WEB 2.0, REDES SOCIAL...
Santiago Bonet
 
PDF
The Bionic City by Melissa Sterry. Published September 2011.
Melissa Sterry
 
PIERS Specialty Chemicals 2013 - Insights from Trade Data
UBMGT PIERS
 
RPP corporation brochure
Michael Audy
 
Proyecto escuelas sustentables EDOMEX
clocsc
 
Programacion octubre Escuela de Innovación para el Comercio (Vivero de Empres...
Escuela de Innovación para el Comercio
 
Catalogue of Nano Companies in Spain 2016
Phantoms Foundation
 
北陸エンジニアず　自己紹介資料
Yuuki Kojima
 
Selex ES @ Innovation Lab 2014-Smart Energy Innovation
Leonardo
 
Nancy patricia quevedo ruiz
patriciaquevedoudes
 
Catálogo mobiliario (n)oriental
Sámago Uruguay
 
IDF News From the Front: What our Soldiers Did in May 2013
IsraelDefenseForces
 
Escuela 95 EspañA Dic2009
Angela Behrendt, PhD
 
Dispositivo modificación. abriendo caminos1
Bruno Ferreyra
 
SEAT Winter 2011
Jared Frank
 
valoracion impactos ambientales
Angela María Zapata Guzmán
 
Palotai - Maszlik - "Kevesebből többet" - az MTM és a Lean együttműködése a R...
mtmhu
 
Teaching practice of ICT student teachers
MirkaCernochova
 
Red Bull ONE FINAL PAPER
Ryan Castro
 
Plc 20013
Alejandro Ezequiel Nicolini
 
CONFERENCIA ESPAITEC-UJI: APLICACIÓN DE LAS TECNOLOGÍAS WEB 2.0, REDES SOCIAL...
Santiago Bonet
 
The Bionic City by Melissa Sterry. Published September 2011.
Melissa Sterry
 
Ad

Similar to AN AUTOMATED APPROACH TO ASSIGN SOFTWARE CHANGE REQUESTS (Ph.D. Presentation) (20)

PDF
Combining Rule-based and Information Retrieval Techniques to assign Software ...
yguarata
 
PDF
Introduction to Software Engineering 2nd Edition Ronald J. Leach
vkidxnph0314
 
PDF
Introduction to Software Engineering 2nd Edition Ronald J. Leach
brohmqklenes9
 
PPTX
Slcm sharbani bhattacharya
Sharbani Bhattacharya
 
PPT
Prov4J: A Semantic Web Framework for Generic Provenance Management
Andre Freitas
 
PDF
A Method for Evaluating End-User Development Technologies
Claudia Melo
 
PDF
Introduction to software engineering Second Edition Leach
rachoraimilj
 
PDF
Designing A Waterfall Approach For Software Development Essay
Alison Reed
 
PPT
RapidRma
CS, NcState
 
PPTX
Sdpl1
sraviinthiran
 
PPTX
reverse engineering and applications and approaches
OweziemBright
 
PDF
Modern Elicitation Process
Rajon
 
PDF
An exploratory study of the state of practice of performance testing in Java-...
corpaulbezemer
 
PDF
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
Spark Summit
 
PPT
Cochrane Collaboration - Register of Studies Consultation
Cochrane.Collaboration
 
PPTX
Week1.pptx
MarriamNawaz
 
PPTX
Software Engineering concept
Atamjitsingh92
 
PPTX
The process
prakashvs7
 
PDF
A Comparative Study of Software Requirement, Elicitation, Prioritization and ...
IJERA Editor
 
PDF
Agile Testing 2020
arzu TR
 
Combining Rule-based and Information Retrieval Techniques to assign Software ...
yguarata
 
Introduction to Software Engineering 2nd Edition Ronald J. Leach
vkidxnph0314
 
Introduction to Software Engineering 2nd Edition Ronald J. Leach
brohmqklenes9
 
Slcm sharbani bhattacharya
Sharbani Bhattacharya
 
Prov4J: A Semantic Web Framework for Generic Provenance Management
Andre Freitas
 
A Method for Evaluating End-User Development Technologies
Claudia Melo
 
Introduction to software engineering Second Edition Leach
rachoraimilj
 
Designing A Waterfall Approach For Software Development Essay
Alison Reed
 
RapidRma
CS, NcState
 
Sdpl1
sraviinthiran
 
reverse engineering and applications and approaches
OweziemBright
 
Modern Elicitation Process
Rajon
 
An exploratory study of the state of practice of performance testing in Java-...
corpaulbezemer
 
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
Spark Summit
 
Cochrane Collaboration - Register of Studies Consultation
Cochrane.Collaboration
 
Week1.pptx
MarriamNawaz
 
Software Engineering concept
Atamjitsingh92
 
The process
prakashvs7
 
A Comparative Study of Software Requirement, Elicitation, Prioritization and ...
IJERA Editor
 
Agile Testing 2020
arzu TR
 
Ad

Recently uploaded (20)

DOCX
Modern SharePoint Intranet Templates That Boost Employee Engagement in 2025.docx
Sharepoint Designs
 
PPTX
assetexplorer- product-overview - presentation
nonameist3434
 
PDF
EaseUS PDF Editor Pro 6.2.0.2 Crack with License Key 2025
halimaanam8
 
PDF
Multiverse AI Review 2025: Access All TOP AI Model-Versions!
Moshiur Rahman Jisan
 
PPTX
"Secure File Sharing Solutions on AWS".pptx
sudharani74442
 
PDF
Types of Token_ From Utility to Security.pdf
Herond Labs
 
PDF
How to Make Money in the Metaverse_ Top Strategies for Beginners.pdf
Herond Labs
 
PPTX
Computer Software - Technology and Livelihood Education
ShielaGuevarra6
 
PPTX
Computer Software and OS of computer science of grade 11.pptx
GauravDahal9
 
PPTX
AMADEUS TRAVEL AGENT SOFTWARE | AMADEUS TICKETING SYSTEM
philipnathen82
 
PDF
How AI/LLM recommend to you ? GDG meetup 16 Aug by Fariman Guliev
HusseinMalikMammadli
 
PPTX
Tech Workshop Escape Room Tech Workshop
muthuiyad
 
PPTX
CNN LeNet5 Architecture: Neural Networks
DrRPonnusamyCIT
 
PPTX
Log360_SIEM_Solutions Overview PPT_Feb 2020.pptx
nonameist3434
 
PPTX
GSA Content Generator Crack (2025 Latest)
halimaanam8
 
PDF
DNT Brochure 2025 – ISV Solutions @ D365
sai vignesh
 
PDF
Visual explanation of Dijkstra's Algorithm using Python
Universidad Nacional de Ingenieria
 
PDF
iTop VPN Crack Latest Version Full Key 2025
hashmianya37
 
PPTX
WiFi Honeypot Detecscfddssdffsedfseztor.pptx
singlesrihari
 
PDF
The Dynamic Duo Transforming Financial Accounting Systems Through Modern Expe...
Triforce Global
 
Modern SharePoint Intranet Templates That Boost Employee Engagement in 2025.docx
Sharepoint Designs
 
assetexplorer- product-overview - presentation
nonameist3434
 
EaseUS PDF Editor Pro 6.2.0.2 Crack with License Key 2025
halimaanam8
 
Multiverse AI Review 2025: Access All TOP AI Model-Versions!
Moshiur Rahman Jisan
 
"Secure File Sharing Solutions on AWS".pptx
sudharani74442
 
Types of Token_ From Utility to Security.pdf
Herond Labs
 
How to Make Money in the Metaverse_ Top Strategies for Beginners.pdf
Herond Labs
 
Computer Software - Technology and Livelihood Education
ShielaGuevarra6
 
Computer Software and OS of computer science of grade 11.pptx
GauravDahal9
 
AMADEUS TRAVEL AGENT SOFTWARE | AMADEUS TICKETING SYSTEM
philipnathen82
 
How AI/LLM recommend to you ? GDG meetup 16 Aug by Fariman Guliev
HusseinMalikMammadli
 
Tech Workshop Escape Room Tech Workshop
muthuiyad
 
CNN LeNet5 Architecture: Neural Networks
DrRPonnusamyCIT
 
Log360_SIEM_Solutions Overview PPT_Feb 2020.pptx
nonameist3434
 
GSA Content Generator Crack (2025 Latest)
halimaanam8
 
DNT Brochure 2025 – ISV Solutions @ D365
sai vignesh
 
Visual explanation of Dijkstra's Algorithm using Python
Universidad Nacional de Ingenieria
 
iTop VPN Crack Latest Version Full Key 2025
hashmianya37
 
WiFi Honeypot Detecscfddssdffsedfseztor.pptx
singlesrihari
 
The Dynamic Duo Transforming Financial Accounting Systems Through Modern Expe...
Triforce Global
 

AN AUTOMATED APPROACH TO ASSIGN SOFTWARE CHANGE REQUESTS (Ph.D. Presentation)

  • 1. An Automated Approach to Assign Software Change Requests Ph.D. Thesis Yguarat˜a Cerqueira Cavalcanti Centro de Inform´atica – UFPE March 20, 2014
  • 2. Agenda 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 3. 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 4. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Change Management Every software project changes (1st Lehman’s law) user needs defects new functionalities Changes are made during software development or after release (software maintenance and evolution) Changes need to be managed, instead you lose control component versions software versions (different clients) 1/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 5. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Change Requests (CRs) CR describes a defect to be fixed, an adaptive or perfective change, or a new functionality. CRs are stored and managed through CR Repositories. 2/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 6. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions CR Assignment 3/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 7. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 8. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project However, dozens to hundreds CRs daily 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 9. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project However, dozens to hundreds CRs daily Labor-intensive and time consuming Susceptible to mistakes 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 10. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Why CR Assignment Matters? Select developers considering the low fixing time yet keeping satisfactory quality Needs good knowledge on the project However, dozens to hundreds CRs daily Labor-intensive and time consuming Susceptible to mistakes 37%-44% of CRs did not reach the right developer Reassignments (rework!) 4/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 11. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Objective To propose an automated approach for CR assignment Information Retrieval (IR) models Rule-based expert systems Context-aware information 5/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 12. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Methodology 6/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 13. 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 14. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Systematic Mapping Study The process 1 Research questions 2 Searches in the literature (protocol) 3 Selection of papers, tools, and services 4 Classification (two schemes) 5 Analysis and synthesis of the results 7/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 15. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Questions Defined two questions for the mapping study 8/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 16. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Questions Defined two questions for the mapping study Question 1 – What are the current challenges and opportunities regarding CR repositories and how do they impact software development? 8/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 17. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Research Questions Defined two questions for the mapping study Question 1 – What are the current challenges and opportunities regarding CR repositories and how do they impact software development? Question 02 – Do the tools and online services for CR management address any of the challenges pointed out as a result of the answers to Question 01? If so, how do they address such challenges? 8/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 18. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Criteria Inclusion: Theory, practice, and approaches CR artifacts written in natural language Unique studies Exclusion: summaries of tutorial or workshop posters keynotes studies with no scientific analysis studies published in unknown sources 9/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 19. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Searches SEARCH ENGINES Automated: Google, ACM, IEEE, Citeseer, Elsevier, Scirus, ScienceDirect, Scopus, ISI, SpringerLink, and Wiley Manual: DBLP KEYWORDS Bug report, change request, modification request, defect track, software issue, bug tracking STUDIES SELECTION 1150 → superficial reading → 321 → full reading → 142 10/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 20. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Tools Selection and Analysis Tools Online Services Bugzilla http://www.bugzilla.org SourceForge http://www.sourceforge.net MantisBT http://www.mantisbt.org Launchpad http://www.launchpad.net Trac http://trac.edgewall.org Code Plex http://www.codeplex.com Redmine http://www.redmine.org Google Code http://code.google.com Jira http://www.atlassian.com GitHub http://www.github.com Do they address any of the challenges? How? 11/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 21. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Classification Schemes Classification Scheme 1: created a taxonomy for Research areas and topics Classification Scheme 2: used a taxonomy for Information Retrieval models 12/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 22. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Classification Scheme 1 Taxonomy for Challenges and Opportunities 13/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 23. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Classification Scheme 2 Information Retrieval (IR) Taxonomy Representation Reasoning Repository Query Document With logic With uncer- tainty With learning CRs(e.g.Bugzilla) CommitLog(e.g.CVS,SVN) SourceCode Keyword-based Pattern-based Structural StreamofCharacters VectorSpace Structural Logic Algebra GraphTheories ProbabilityTheories FuzzySetTheories NeuralNetwork SymbolicLearning SupportVectorMachines DecisionTrees/Table LazyLearning BayesianStatistics GeneticAlgorithms RegressionAnalysis LearntoRank Table: Taxonomy for the classification of the IR models and techniques used in each approach. This is an extension of the taxonomy created by Canfora and Cerulo [1]. 14/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 24. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Concluding Remarks from the Review Automated and Semi-Automated approaches for CR challenges Combinations of software repositories Possibility of mixing up the approaches Lack of contextual information in the approaches I.e.: CR assignment needs workload, developer knowledge, priority, and politics issues Difficulty in assessing the approaches State-of-the-art still far from the state-of-the-practice 15/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 25. 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 26. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Survey’s Research Questions RQ1. How much time does the CR Assignment activities take? (amount of CRs, individual time, and reassignments) RQ2. What are the strategies used to assign CRs to the appropriate developers? RQ3. What is the complexity involved in assigning CRs to developers? 16/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 27. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Questionnaire 38 questions 8 open-ended 30 closed-ended (most Likert-scaled) 17/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 28. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Questionnaire 38 questions 8 open-ended 30 closed-ended (most Likert-scaled) Three steps validation 17/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 29. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Population Sample Around 400 software developers from Brazilian Federal Organization for Data Processing (SERPRO) From three main sites in the south of Brazil Porto Alegre, Florian´opolis, and Curitiba 18/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 30. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Responses Periodically remainder emails 38 responses out of 400 (9%) Is it enough? Yes! In SERPRO, project leaders and managers are likely to have the desired profile 19/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 31. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Data Analysis I RQ1. How much time does a CR assignment take? It is common to assign almost 20 CRs per day Each CR takes around 5 to 10 minutes to be assigned Reassigning CRs is not so frequent in the SERPRO organization 20 CRs ∗ 10 min = 3.3 hours (per developer/day) Plus reassignments (±10 minutes) For bigger projects and open source it gets worse 20/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 32. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Data Analysis II RQ2. What are the strategies used to assign CRs? 1 Consider workload 2 Severity and criticality 3 Talk to developers before assignment 4 Select developers with more familiarity on the problem 5 Select developers who have solved similar CRs 6 Developers with better knowledge on the project 7 Developers who master the tools 8 Affinity 21/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 33. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Data Analysis III RQ3. What is the complexity involved in assigning CRs? According to the strategies, CR assignments require: Good knowledge on the project(s) The ability of communicating to other people The ability of information seeking in different repositories The capability to retain the knowledge that is acquired during this cognitive process Assign CRs to different teams Assign CRs to different projects 22/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 34. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Survey Replication Application of the same survey design Dataprev Instituto Recˆoncavo de Tecnologia (IRT) Confirmation of initial results 23/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 35. 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 36. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions The Solution An Automated Approach to Assign Software Change Requests 24/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 37. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Requirements CRs must be assigned according to their severity and criticality workload of developers developers experience interpersonal relationships rely on contextual information (software repositories) 25/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 38. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Strategy to Automated CR Assignment 26/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 39. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Rule-Based Expert System (RBES) rule "Critical CRs, or CRs for module C" when $cr: ChangeRequest (severity == CRITICAL || module =="C") then $cr.assignTo(developer(" johndoe@fakedev .com")) end rule "Change Requests for modules A and B" when $cr: ChangeRequest (module =="A" || module =="B") then $cr.assignTo( availableDeveloper (Workload.WEIGHTED )) end 27/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 40. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Information Retrieval Model With Learning Support Vector Machine (SVM) Training (Black arrows) Recommendation (Gray arrows) 10-fold cross-validation 28/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 41. 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 42. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Questions Q1: What is the accuracy of the proposed approach for automated CR assignment? Q2: What is the necessary effort to setup the approach in a software development project? Q3: Does the achieved accuracy pay the necessary effort needed in the setup? 29/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 43. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Experiment Design Proposed approach versus pure SVM Proposed approach: SVM, expert system and context 30/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 44. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Experiment Design Proposed approach versus pure SVM Proposed approach: SVM, expert system and context 30/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 45. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Hypotheses Null Hypothesis H0: µ(accuracy with our approach) <= µ(accuracy with SVM) µ(payoff with our approach) <= µ(payoff with SVM) 31/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 46. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Hypotheses Null Hypothesis H0: µ(accuracy with our approach) <= µ(accuracy with SVM) µ(payoff with our approach) <= µ(payoff with SVM) Alternative Hypothesis H1: µ(accuracy with our approach) > µ(accuracy with SVM) µ(payoff with our approach) > µ(payoff with SVM) 31/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 47. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Testing dataset CRs from two modules of Novo SIAFI project (SERPRO) Module A = 781 CRs Module B = 1031 CRs 32/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 48. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Context information Assignment strategy configuration 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 49. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Interviews with 4 workers and analysis of CR samples Total of 14 rules Context information Assignment strategy configuration 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 50. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Interviews with 4 workers and analysis of CR samples Total of 14 rules Context information developers vacation developers project allocation developers experience Assignment strategy configuration 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 51. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Configuration of the Proposed Approach Rules extraction Interviews with 4 workers and analysis of CR samples Total of 14 rules Context information developers vacation developers project allocation developers experience Assignment strategy configuration 1 execute simple rules 2 execute complex rules 3 SVM (instead of manual assignment) 33/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 52. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Results I Q1. What is the accuracy of the proposed approach for automated CR assignment? New approach: Module A = 45% and Module B = 34% SVM: Module A = 38% and Module B = 23% An improvement of 18% on Module A and 48% on B Null hypothesis refuted 34/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 53. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Results II Q2. What is the necessary effort to setup the approach in a software development project? 38 hours (rule extraction, context information, strategy) Q3. Does the achieved accuracy pay the necessary effort needed in the setup? 10 minutes for each CR assigned SVM saved 89 hours New approach saved 117 hours Economy of 28 hours vs. 38 hours for setup Null hypothesis not refuted (for this context!) 35/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 54. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Threats to the Validity Generalization of the results (only CRs from one project) Variety of metrics (Precision, Recall, and F-measure) SVM learning process (quality of text data) Difficult to assess the configuration time (trial and error for rules extraction) Implementation of the approach (bug-free?) 36/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 55. 1 Introduction 2 Literature Review 3 Survey on CR Assignment 4 Proposal 5 Experiment 6 Conclusions
  • 56. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Conclusions I Research Contribution Mapping study on CR repositories investigation Questionnaire-based survey with practitioners An approach for automated CR assignment Validation of the approach Tools Prototype and plugins Test bed for new research 37/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 57. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Conclusions II Academic Contributions Cavalcanti, Y. C., Neto, P. A. D. M. S., Machado, I. D. C., de Almeida, E. S., and de Lemos Meira, S. R. (2013b). Towards Understanding Software Change Request Assignment: A survey with practitioners. In Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering (EASE’2013), pages 195–206 Cavalcanti, Y. C., da Mota Silveira Neto, P. A., do Carmo Machado, I., Vale, T. F., de Almeida, E. S., and de Lemos Meira, S. R. (2013a). Challenges and Opportunities for Software Change Request Repositories: a systematic mapping study. Journal of Software: Evolution and Process. Online first More publications are under work: CBSoft’2014 tool session, ICSME’2014, JSEP journal 38/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 58. Outline Introduction Literature Review Survey on CR Assignment Proposal Experiment Conclusions Conclusions III Future work Investigate new algorithms for workload balancing Investigate methods and techniques for automatic extraction of assignment rules Perform new experimental studies Address other issues of CR management 39/39 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 59. An Automated Approach to Assign Software Change Requests Ph.D. Thesis Yguarat˜a Cerqueira Cavalcanti Centro de Inform´atica – UFPE March 20, 2014
  • 60. References Lotka’s Law Few developers fix the most of CRs 1/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 61. References The Problem’s Characteristics There are complex factors which influence CR assignment Factors vary from one organization to another Such as developers’ workload, CRs attributes, interpersonal relationships, and developers know-how Consider different rules for the assignments Thus, automated approaches should be context-aware 2/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 62. References Component Diagram of the Solution 3/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 63. References Prototype Tool Architecture 4/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests
  • 64. References References I [1] Canfora, G. and Cerulo, L. (2004). A taxonomy of information retrieval models and tools. Computing and Information Technology, 12(3), 175–194. [2] Cavalcanti, Y. C., da Mota Silveira Neto, P. A., do Carmo Machado, I., Vale, T. F., de Almeida, E. S., and de Lemos Meira, S. R. (2013a). Challenges and Opportunities for Software Change Request Repositories: a systematic mapping study. Journal of Software: Evolution and Process. Online first. [3] Cavalcanti, Y. C., Neto, P. A. D. M. S., Machado, I. D. C., de Almeida, E. S., and de Lemos Meira, S. R. (2013b). Towards Understanding Software Change Request Assignment: A survey with practitioners. In Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering (EASE’2013), pages 195–206. 5/5 Yguarat˜a Cerqueira Cavalcanti An Automated Approach to Assign Software Change Requests