SlideShare a Scribd company logo
MUTATION TESTING FOR DSLS
TOOL DEMO
P. Gómez-Abajo , E. Guerra, J. de Lara
Modelling&Software Engineering Research Group
http://miso.es
Universidad Autónoma de Madrid (Spain)
DSM 2019
October 20th, Athens
Mercedes G. Merayo
Design and Testing of Reliable Systems Research Group
http://antares.sip.ucm.es/testing
Universidad Complutense de Madrid (Spain)
WHAT IS MUTATION
TESTING?
• Approach of software testing to
assess the quality of test suites
• Injection of syntax changes in a
program by using mutation
operators
• The mutations introduced
simulate common programming
faults
• Facilitates to improve the
quality of the test-suites and
the mutation operators set
2
3
MUTATION TESTING FOR FA
0
110
Seed model
01
00
Test-suite
✓

4
MUTATION TESTING FOR FA
0
101
0
110
Seed model Mutant model
01
00
Test-suite
✓

MT
01
00 ✓

Test-suite
5
MUTATION TESTING FOR FA
0
101
0
110
Seed model Mutant model
01
00
Test-suite
✓

The mutant is alive 
MT
01
00 ✓

Test-suite
6
MUTATION TESTING FOR FA
0
110
Seed model
✓
01
00
Test-suite
✓

10
7
MUTATION TESTING FOR FA
0
101
0
110
Seed model Mutant model
✓
01
00
Test-suite
✓

10
MT
01
00 ✓

10 
Test-suite
8
MUTATION TESTING FOR FA
0
101
0
110
Seed model Mutant model
The mutant is killed
✓
01
00
Test-suite
✓

10
✓
01
00 ✓

10 
Test-suite
MT
• Wodel: a DSL for model mutation
generate exhaustive mutants in "out/" from "model/"
metamodel "mm/fa.ecore"
description "Simple Wodel program"
with blocks {
sts "Swap the symbols of two transitions" {
t = select one Transition
where {symbol <> null}
modify one Transition
where {symbol <> t->symbol}
with {swap(symbol, t->symbol)}
}
}
• Wodel tool extension for language independent MT Wodel-Test
9
A SIMPLE WODEL PROGRAM
WODEL-TEST PROCESS
10
Wodel-Test is also useful to
build MT tools for common
programming languages:
Wodel-Test for Java
• Wodel-Test: automates the generation of MT tools for arbitrary languages
• Eases the creation of MT tools for the MDE community
• Implemented 3 MT tools: Wodel-Test for FA/Java/ATL
11
CONCLUSIONS
FUTURE WORK
• We plan to create MT tools for other DSLs
• Reuse of generic mutation operators across similar languages (e.g., Java and C++)
• Support for the definition of functions in the Wodel DSL
12
Thank you!!
Wodel & Wodel-Test project websites:
http://gomezabajo.github.io/Wodel/
http://gomezabajo.github.io/Wodel/Wodel-Test/
Pablo.GomezA@uam.es
@GomezAbajo

More Related Content

PDF
Towards a model-driven engineering solution for language independent mutation...
PDF
Generation of mutation testing tools with Wodel-Test
PDF
Wodel-Test: A Model-Based Framework for Language-Independent Mutation Testing
PDF
Seed Model Synthesis for Testing Model-based Mutation Operators
PDF
A DSL for Model Mutation and its Applications to Different Domains
PDF
Wodel: A Domain-Specific Language for Model Mutation
PPTX
Model based vulnerability testing
PDF
ASDSpec, Model Based Testing
Towards a model-driven engineering solution for language independent mutation...
Generation of mutation testing tools with Wodel-Test
Wodel-Test: A Model-Based Framework for Language-Independent Mutation Testing
Seed Model Synthesis for Testing Model-based Mutation Operators
A DSL for Model Mutation and its Applications to Different Domains
Wodel: A Domain-Specific Language for Model Mutation
Model based vulnerability testing
ASDSpec, Model Based Testing

What's hot (12)

PDF
50120140502017
PPTX
Iml v1.5 open-source version
PDF
Technology & innovation Management Course - Session 2
PDF
Automatic Test Case Generation
PDF
Strategy-driven Test Generation with Open Source Frameworks
PPT
Ideate ptototypes and feedback
PDF
Using task models in model-based testing
PPT
Testing ppt
PDF
Experimental design
PDF
Model Driven Developing & Model Based Checking: Applying Together
PDF
Black box testing (an introduction to)
PDF
Finding latent code errors via machine learning over program ...
50120140502017
Iml v1.5 open-source version
Technology & innovation Management Course - Session 2
Automatic Test Case Generation
Strategy-driven Test Generation with Open Source Frameworks
Ideate ptototypes and feedback
Using task models in model-based testing
Testing ppt
Experimental design
Model Driven Developing & Model Based Checking: Applying Together
Black box testing (an introduction to)
Finding latent code errors via machine learning over program ...
Ad

Similar to Mutation Testing for DSLs (Tool Demo) (20)

PDF
A mutation testing analysis and regression
PDF
A MUTATION TESTING ANALYSIS AND REGRESSION TESTING
PPTX
Mutation Testing
PDF
DYNAMUT: A MUTATION TESTING TOOL FOR INDUSTRY-LEVEL EMBEDDED SYSTEM APPLICATIONS
PDF
SAIConference_PAPER
PDF
Mutation Testing: Start Hunting The Bugs
PDF
Mutation Testing with PIT (Booster 2014, 2014-MAR-13)
PPT
Mutation Testing and MuJava
PDF
MUTANTS KILLER - PIT: state of the art of mutation testing system
PDF
Vaidas Pilkauskas and Tadas Ščerbinskas - Can you trust your tests?
PDF
Mutation Testing
PDF
JS Fest 2018. Андрей Кучеренко. Мутационное тестирование в JavaScript
PDF
Must.kill.mutants. TopConf Tallinn 2016
PDF
MUTANTS KILLER (Revised) - PIT: state of the art of mutation testing system
PDF
Mutation Testing: Leaving the Stone Age. FOSDEM 2017
PPTX
MuFinal
PPTX
Mateusz Bryła - Mutation testing
PPTX
Joker - Improve your tests with mutation testing
PDF
Mutation Testing
PDF
Mutation testing in Java
A mutation testing analysis and regression
A MUTATION TESTING ANALYSIS AND REGRESSION TESTING
Mutation Testing
DYNAMUT: A MUTATION TESTING TOOL FOR INDUSTRY-LEVEL EMBEDDED SYSTEM APPLICATIONS
SAIConference_PAPER
Mutation Testing: Start Hunting The Bugs
Mutation Testing with PIT (Booster 2014, 2014-MAR-13)
Mutation Testing and MuJava
MUTANTS KILLER - PIT: state of the art of mutation testing system
Vaidas Pilkauskas and Tadas Ščerbinskas - Can you trust your tests?
Mutation Testing
JS Fest 2018. Андрей Кучеренко. Мутационное тестирование в JavaScript
Must.kill.mutants. TopConf Tallinn 2016
MUTANTS KILLER (Revised) - PIT: state of the art of mutation testing system
Mutation Testing: Leaving the Stone Age. FOSDEM 2017
MuFinal
Mateusz Bryła - Mutation testing
Joker - Improve your tests with mutation testing
Mutation Testing
Mutation testing in Java
Ad

More from Pablo Gómez Abajo (11)

PDF
Automated Engineering of Domain-Specific Metamorphic Testing Environments
PDF
Mutation testing for DSLs - The case of task-oriented chatbots
PDF
Mutation Testing for Task-Oriented Chatbots
PDF
Wodel-Edu: A tool for the generation and evaluation of diagram-based exercises
PDF
Automated engineering of domain-specific metamorphic testing environments
PDF
Wodel-Test: A Model-Based Framework for Language-Independent Mutation Testing...
PDF
Wodel-Edu: An MDE Solution for the Generation and Evaluation of Diagram-based...
PDF
Programación de macros en Microsoft Excel VBA
PDF
PhD defense presentation
PDF
Wodel: A DSL for Model Mutation; and Wodel-Edu: its Application to the Automa...
PDF
Un framework para la generación automática de ejercicios mediante técnicas de...
Automated Engineering of Domain-Specific Metamorphic Testing Environments
Mutation testing for DSLs - The case of task-oriented chatbots
Mutation Testing for Task-Oriented Chatbots
Wodel-Edu: A tool for the generation and evaluation of diagram-based exercises
Automated engineering of domain-specific metamorphic testing environments
Wodel-Test: A Model-Based Framework for Language-Independent Mutation Testing...
Wodel-Edu: An MDE Solution for the Generation and Evaluation of Diagram-based...
Programación de macros en Microsoft Excel VBA
PhD defense presentation
Wodel: A DSL for Model Mutation; and Wodel-Edu: its Application to the Automa...
Un framework para la generación automática de ejercicios mediante técnicas de...

Recently uploaded (20)

PPTX
Fluid dynamics vivavoce presentation of prakash
PPT
Animal tissues, epithelial, muscle, connective, nervous tissue
PPTX
Introcution to Microbes Burton's Biology for the Health
PDF
Cosmic Outliers: Low-spin Halos Explain the Abundance, Compactness, and Redsh...
PDF
Warm, water-depleted rocky exoplanets with surfaceionic liquids: A proposed c...
PPTX
GREEN FIELDS SCHOOL PPT ON HOLIDAY HOMEWORK
PPT
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
PDF
The Land of Punt — A research by Dhani Irwanto
PPTX
ap-psych-ch-1-introduction-to-psychology-presentation.pptx
PPTX
Substance Disorders- part different drugs change body
PDF
Communicating Health Policies to Diverse Populations (www.kiu.ac.ug)
PDF
Looking into the jet cone of the neutrino-associated very high-energy blazar ...
PDF
Unit 5 Preparations, Reactions, Properties and Isomersim of Organic Compounds...
PPTX
PMR- PPT.pptx for students and doctors tt
PPTX
endocrine - management of adrenal incidentaloma.pptx
PPTX
A powerpoint on colorectal cancer with brief background
PPTX
BODY FLUIDS AND CIRCULATION class 11 .pptx
PDF
Assessment of environmental effects of quarrying in Kitengela subcountyof Kaj...
PDF
GROUP 2 ORIGINAL PPT. pdf Hhfiwhwifhww0ojuwoadwsfjofjwsofjw
PDF
BET Eukaryotic signal Transduction BET Eukaryotic signal Transduction.pdf
Fluid dynamics vivavoce presentation of prakash
Animal tissues, epithelial, muscle, connective, nervous tissue
Introcution to Microbes Burton's Biology for the Health
Cosmic Outliers: Low-spin Halos Explain the Abundance, Compactness, and Redsh...
Warm, water-depleted rocky exoplanets with surfaceionic liquids: A proposed c...
GREEN FIELDS SCHOOL PPT ON HOLIDAY HOMEWORK
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
The Land of Punt — A research by Dhani Irwanto
ap-psych-ch-1-introduction-to-psychology-presentation.pptx
Substance Disorders- part different drugs change body
Communicating Health Policies to Diverse Populations (www.kiu.ac.ug)
Looking into the jet cone of the neutrino-associated very high-energy blazar ...
Unit 5 Preparations, Reactions, Properties and Isomersim of Organic Compounds...
PMR- PPT.pptx for students and doctors tt
endocrine - management of adrenal incidentaloma.pptx
A powerpoint on colorectal cancer with brief background
BODY FLUIDS AND CIRCULATION class 11 .pptx
Assessment of environmental effects of quarrying in Kitengela subcountyof Kaj...
GROUP 2 ORIGINAL PPT. pdf Hhfiwhwifhww0ojuwoadwsfjofjwsofjw
BET Eukaryotic signal Transduction BET Eukaryotic signal Transduction.pdf

Mutation Testing for DSLs (Tool Demo)

  • 1. MUTATION TESTING FOR DSLS TOOL DEMO P. Gómez-Abajo , E. Guerra, J. de Lara Modelling&Software Engineering Research Group http://miso.es Universidad Autónoma de Madrid (Spain) DSM 2019 October 20th, Athens Mercedes G. Merayo Design and Testing of Reliable Systems Research Group http://antares.sip.ucm.es/testing Universidad Complutense de Madrid (Spain)
  • 2. WHAT IS MUTATION TESTING? • Approach of software testing to assess the quality of test suites • Injection of syntax changes in a program by using mutation operators • The mutations introduced simulate common programming faults • Facilitates to improve the quality of the test-suites and the mutation operators set 2
  • 3. 3 MUTATION TESTING FOR FA 0 110 Seed model 01 00 Test-suite ✓ 
  • 4. 4 MUTATION TESTING FOR FA 0 101 0 110 Seed model Mutant model 01 00 Test-suite ✓  MT 01 00 ✓  Test-suite
  • 5. 5 MUTATION TESTING FOR FA 0 101 0 110 Seed model Mutant model 01 00 Test-suite ✓  The mutant is alive  MT 01 00 ✓  Test-suite
  • 6. 6 MUTATION TESTING FOR FA 0 110 Seed model ✓ 01 00 Test-suite ✓  10
  • 7. 7 MUTATION TESTING FOR FA 0 101 0 110 Seed model Mutant model ✓ 01 00 Test-suite ✓  10 MT 01 00 ✓  10  Test-suite
  • 8. 8 MUTATION TESTING FOR FA 0 101 0 110 Seed model Mutant model The mutant is killed ✓ 01 00 Test-suite ✓  10 ✓ 01 00 ✓  10  Test-suite MT
  • 9. • Wodel: a DSL for model mutation generate exhaustive mutants in "out/" from "model/" metamodel "mm/fa.ecore" description "Simple Wodel program" with blocks { sts "Swap the symbols of two transitions" { t = select one Transition where {symbol <> null} modify one Transition where {symbol <> t->symbol} with {swap(symbol, t->symbol)} } } • Wodel tool extension for language independent MT Wodel-Test 9 A SIMPLE WODEL PROGRAM
  • 10. WODEL-TEST PROCESS 10 Wodel-Test is also useful to build MT tools for common programming languages: Wodel-Test for Java
  • 11. • Wodel-Test: automates the generation of MT tools for arbitrary languages • Eases the creation of MT tools for the MDE community • Implemented 3 MT tools: Wodel-Test for FA/Java/ATL 11 CONCLUSIONS FUTURE WORK • We plan to create MT tools for other DSLs • Reuse of generic mutation operators across similar languages (e.g., Java and C++) • Support for the definition of functions in the Wodel DSL
  • 12. 12 Thank you!! Wodel & Wodel-Test project websites: http://gomezabajo.github.io/Wodel/ http://gomezabajo.github.io/Wodel/Wodel-Test/ Pablo.GomezA@uam.es @GomezAbajo