SlideShare a Scribd company logo
Nikita Voinov
Generation of Test Scenarios
for Non Deterministic and
Concurrent Telecommunication
Applications
14.11.2015
14 November
2015
2
Information and Control System Department of ICST
• Software development methods:
• Model Driven Development (MDD)
• Model Driven Software Development (MDSD)
• Model Driven Engineering (MDE)
• Software testing methods:
• Model Driven Testing (MDT)
• Model Based Testing (MBT)
Introduction
3
Information and Control System Department of ICST
Model Oriented Approach
• Benefits:
• Reduction of software development cost via automation
• Simplification of test development process
• Involving of customer into development process
• Issues:
• A shortage of engineers with MDT expertise
• Different levels of abstraction
• The problem of test suite explosion
• Necessity to customize MDT approaches in projects from
different areas of industry
4
Information and Control System Department of ICST
Fragment of Telecom Project in UCM Notation
5
Information and Control System Department of ICST
Fragment of Multi Concurrent Model in UCM Notation
6
Information and Control System Department of ICST
Verification and Testing Within Single Technology
• Test Coverage criteria
• Functional coverage
• Responsibility coverage
• Branches coverage
• Paths coverage
• Verification techniques (performed by VRS toolset)
• Model checking
• Symbolic verification
• Searching of equivalence classes
7
Information and Control System Department of ICST
Non Deterministic Behavior: active alternative
Direction of the signals in Req1 and Req2: from test to SUT.
Two linear tests shall be used.
8
Information and Control System Department of ICST
Non Deterministic Behavior: passive alternative
Direction of the signals in Req1 and Req2: from SUT to test.
Linear tests can not be used, adding of “alt” construction is required.
9
Information and Control System Department of ICST
Concurrent Behavior: linear traces
Correctness of the test strictly depends on the direction of the signals.
10
Information and Control System Department of ICST
Concurrent Behavior: solution
Par construction can be automatically
added into particular test based on
syntax analysis of high level formal
model.
11
Information and Control System Department of ICST
Concurrent Behavior: example
12
Information and Control System Department of ICST
Results
Project BP number Non
linear BP,
%
Test scenario
number
(Linear)
Test scenario
number
(Linear + non
linear)
Reduce of
test suite,
%
SMTP 30 10 10 8 20
CDMA 205 43 1171 615 48
Satellite
terminal
191 15 396 291 27
Examples of not huge projects: average reduction of test suite with
usage of suggested approach is near 30%
Thank You
14
Information and Control System Department of ICST
Proved Model of System Under Test

More Related Content

PDF
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
PDF
Process modelling at BaneDanmark
PDF
System verilog verification building blocks
PPT
Software Engineering (Testing techniques)
PDF
Incremental Reconfiguration of Product Specific Use Case Models for Evolving ...
PDF
TMPA-2015: Multi-Platform Approach to Reverse Debugging of Virtual Machines
PDF
TMPA-2015: Multi-Module Application Tracing in z/OS Environment
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
Process modelling at BaneDanmark
System verilog verification building blocks
Software Engineering (Testing techniques)
Incremental Reconfiguration of Product Specific Use Case Models for Evolving ...
TMPA-2015: Multi-Platform Approach to Reverse Debugging of Virtual Machines
TMPA-2015: Multi-Module Application Tracing in z/OS Environment

Viewers also liked (20)

PDF
TMPA-2015: Towards a Usable Defect Prediction Tool: Crossbreeding Machine Lea...
PPT
TMPA-2015: Information Support System for Autonomous Spacecraft Control Macro...
PDF
TMPA-2015: The dynamic Analysis of Executable Code in ELF Format Based on Sta...
PPT
TMPA-2015: ClearTH: a Tool for Automated Testing of Post Trade Systems
PDF
TMPA-2015: The Application of Parameterized Hierarchy Templates for Automated...
PDF
TMPA-2015: Lexical analysis of dynamically formed string expressions
PDF
TMPA-2015: Expanding the Meta-Generation of Correctness Conditions by Means o...
PDF
TMPA-2015: Software Engineering Education: The Messir Approach
PDF
TMPA-2015: Implementing the MetaVCG Approach in the C-light System
PDF
TMPA-2015: A Need To Specify and Verify Standard Functions
PPTX
TMPA-2015: Automated process of creating test scenarios for financial protoco...
PDF
TMPA-2015: The Verification of Functional Programs by Applying Statechart Dia...
PDF
TMPA-2015: Automated Testing of Multi-thread Data Structures Solutions Lineri...
PPTX
TMPA-2015: Standards and Standartization in Program Engineering. Why Would Yo...
PDF
TMPA-2015: Formal Methods in Robotics
PPTX
TMPA-2015: The Application of Static Analysis to Optimize the Dynamic Detecti...
PPT
TMPA-2015: FPGA-Based Low Latency Sponsored Access
PDF
TMPA-2015: Kotlin: From Null Dereference to Smart Casts
PDF
TMPA-2017: The Quest for Average Response Time
PDF
TMPA-2017: Evolutionary Algorithms in Test Generation for digital systems
TMPA-2015: Towards a Usable Defect Prediction Tool: Crossbreeding Machine Lea...
TMPA-2015: Information Support System for Autonomous Spacecraft Control Macro...
TMPA-2015: The dynamic Analysis of Executable Code in ELF Format Based on Sta...
TMPA-2015: ClearTH: a Tool for Automated Testing of Post Trade Systems
TMPA-2015: The Application of Parameterized Hierarchy Templates for Automated...
TMPA-2015: Lexical analysis of dynamically formed string expressions
TMPA-2015: Expanding the Meta-Generation of Correctness Conditions by Means o...
TMPA-2015: Software Engineering Education: The Messir Approach
TMPA-2015: Implementing the MetaVCG Approach in the C-light System
TMPA-2015: A Need To Specify and Verify Standard Functions
TMPA-2015: Automated process of creating test scenarios for financial protoco...
TMPA-2015: The Verification of Functional Programs by Applying Statechart Dia...
TMPA-2015: Automated Testing of Multi-thread Data Structures Solutions Lineri...
TMPA-2015: Standards and Standartization in Program Engineering. Why Would Yo...
TMPA-2015: Formal Methods in Robotics
TMPA-2015: The Application of Static Analysis to Optimize the Dynamic Detecti...
TMPA-2015: FPGA-Based Low Latency Sponsored Access
TMPA-2015: Kotlin: From Null Dereference to Smart Casts
TMPA-2017: The Quest for Average Response Time
TMPA-2017: Evolutionary Algorithms in Test Generation for digital systems
Ad

Similar to TMPA-2015: Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications (20)

PDF
Survey on Software Defect Prediction (PhD Qualifying Examination Presentation)
PPTX
Survey on Software Defect Prediction
PDF
Profile tulasi v1.1
PDF
Survey on Software Defect Prediction
PDF
Making Model-Driven Verification Practical and Scalable: Experiences and Less...
PDF
Automated Analysis of Natural-Language Requirements: Industrial Needs and Opp...
PDF
Information technology of developing test kits based on software requirements
PDF
Testing Machine Learning-enabled Systems: A Personal Perspective
PPTX
memetic algorithm
PDF
Functional Safety in ML-based Cyber-Physical Systems
PPTX
Transaction Flow Testing: transaction flows, transaction flow testing techniq...
PDF
SSBSE 2020 keynote
PPTX
Esem2010 shihab
PPT
Bart Knaack - The Truth About Model-Based Quality Improvements
PDF
An Enhanced Technique for Network Traffic Classification with unknown Flow De...
PDF
SAM-IoT: Model Based Methodology and Framework for Design and Management of N...
PDF
Final Exam Questions Fall03
PPTX
DevOps Continuous Testing and LaaS – The Perfect Match for SDN
PDF
2742303.pdf
PPTX
Comparing model coverage and code coverage in Model Driven testing: an explor...
Survey on Software Defect Prediction (PhD Qualifying Examination Presentation)
Survey on Software Defect Prediction
Profile tulasi v1.1
Survey on Software Defect Prediction
Making Model-Driven Verification Practical and Scalable: Experiences and Less...
Automated Analysis of Natural-Language Requirements: Industrial Needs and Opp...
Information technology of developing test kits based on software requirements
Testing Machine Learning-enabled Systems: A Personal Perspective
memetic algorithm
Functional Safety in ML-based Cyber-Physical Systems
Transaction Flow Testing: transaction flows, transaction flow testing techniq...
SSBSE 2020 keynote
Esem2010 shihab
Bart Knaack - The Truth About Model-Based Quality Improvements
An Enhanced Technique for Network Traffic Classification with unknown Flow De...
SAM-IoT: Model Based Methodology and Framework for Design and Management of N...
Final Exam Questions Fall03
DevOps Continuous Testing and LaaS – The Perfect Match for SDN
2742303.pdf
Comparing model coverage and code coverage in Model Driven testing: an explor...
Ad

More from Iosif Itkin (20)

PDF
Foundations of Software Testing Lecture 4
PPTX
QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...
PDF
Exactpro FinTech Webinar - Global Exchanges Test Oracles
PDF
Exactpro FinTech Webinar - Global Exchanges FIX Protocol
PDF
Operational Resilience in Financial Market Infrastructures
PDF
20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season
PDF
Testing the Intelligence of your AI
PDF
EXTENT 2019: Exactpro Quality Assurance for Financial Market Infrastructures
PDF
ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...
PPTX
EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan Shamrai
PDF
EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference Open
PDF
User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...
PPTX
QAFF Chicago 2019 - Complex Post-Trade Systems, Requirements Traceability and...
PDF
QA Community Saratov: Past, Present, Future (2019-02-08)
PDF
Machine Learning and RoboCop Testing
PDF
Behaviour Driven Development: Oltre i limiti del possibile
PDF
2018 - Exactpro Year in Review
PPTX
Exactpro Discussion about Joy and Strategy
PPTX
FIX EMEA Conference 2018 - Post Trade Software Testing Challenges
PDF
BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)
Foundations of Software Testing Lecture 4
QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...
Exactpro FinTech Webinar - Global Exchanges Test Oracles
Exactpro FinTech Webinar - Global Exchanges FIX Protocol
Operational Resilience in Financial Market Infrastructures
20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season
Testing the Intelligence of your AI
EXTENT 2019: Exactpro Quality Assurance for Financial Market Infrastructures
ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...
EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan Shamrai
EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference Open
User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...
QAFF Chicago 2019 - Complex Post-Trade Systems, Requirements Traceability and...
QA Community Saratov: Past, Present, Future (2019-02-08)
Machine Learning and RoboCop Testing
Behaviour Driven Development: Oltre i limiti del possibile
2018 - Exactpro Year in Review
Exactpro Discussion about Joy and Strategy
FIX EMEA Conference 2018 - Post Trade Software Testing Challenges
BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)

Recently uploaded (20)

PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
PPT
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PPTX
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PDF
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
PPTX
Microbiology with diagram medical studies .pptx
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PDF
Sciences of Europe No 170 (2025)
PPTX
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
PPTX
Classification Systems_TAXONOMY_SCIENCE8.pptx
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPTX
ECG_Course_Presentation د.محمد صقران ppt
PDF
. Radiology Case Scenariosssssssssssssss
PDF
The scientific heritage No 166 (166) (2025)
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PPTX
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
PPTX
Cell Membrane: Structure, Composition & Functions
PPT
protein biochemistry.ppt for university classes
PPT
POSITIONING IN OPERATION THEATRE ROOM.ppt
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
Microbiology with diagram medical studies .pptx
bbec55_b34400a7914c42429908233dbd381773.pdf
Sciences of Europe No 170 (2025)
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
Classification Systems_TAXONOMY_SCIENCE8.pptx
The KM-GBF monitoring framework – status & key messages.pptx
ECG_Course_Presentation د.محمد صقران ppt
. Radiology Case Scenariosssssssssssssss
The scientific heritage No 166 (166) (2025)
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
Cell Membrane: Structure, Composition & Functions
protein biochemistry.ppt for university classes
POSITIONING IN OPERATION THEATRE ROOM.ppt

TMPA-2015: Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications

  • 1. Nikita Voinov Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications 14.11.2015 14 November 2015
  • 2. 2 Information and Control System Department of ICST • Software development methods: • Model Driven Development (MDD) • Model Driven Software Development (MDSD) • Model Driven Engineering (MDE) • Software testing methods: • Model Driven Testing (MDT) • Model Based Testing (MBT) Introduction
  • 3. 3 Information and Control System Department of ICST Model Oriented Approach • Benefits: • Reduction of software development cost via automation • Simplification of test development process • Involving of customer into development process • Issues: • A shortage of engineers with MDT expertise • Different levels of abstraction • The problem of test suite explosion • Necessity to customize MDT approaches in projects from different areas of industry
  • 4. 4 Information and Control System Department of ICST Fragment of Telecom Project in UCM Notation
  • 5. 5 Information and Control System Department of ICST Fragment of Multi Concurrent Model in UCM Notation
  • 6. 6 Information and Control System Department of ICST Verification and Testing Within Single Technology • Test Coverage criteria • Functional coverage • Responsibility coverage • Branches coverage • Paths coverage • Verification techniques (performed by VRS toolset) • Model checking • Symbolic verification • Searching of equivalence classes
  • 7. 7 Information and Control System Department of ICST Non Deterministic Behavior: active alternative Direction of the signals in Req1 and Req2: from test to SUT. Two linear tests shall be used.
  • 8. 8 Information and Control System Department of ICST Non Deterministic Behavior: passive alternative Direction of the signals in Req1 and Req2: from SUT to test. Linear tests can not be used, adding of “alt” construction is required.
  • 9. 9 Information and Control System Department of ICST Concurrent Behavior: linear traces Correctness of the test strictly depends on the direction of the signals.
  • 10. 10 Information and Control System Department of ICST Concurrent Behavior: solution Par construction can be automatically added into particular test based on syntax analysis of high level formal model.
  • 11. 11 Information and Control System Department of ICST Concurrent Behavior: example
  • 12. 12 Information and Control System Department of ICST Results Project BP number Non linear BP, % Test scenario number (Linear) Test scenario number (Linear + non linear) Reduce of test suite, % SMTP 30 10 10 8 20 CDMA 205 43 1171 615 48 Satellite terminal 191 15 396 291 27 Examples of not huge projects: average reduction of test suite with usage of suggested approach is near 30%
  • 14. 14 Information and Control System Department of ICST Proved Model of System Under Test