MODELS2013_MDHPCL_Presentation

TOWARDS DOMAIN-SPECIFIC TESTING LANGUAGES
FOR SOFTWARE-AS-A-SERVICE
Dionny Santiago, Adam Cando, Cody Mack, Gabriel Nunez,
Troy Thomas and Tariq M. King
MDHPCL 2013
Workshop on Model-Driven Engineering for High Performance and Cloud
Computing, September 29, 2013, Miami, Florida

©2012-2013 Ultimate Software
AGENDA
 Introduction
 Motivation
 Approach
 Prototype
 Lessons Learned
 Related Work
 Conclusion 2

Introduction: Cloud Computing
3
Introspection
 Cloud Computing delivers “services” over the Internet
 Software, Platform and Infrastructure
 Cloud Characteristics:
 Computational Power
 Massive Data Storage
 Virtualization Technologies
 Scalability and Elasticity
Enables us to tackle more complex problem domains

 Seeks to raise the level of abstraction
used in software development
 Domain Modeling
 Ubiquitous Language
 MDE Tools and Approaches:
 Meta-Modeling
 Model Transformations
 Platform Independent Models into Code
Few works leverage MDE to improve Software Testing
Model-Driven Engineering (MDE)
4

 Ultimate Software is the developer of a cloud-based
Human Capital Management Solution – UltiPro
Testing Cloud-Based HCM Software
5
Testing Challenges
Large Problem Domain
Multiple Tester Roles
Cloud Platform Configuration
Browser Compatibility
Desktop and Mobile Products
Multi-Language Support

Approach
6

 Actions
 Set
 Blur
 Click
 Assertions
 Exists
 Is
Abstract Test Commands
7

Application Domain Models
8

Application Domain Models
9
 Domain Macro: Payroll Setup

Test Harness Configuration
Timing
Logging
Client-side Platform
Desktop vs. Mobile
Web Browser Configuration
Server-side Environment
Web Servers
Database Servers
Configuration Models
10

Example Test Specification
11

 Developed as a Visual Studio Extension written in C#
 Syntax Coloring
 Error Highlighting
 Intelli-Sense
 Block Outlining
 Tooltips
 Debugging
Prototype: Legend
12

 Developed as a Visual Studio Extension written in C#
 Syntax Coloring
 Error Highlighting
 Intelli-Sense
 Block Outlining
 Tooltips
 Debugging
Prototype: Legend
13

Prototype: Design
14

Prototype: Configuration
Configuration prototype
Abstractions for client and server configurations
Two distinct XML files

Configurable testing frameworks are key
Building application domain models requires
cross-functional collaboration
Test automation highly simplified
Ability to debug tests in a domain language
Using Legend may eliminate need for separate test
inventory
Lessons Learned
16

 MDE Approach to Platform Independent Tests
Hernandez et al.
Technique for designing platform independent tests
Platform-specific tests are generated when combined
with application models
 Behavioral-Driven Development Frameworks
RSpec / Cucumber / SpecFlow
Aid in tying acceptance tests to business requirements
Typically create and link two sets of files – specifications
and step definitions*
Related Work
17

Domain-specific test case specification language
Our approach, while focused on web-based applications,
could be applied to any domain
Prototyped proposed approach for a cloud-based human
capital management solution
Next steps:
Develop a full implementation of Legend
Perform a case study using data from UltiPro
Conclusion
18

Jorge Martinez
Michael Mattera
Virtual Team at Ultimate Software
Judges and Participants at Summer 2012 Ultimate
Software 48 Hours Project
Acknowledgements
19

Open Discussion
20
Introspection
Questions?
¿Preguntas?
問題
Sawwal
вопросы
質問
domande
ερωτήσεις

MODELS2013_MDHPCL_Presentation

More Related Content

What's hot (20)

Similar to MODELS2013_MDHPCL_Presentation (20)

MODELS2013_MDHPCL_Presentation

Editor's Notes