SlideShare a Scribd company logo
Business Process
Automation and Data
Processing Workflows
Marlon Dumas
University of Tartu, Estonia
marlon.dumas@ut.ee
Istat, Rome, 4 May 2018
The Business Process Management Lifecycle
Process
identification
Conformance and
performance insights
Conformance and
performance insights
Process
monitoring and
controlling
Executable
process
model
Executable
process
model
Process
implementation To-be process
model
To-be process
model
Process
analysis
As-is process
model
As-is process
model
Process
discovery
Process architectureProcess architecture
Process
redesign
Insights on
weaknesses and
their impact
Insights on
weaknesses and
their impact
2
Automating:
1. The scheduling and routing of tasks in a process
2. The handling of data associated to the process
3. The assignment of tasks to resources and interactions with
applications
4. The monitoring of the process
… All this on the basis of process models
What is Process Automation?
3
Example of process automation (Danske Bank)
Customer
Advisor
Backoffice workers
XML
Case Transfer System
Service
A
Service
B
Service
C
Not valid
Create Credit
BPMS
© Steen Brahe, 2007 4
Hajo Reijers et al. (2016) “The effectiveness of workflow
management systems: A longitudinal study”
• 10 Dutch organizations implementing a workflow
management system followed over a 10-years period
• Measured KPIs before and after (25 processes)
• Cycle time (lead time): average time from start to end of a case
• Waiting time: time a case spends in “idle” mode
• Resource utilization: percentage of times resources are busy
Why Process Automation?
5
Effect on cycle time
6
before
after
Effect on wait times
7
Effect on resource utilization
8
1. Custom Software
• Don’t do it unless you have a well-funded IT department and special requirements, or
tackling very simple processes in a specific context…
2. Packaged Enterprise Systems
• Enterprise Resource Planning (ERP), Customer Relationship Management (CRM)
systems
3. Document Management Systems (DMS)
 Nowadays called Enterprise Content Management Systems (ECMS)
4. Business Process Management System (BPMS)
• Especially designed for process automation
5. Data Processing Workflows
• Specialized for automation of data processing pipelines
6. Robotic Process Automation
 Automation of tasks and routines (not covered in this talk)
Process Automation Technology
9
• Support standardized processes with configuration options
• Lead generation, lead-to-order, …
• Order-to-cash, invoice-to-cash, stock replenishment, procure-to-pay, ...
• Recruitment, roster & scheduling, payroll, …
• ERP, CRM, SCM, e.g.
• SAP Suite
• Oracle Apps
• MS Dynamics CRM/ERP
• Salesforce, Intacct, NetSuite, Acumatica, …
• Compiere, OpenERP, Odoo, …
• Most of them support configuration via process flows, e.g.
• SAP Process Orchestration
• Business process flows and workflows in Dynamics CRM
Packaged Enterprise Systems
10
• Suitable for single-document processes (document routing)
• Simple purchase requests, travel requests, …
• Sometimes marketed as part of Enterprise Content
Management (ECM) sytsems
• Examples
• Documentum Workflows
• Adobe LiveCycle
• MS SharePoint workflow
• …
Document Management Systems
11
Business Process Management Systems
12
BPMS Landscape
Big vendors
• IBM BPM
• Oracle BPMS
• Microsoft BizTalk
• Software AG
webMethods
Other
closed-source
• Appian BPMS
• BizAgi BPM Suite
• Bosch inubit Suite
• OpenText BPM
• Pegaystems Pega
BPM Platform
• Progress Savvion
• TIBCO
ActiveMatrix BPM
Open-source
• Bonita BPM
• Camunda
• JBoss jBPM
• YAWL
13
• Have dozens or hundreds of distinct processes that:
• Consists of combination of manual and automated steps
• Involve decision points, rework loops, time-outs, exception handling (complex
control-flow)
• Need to be traced
• Are executed frequently/regularly
• Do not involve automated processing of large or unstructured data (“small”
structured data)
• The processes are expected to evolve from times to times
• So hard-coding the processes in custom software is not flexible enough
• Have a heterogenous IT applications (incl. legacy applications)
that are exposed via Application Programming Interfaces
(APIs)
When to use a BPMS?
14
Tools intended to automate processes where:
• A number of data sources
• DB tables, CSV files, semi-structured documents, textual documents, …
• …are transformed into data outputs
• Tables, reports, statistical measures, etc.
• …via multiple steps
• Extraction, pre-processing/cleaning, transformation, splitting, merging,
aggregation, and validation steps
• Typically automated steps
• …inter-linked via dependencies
• Data-flow dependencies (output of one step is input of another)
• But can also be control-flow (decision points, loops, etc.)
• In a traceable and reproducible manner
Data Processing Workflow Systems
15
Data Processing Workflow (examples)
16
• KNIME (open-source)
• RapidMiner (partially open-source)
• Alteryx
• Angoss
• SAS Workflow
• …
Data Processing Tools
17
• Have lots of data processing pipelines that:
• Mostly consists of automated steps (few manual steps, if any)
• Not many decision points or rework loops (if any)
• Keep evolving
• Need to be traced
• Are executed frequently/regularly
• Have users with different levels of expertise
• Not everyone is an R hacker
• Need to work with heterogeneous data and data sources
• Need flexibility to run data processing pipelines on single-
node, private cloud, etc.
When to use a data processing workflow system?
18
Table of Contents
1. Introduction
2. Process Identification
3. Process Modeling
4. Advanced Process Modeling
5. Process Discovery
6. Qualitative Process Analysis
7. Quantitative Process Analysis
8. Process Redesign
9. Process-Aware Information
Systems
10. Executable Process Modeling
11. Process Monitoring
12. BPM as an Enterprise Capability
http://fundamentals-of-bpm.org
19

More Related Content

PDF
Mdm: why, when, how
PDF
Master Data Management – Aligning Data, Process, and Governance
PDF
Real Time Data Strategy and Architecture
PDF
Master Data Management
PDF
Data Architecture Strategies: Data Architecture for Digital Transformation
PPT
Planning Data Warehouse
PPTX
Data modeling
PPT
Master Data Management
Mdm: why, when, how
Master Data Management – Aligning Data, Process, and Governance
Real Time Data Strategy and Architecture
Master Data Management
Data Architecture Strategies: Data Architecture for Digital Transformation
Planning Data Warehouse
Data modeling
Master Data Management

What's hot (20)

PPTX
Creating an Enterprise AI Strategy
PDF
The Importance of Master Data Management
PPTX
Data Lakehouse, Data Mesh, and Data Fabric (r1)
PDF
Architecting Modern Data Platforms
PPTX
Selling MDM to Leadership: Defining the Why
PPTX
Building Modern Data Platform with Microsoft Azure
PPTX
Building the enterprise data architecture
PDF
How to identify the correct Master Data subject areas & tooling for your MDM...
PDF
Analyst field reports on top 20 multi domain MDM solutions - Aaron Zornes (NY...
PDF
Preparing For a Master Data Management Implemenation
PDF
Introduction to Data Governance
PDF
Sample - Data Warehouse Requirements
PPTX
Process Mining 2.0: From Insights to Actions
PPTX
Business requirements gathering for bi
PDF
Reference master data management
PDF
Creating an Effective MDM Strategy for Salesforce
PPTX
Master Data Management
PDF
Data Profiling, Data Catalogs and Metadata Harmonisation
PDF
Data Science Use cases in Banking
PPTX
Data Strategy - Executive MBA Class, IE Business School
Creating an Enterprise AI Strategy
The Importance of Master Data Management
Data Lakehouse, Data Mesh, and Data Fabric (r1)
Architecting Modern Data Platforms
Selling MDM to Leadership: Defining the Why
Building Modern Data Platform with Microsoft Azure
Building the enterprise data architecture
How to identify the correct Master Data subject areas & tooling for your MDM...
Analyst field reports on top 20 multi domain MDM solutions - Aaron Zornes (NY...
Preparing For a Master Data Management Implemenation
Introduction to Data Governance
Sample - Data Warehouse Requirements
Process Mining 2.0: From Insights to Actions
Business requirements gathering for bi
Reference master data management
Creating an Effective MDM Strategy for Salesforce
Master Data Management
Data Profiling, Data Catalogs and Metadata Harmonisation
Data Science Use cases in Banking
Data Strategy - Executive MBA Class, IE Business School
Ad

Similar to Business Process Automation and Data Processing Workflows (20)

PPTX
From Conceptual to Executable BPMN Process Models A Step-by-Step Method
PPT
Workflow and BPM in the New Enterprise Architecture
PPT
D1 3 200710 Poznan+Paris Bpm Arch
PPT
Business Process Modeling & Automation: Where are we?
PPT
BPM & Workflow in the New Enterprise Architecture
PPT
BPM & Workflow in the New Enterprise Architecture
PDF
Case study: Camunda BPM in PwC project
PDF
2. oracle bpm soa 11g - simple - unified - complete
PPTX
Bpms, Putting Business In The Driver’S Seat
PDF
Fundamentals of business process management and BPMN
PPTX
BPM - What is next
PDF
Next generation BPM
PPTX
Proceedit 20110819 Companys Presentation For Partners Eng Dol
PPTX
Bpms
PDF
Business Process Management Training | By ex-Deloitte & McKinsey Consultants
PPTX
Fundamentals of Business Process Management - Tutorial at CAiSE'2018
PDF
Evolution of Workflow Technology: Usages, Architectures, Languages
PPTX
Business Process Management - What is it, and why all the buzz?
PPS
BPM - The Promise And Challenges
From Conceptual to Executable BPMN Process Models A Step-by-Step Method
Workflow and BPM in the New Enterprise Architecture
D1 3 200710 Poznan+Paris Bpm Arch
Business Process Modeling & Automation: Where are we?
BPM & Workflow in the New Enterprise Architecture
BPM & Workflow in the New Enterprise Architecture
Case study: Camunda BPM in PwC project
2. oracle bpm soa 11g - simple - unified - complete
Bpms, Putting Business In The Driver’S Seat
Fundamentals of business process management and BPMN
BPM - What is next
Next generation BPM
Proceedit 20110819 Companys Presentation For Partners Eng Dol
Bpms
Business Process Management Training | By ex-Deloitte & McKinsey Consultants
Fundamentals of Business Process Management - Tutorial at CAiSE'2018
Evolution of Workflow Technology: Usages, Architectures, Languages
Business Process Management - What is it, and why all the buzz?
BPM - The Promise And Challenges
Ad

More from Marlon Dumas (20)

PPTX
LLM-Assisted Optimization of Waiting Time in Business Processes: A Prompting ...
PPTX
Explanatory Capabilities of Large Language Models in Prescriptive Process Mon...
PPTX
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
PPTX
How GenAI will (not) change your business?
PPTX
Walking the Way from Process Mining to AI-Driven Process Optimization
PPTX
Discovery and Simulation of Business Processes with Probabilistic Resource Av...
PPTX
Can I Trust My Simulation Model? Measuring the Quality of Business Process Si...
PPTX
Business Process Optimization: Status and Perspectives
PPTX
Learning When to Treat Business Processes: Prescriptive Process Monitoring wi...
PPTX
Why am I Waiting Data-Driven Analysis of Waiting Times in Business Processes
PPTX
Augmented Business Process Management
PPTX
Process Mining and Data-Driven Process Simulation
PPTX
Modeling Extraneous Activity Delays in Business Process Simulation
PPTX
Business Process Simulation with Differentiated Resources: Does it Make a Dif...
PPTX
Prescriptive Process Monitoring Under Uncertainty and Resource Constraints
PPTX
Robotic Process Mining
PPTX
Accurate and Reliable What-If Analysis of Business Processes: Is it Achievable?
PPTX
Learning Accurate Business Process Simulation Models from Event Logs via Auto...
PPTX
Process Mining: A Guide for Practitioners
PPTX
Process Mining for Process Improvement.pptx
LLM-Assisted Optimization of Waiting Time in Business Processes: A Prompting ...
Explanatory Capabilities of Large Language Models in Prescriptive Process Mon...
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
How GenAI will (not) change your business?
Walking the Way from Process Mining to AI-Driven Process Optimization
Discovery and Simulation of Business Processes with Probabilistic Resource Av...
Can I Trust My Simulation Model? Measuring the Quality of Business Process Si...
Business Process Optimization: Status and Perspectives
Learning When to Treat Business Processes: Prescriptive Process Monitoring wi...
Why am I Waiting Data-Driven Analysis of Waiting Times in Business Processes
Augmented Business Process Management
Process Mining and Data-Driven Process Simulation
Modeling Extraneous Activity Delays in Business Process Simulation
Business Process Simulation with Differentiated Resources: Does it Make a Dif...
Prescriptive Process Monitoring Under Uncertainty and Resource Constraints
Robotic Process Mining
Accurate and Reliable What-If Analysis of Business Processes: Is it Achievable?
Learning Accurate Business Process Simulation Models from Event Logs via Auto...
Process Mining: A Guide for Practitioners
Process Mining for Process Improvement.pptx

Recently uploaded (20)

PDF
Equity at the Helm_ Guiding Schools Through Inclusive Leadership by Dr.pdf
PDF
Human resources management is a best management
PPTX
Supervisory Styles and When to Use Them!
PPTX
Course Overview of the Course Titled.pptx
PDF
Case study -Uber strategic plan and management
PDF
The Cyber SwarmShield by Stéphane Nappo
PDF
ORGANIZATIONAL communication -concepts and importance._20250806_112132_0000.pdf
PDF
CISSP Domain 5: Identity and Access Management (IAM)
PPTX
2. CYCLE OF FUNCTIONING RIFLE -PP Presentation..pptx
PDF
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
PPTX
Chapter One an overview of political economy
PPTX
Improved_Leadership_in_Total_Quality_Lesson.pptx
PDF
CISSP - Domain 7: Security Operations - InfoSec Institute
PPTX
Human Resource Management | Introduction,Meaning and Definition
PPTX
Consulting on marketing-The needs wants and demands are a very important comp...
PDF
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
PDF
Organisational Behaviour And it's concepts
PPTX
Human resources management -job perception concept
PPTX
Psychological_Contract_Presentation.pptx
PDF
Timeless Leadership Principles from History’s Greatest Figures by Alfonso Ken...
Equity at the Helm_ Guiding Schools Through Inclusive Leadership by Dr.pdf
Human resources management is a best management
Supervisory Styles and When to Use Them!
Course Overview of the Course Titled.pptx
Case study -Uber strategic plan and management
The Cyber SwarmShield by Stéphane Nappo
ORGANIZATIONAL communication -concepts and importance._20250806_112132_0000.pdf
CISSP Domain 5: Identity and Access Management (IAM)
2. CYCLE OF FUNCTIONING RIFLE -PP Presentation..pptx
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
Chapter One an overview of political economy
Improved_Leadership_in_Total_Quality_Lesson.pptx
CISSP - Domain 7: Security Operations - InfoSec Institute
Human Resource Management | Introduction,Meaning and Definition
Consulting on marketing-The needs wants and demands are a very important comp...
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
Organisational Behaviour And it's concepts
Human resources management -job perception concept
Psychological_Contract_Presentation.pptx
Timeless Leadership Principles from History’s Greatest Figures by Alfonso Ken...

Business Process Automation and Data Processing Workflows

  • 1. Business Process Automation and Data Processing Workflows Marlon Dumas University of Tartu, Estonia marlon.dumas@ut.ee Istat, Rome, 4 May 2018
  • 2. The Business Process Management Lifecycle Process identification Conformance and performance insights Conformance and performance insights Process monitoring and controlling Executable process model Executable process model Process implementation To-be process model To-be process model Process analysis As-is process model As-is process model Process discovery Process architectureProcess architecture Process redesign Insights on weaknesses and their impact Insights on weaknesses and their impact 2
  • 3. Automating: 1. The scheduling and routing of tasks in a process 2. The handling of data associated to the process 3. The assignment of tasks to resources and interactions with applications 4. The monitoring of the process … All this on the basis of process models What is Process Automation? 3
  • 4. Example of process automation (Danske Bank) Customer Advisor Backoffice workers XML Case Transfer System Service A Service B Service C Not valid Create Credit BPMS © Steen Brahe, 2007 4
  • 5. Hajo Reijers et al. (2016) “The effectiveness of workflow management systems: A longitudinal study” • 10 Dutch organizations implementing a workflow management system followed over a 10-years period • Measured KPIs before and after (25 processes) • Cycle time (lead time): average time from start to end of a case • Waiting time: time a case spends in “idle” mode • Resource utilization: percentage of times resources are busy Why Process Automation? 5
  • 6. Effect on cycle time 6 before after
  • 7. Effect on wait times 7
  • 8. Effect on resource utilization 8
  • 9. 1. Custom Software • Don’t do it unless you have a well-funded IT department and special requirements, or tackling very simple processes in a specific context… 2. Packaged Enterprise Systems • Enterprise Resource Planning (ERP), Customer Relationship Management (CRM) systems 3. Document Management Systems (DMS)  Nowadays called Enterprise Content Management Systems (ECMS) 4. Business Process Management System (BPMS) • Especially designed for process automation 5. Data Processing Workflows • Specialized for automation of data processing pipelines 6. Robotic Process Automation  Automation of tasks and routines (not covered in this talk) Process Automation Technology 9
  • 10. • Support standardized processes with configuration options • Lead generation, lead-to-order, … • Order-to-cash, invoice-to-cash, stock replenishment, procure-to-pay, ... • Recruitment, roster & scheduling, payroll, … • ERP, CRM, SCM, e.g. • SAP Suite • Oracle Apps • MS Dynamics CRM/ERP • Salesforce, Intacct, NetSuite, Acumatica, … • Compiere, OpenERP, Odoo, … • Most of them support configuration via process flows, e.g. • SAP Process Orchestration • Business process flows and workflows in Dynamics CRM Packaged Enterprise Systems 10
  • 11. • Suitable for single-document processes (document routing) • Simple purchase requests, travel requests, … • Sometimes marketed as part of Enterprise Content Management (ECM) sytsems • Examples • Documentum Workflows • Adobe LiveCycle • MS SharePoint workflow • … Document Management Systems 11
  • 13. BPMS Landscape Big vendors • IBM BPM • Oracle BPMS • Microsoft BizTalk • Software AG webMethods Other closed-source • Appian BPMS • BizAgi BPM Suite • Bosch inubit Suite • OpenText BPM • Pegaystems Pega BPM Platform • Progress Savvion • TIBCO ActiveMatrix BPM Open-source • Bonita BPM • Camunda • JBoss jBPM • YAWL 13
  • 14. • Have dozens or hundreds of distinct processes that: • Consists of combination of manual and automated steps • Involve decision points, rework loops, time-outs, exception handling (complex control-flow) • Need to be traced • Are executed frequently/regularly • Do not involve automated processing of large or unstructured data (“small” structured data) • The processes are expected to evolve from times to times • So hard-coding the processes in custom software is not flexible enough • Have a heterogenous IT applications (incl. legacy applications) that are exposed via Application Programming Interfaces (APIs) When to use a BPMS? 14
  • 15. Tools intended to automate processes where: • A number of data sources • DB tables, CSV files, semi-structured documents, textual documents, … • …are transformed into data outputs • Tables, reports, statistical measures, etc. • …via multiple steps • Extraction, pre-processing/cleaning, transformation, splitting, merging, aggregation, and validation steps • Typically automated steps • …inter-linked via dependencies • Data-flow dependencies (output of one step is input of another) • But can also be control-flow (decision points, loops, etc.) • In a traceable and reproducible manner Data Processing Workflow Systems 15
  • 16. Data Processing Workflow (examples) 16
  • 17. • KNIME (open-source) • RapidMiner (partially open-source) • Alteryx • Angoss • SAS Workflow • … Data Processing Tools 17
  • 18. • Have lots of data processing pipelines that: • Mostly consists of automated steps (few manual steps, if any) • Not many decision points or rework loops (if any) • Keep evolving • Need to be traced • Are executed frequently/regularly • Have users with different levels of expertise • Not everyone is an R hacker • Need to work with heterogeneous data and data sources • Need flexibility to run data processing pipelines on single- node, private cloud, etc. When to use a data processing workflow system? 18
  • 19. Table of Contents 1. Introduction 2. Process Identification 3. Process Modeling 4. Advanced Process Modeling 5. Process Discovery 6. Qualitative Process Analysis 7. Quantitative Process Analysis 8. Process Redesign 9. Process-Aware Information Systems 10. Executable Process Modeling 11. Process Monitoring 12. BPM as an Enterprise Capability http://fundamentals-of-bpm.org 19