SlideShare a Scribd company logo
TENCompetence Workshop, Manchester 2007 Designing Systems for Managing Collaborative Research Processes Scott Wilson, CETIS; Yoichi Takayama, Ernie Ghiglione, James Dalziel, MELCOE This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence
Context Two linked projects: RAMS & DRAMA Research by MELCOE Funded by DEST as part of programme backing Australia’s research capability
Why  collaborative  research workflow? Plenty of work to date in process automation, especially data analysis Relatively little work on communication and collaboration-heavy processes Emphasis in funding on collaborative work (e.g. multi-partner) but patchy practice Possibility of scaffolding collaborative processes to improve effectiveness
Which kinds of processes? Research management Research quality assessment Online research collaboration Data collection Monitoring, positioning new opportunities Proposal development Scheduling
Research process characteristics May be weakly structured While some processes may be pre-determined, the majority exhibit dynamic properties, and may diverge from design at runtime Alternate periods of individual and team activity
Potential benefits Greater standardisation of common or repeatable research processes, leading to higher quality outcomes and improved efficiency;  The ability to share descriptions of common research processes both within institutions, and between institutions – including the ability to adapt and localise shared research processes; Greatly improved accountability and audit for processes involving multiple actors across multiple steps – such as for research assessment (e.g., RQF/RAE assessor workflows), as well as for research itself (e.g., as a deterrent to academic fraud); and  Providing a process-oriented checklist to ensure the ordered completion of relevant research tasks.
Potential risks The technology may be costly when compared to the actual benefits The technology may require new competences to devise and execute research processes, placing control of such processes into the hands of IT specialists rather than researchers themselves The technology may restrict unnecessarily the diversity of activities and approaches to conducting research The technology may be perceived as an attempt to control rather than enable the work of researchers
Six Lenses (so far…) BPM HIM BPOKM CSC Learning Design VSM
Simple workflow…
… can exhibit complex behaviour
Is it worth the trouble? “ One might argue that in a world where routine processes have been automated by systems, these value-adding, creative, innovative human activities are what business is all about.  An organisation in which people interacted only via scripts loaded into machines could not think, could not respond, could not change and could not possibly provide effective support for its customers.  And if human-driven processes are indeed critical, they deserve effective computer support.” (Harrison-Broninski (2004)
Cybernetic Analysis using the VSM Attempt to identify design principles using structured approach the VSM by Stafford Beer Previously applied in pedagogic analysis of elearning systems (Liber & Britain, 1999 & 2004)
Simplified VSM (Liber & Britain, 2004)
Topics of analysis Distribution of work Monitoring Audit Self-organisation Reverberation Strategy
Distribution of work How do users end up in process roles? How are resources managed? Useful perspectives: Winograd and Flores (1986): CFA Russell et al (2004): workflow resource patterns
Simplistic concepts of work distribution abound in IT systems…
But simplicity can be deceptive! In some cases it just pushes complexity to the outside
 
 
Other considerations in work distribution Capability management Role-capability mapping and user-capability assessment
Monitoring (system 3) Monitoring for variety management Monitoring and self-regulation Challenge: identifying process states in dynamic, diverging processes Solutions: minimal representations (van der Alst, 2001); analog roll-up; declaration Issues: assumptions of control Requirement for openness in monitoring
Audit (System 3*) Process auditing Rewind and reflect Sampling Intervention
Self-organisation Self-organization can dramatically reduce the management demands of a system Delegation of process design Delegation of process initiation Requirement for workflow tools to be usable by process participants, not specialists
Reverberation Avoiding ‘process blindness’ or blinkered viewpoint leading to clashing activities Cross-cutting communication; openness of processes across related groups
Unforeseen events In work distribution, requiring reallocation, escalation, delegation… In process development, requiring redesign, termination, suspension… Monitoring and intervention Algedonic channel
Strategy (System 4) Forecasting Monitoring trends in the wider world Implementing strategy
Recursions and perspectives Work Item Work Package Project  Team Unit Department University/Company Consortium
From LAMS to RAMS Flexible role definitions supporting dynamic processes and shared ownership Choice of work distribution models, not just “simple assignment” Processes able to be redesigned while running by the participants Monitoring interfaces available for all participants, not just “teacher” role Analog and asserted digital indicators for monitoring Dashboard for multiple-level monitoring Tools to interact with more structured processes (e.g. bid/RQF submission, grid data processes)
Modified WfMC Reference Model
 
 
 
Observations Collaborative processes do not lend themselves to todays BPM methods Requirements for eResearch turned up using VSM-driven approach are also useful in eLearning
Future work Aligning process and policy (and the gray area inbetween) Capability management Validation of the approach
Cheers! [email_address] http://www.cetis.ac.uk/members/scott

More Related Content

PPT
SSADM
PPT
Defining Systems
PPTX
SYSTEM ANALYSIS AND DESIGN Assignment help
PPT
The Pragmatic Evaluation of Tool System Interoperability
PPTX
Software Development Methodologies-HSM, SSADM
PDF
Unit 11-systems-analysis-and-design
DOCX
Structured systems analysis and design methodology
PPTX
System analysis and design Part2
SSADM
Defining Systems
SYSTEM ANALYSIS AND DESIGN Assignment help
The Pragmatic Evaluation of Tool System Interoperability
Software Development Methodologies-HSM, SSADM
Unit 11-systems-analysis-and-design
Structured systems analysis and design methodology
System analysis and design Part2

What's hot (8)

PPT
Monica Crocker Implementing Ecm Aiim 2009
PDF
Success Factors for Enterprise Systems in the Higher Education Sector: A Case...
PPT
SAD 1st PPT
PDF
Determining Requirements Complexity - White Paper
PPT
Requirements Engineering Processes in Software Engineering SE6
PPT
W3 requirements engineering processes
PPT
Requirement Determination Process
Monica Crocker Implementing Ecm Aiim 2009
Success Factors for Enterprise Systems in the Higher Education Sector: A Case...
SAD 1st PPT
Determining Requirements Complexity - White Paper
Requirements Engineering Processes in Software Engineering SE6
W3 requirements engineering processes
Requirement Determination Process
Ad

Viewers also liked (20)

PPT
Õpidisaini põhimõtted
PPT
Fertilisers
ODP
Encyclopedie van de japanologie
PPT
elearning4
PPTX
Stylita
PDF
Katy Fit Kids Calendar
PPT
The New Gathering Place - Social Media for Arts Businessess
PDF
TEDx talk: How digital ecosystem changes learning
PDF
Castillo de Ainsa
PPT
Czy wlasciciel serwisu moze wpływac na jakosc User Generated Content?
PDF
Wplyw UGC na decyzje konsumentow
PPT
Esitluse loomise metoodika ja avaldamine veebis
PDF
Thurrock Cabinet Paper
PDF
Trappers Traders Cabin
PPT
Getting the Maximum Benefit from Free and Open Source Software
PPT
Den 2 geocaching_day_2010[1]
PPT
Presentatie Slm 4 Dec 2008
PPT
Unit 3 - Introduction
PPTX
Integrating figshare into our RDM workflow: University of Salford
PPT
Exploring New Technologies
Õpidisaini põhimõtted
Fertilisers
Encyclopedie van de japanologie
elearning4
Stylita
Katy Fit Kids Calendar
The New Gathering Place - Social Media for Arts Businessess
TEDx talk: How digital ecosystem changes learning
Castillo de Ainsa
Czy wlasciciel serwisu moze wpływac na jakosc User Generated Content?
Wplyw UGC na decyzje konsumentow
Esitluse loomise metoodika ja avaldamine veebis
Thurrock Cabinet Paper
Trappers Traders Cabin
Getting the Maximum Benefit from Free and Open Source Software
Den 2 geocaching_day_2010[1]
Presentatie Slm 4 Dec 2008
Unit 3 - Introduction
Integrating figshare into our RDM workflow: University of Salford
Exploring New Technologies
Ad

Similar to Designing systems for managing dynamic collaborative research processes (20)

PDF
Climbing the tree of unreachable fruits, reusing processes
PPT
Content workflow amber_swope_submitted
PPT
Begining The Analysys Invetigating System Requirement
PDF
S-CUBE LP: Chemical Modeling: Workflow Enactment based on the Chemical Metaphor
PDF
Towards an Open and Scientific Approach to Innovation Processes
PPTX
Socio organizational issues ppt
PPT
Vcs platform verhaal final
PPT
Situational Method Engineering
PPT
LIMS_ASQ.pptx
PDF
9 madderi sivalingamsaravanan_106-110
PDF
Traditional to Agile Development
ODT
Workflow Usage Best Practices
PPT
Rsc 2009 Process Management Yesterday Today Tomorrow
PPT
PPTX
Workflow User Interfaces Patterns
PPT
OLE Regional Workshop, Utah, Day One
PPT
Call2013
PPTX
Workflow systems
PDF
Speedbump or Springboard? Leveraging Change to Move Nintex Promapp Forward
PDF
chapter04-120827115356-phpapp01.pdf
Climbing the tree of unreachable fruits, reusing processes
Content workflow amber_swope_submitted
Begining The Analysys Invetigating System Requirement
S-CUBE LP: Chemical Modeling: Workflow Enactment based on the Chemical Metaphor
Towards an Open and Scientific Approach to Innovation Processes
Socio organizational issues ppt
Vcs platform verhaal final
Situational Method Engineering
LIMS_ASQ.pptx
9 madderi sivalingamsaravanan_106-110
Traditional to Agile Development
Workflow Usage Best Practices
Rsc 2009 Process Management Yesterday Today Tomorrow
Workflow User Interfaces Patterns
OLE Regional Workshop, Utah, Day One
Call2013
Workflow systems
Speedbump or Springboard? Leveraging Change to Move Nintex Promapp Forward
chapter04-120827115356-phpapp01.pdf

More from scottw (20)

PPT
How to engage students in real open source projects
PPT
Free, Libre and Open Source Software and Further Education
PDF
Open Forges and App Stores
PPT
Delivering Web To Mobile
PPT
Creating mobile web apps
PDF
Widgets and Mashups for Personal and Institutional Technologies
PDF
Open Source Junction: Apache Wookie and W3C Widgets
PDF
Dissemination beyond academic circles
PDF
Android
PDF
Wookie Intro
PDF
Build Widgets
PPT
Wookie Meetup
PPT
Wookie Meetup
PPT
Life of a Wookie
PPT
CRM & HE
PDF
Presence
PDF
FeedForward at RSP
PPT
Boxcri
PDF
Widgets And Wookies
PPT
Widgets - the Wookie project
How to engage students in real open source projects
Free, Libre and Open Source Software and Further Education
Open Forges and App Stores
Delivering Web To Mobile
Creating mobile web apps
Widgets and Mashups for Personal and Institutional Technologies
Open Source Junction: Apache Wookie and W3C Widgets
Dissemination beyond academic circles
Android
Wookie Intro
Build Widgets
Wookie Meetup
Wookie Meetup
Life of a Wookie
CRM & HE
Presence
FeedForward at RSP
Boxcri
Widgets And Wookies
Widgets - the Wookie project

Recently uploaded (20)

PDF
Approach and Philosophy of On baking technology
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Electronic commerce courselecture one. Pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Advanced Soft Computing BINUS July 2025.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Modernizing your data center with Dell and AMD
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
KodekX | Application Modernization Development
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Advanced IT Governance
PDF
NewMind AI Monthly Chronicles - July 2025
Approach and Philosophy of On baking technology
Diabetes mellitus diagnosis method based random forest with bat algorithm
Electronic commerce courselecture one. Pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Advanced Soft Computing BINUS July 2025.pdf
Unlocking AI with Model Context Protocol (MCP)
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Modernizing your data center with Dell and AMD
Network Security Unit 5.pdf for BCA BBA.
Chapter 3 Spatial Domain Image Processing.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
KodekX | Application Modernization Development
Advanced methodologies resolving dimensionality complications for autism neur...
20250228 LYD VKU AI Blended-Learning.pptx
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Advanced IT Governance
NewMind AI Monthly Chronicles - July 2025

Designing systems for managing dynamic collaborative research processes

  • 1. TENCompetence Workshop, Manchester 2007 Designing Systems for Managing Collaborative Research Processes Scott Wilson, CETIS; Yoichi Takayama, Ernie Ghiglione, James Dalziel, MELCOE This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence
  • 2. Context Two linked projects: RAMS & DRAMA Research by MELCOE Funded by DEST as part of programme backing Australia’s research capability
  • 3. Why collaborative research workflow? Plenty of work to date in process automation, especially data analysis Relatively little work on communication and collaboration-heavy processes Emphasis in funding on collaborative work (e.g. multi-partner) but patchy practice Possibility of scaffolding collaborative processes to improve effectiveness
  • 4. Which kinds of processes? Research management Research quality assessment Online research collaboration Data collection Monitoring, positioning new opportunities Proposal development Scheduling
  • 5. Research process characteristics May be weakly structured While some processes may be pre-determined, the majority exhibit dynamic properties, and may diverge from design at runtime Alternate periods of individual and team activity
  • 6. Potential benefits Greater standardisation of common or repeatable research processes, leading to higher quality outcomes and improved efficiency; The ability to share descriptions of common research processes both within institutions, and between institutions – including the ability to adapt and localise shared research processes; Greatly improved accountability and audit for processes involving multiple actors across multiple steps – such as for research assessment (e.g., RQF/RAE assessor workflows), as well as for research itself (e.g., as a deterrent to academic fraud); and Providing a process-oriented checklist to ensure the ordered completion of relevant research tasks.
  • 7. Potential risks The technology may be costly when compared to the actual benefits The technology may require new competences to devise and execute research processes, placing control of such processes into the hands of IT specialists rather than researchers themselves The technology may restrict unnecessarily the diversity of activities and approaches to conducting research The technology may be perceived as an attempt to control rather than enable the work of researchers
  • 8. Six Lenses (so far…) BPM HIM BPOKM CSC Learning Design VSM
  • 10. … can exhibit complex behaviour
  • 11. Is it worth the trouble? “ One might argue that in a world where routine processes have been automated by systems, these value-adding, creative, innovative human activities are what business is all about. An organisation in which people interacted only via scripts loaded into machines could not think, could not respond, could not change and could not possibly provide effective support for its customers. And if human-driven processes are indeed critical, they deserve effective computer support.” (Harrison-Broninski (2004)
  • 12. Cybernetic Analysis using the VSM Attempt to identify design principles using structured approach the VSM by Stafford Beer Previously applied in pedagogic analysis of elearning systems (Liber & Britain, 1999 & 2004)
  • 13. Simplified VSM (Liber & Britain, 2004)
  • 14. Topics of analysis Distribution of work Monitoring Audit Self-organisation Reverberation Strategy
  • 15. Distribution of work How do users end up in process roles? How are resources managed? Useful perspectives: Winograd and Flores (1986): CFA Russell et al (2004): workflow resource patterns
  • 16. Simplistic concepts of work distribution abound in IT systems…
  • 17. But simplicity can be deceptive! In some cases it just pushes complexity to the outside
  • 18.  
  • 19.  
  • 20. Other considerations in work distribution Capability management Role-capability mapping and user-capability assessment
  • 21. Monitoring (system 3) Monitoring for variety management Monitoring and self-regulation Challenge: identifying process states in dynamic, diverging processes Solutions: minimal representations (van der Alst, 2001); analog roll-up; declaration Issues: assumptions of control Requirement for openness in monitoring
  • 22. Audit (System 3*) Process auditing Rewind and reflect Sampling Intervention
  • 23. Self-organisation Self-organization can dramatically reduce the management demands of a system Delegation of process design Delegation of process initiation Requirement for workflow tools to be usable by process participants, not specialists
  • 24. Reverberation Avoiding ‘process blindness’ or blinkered viewpoint leading to clashing activities Cross-cutting communication; openness of processes across related groups
  • 25. Unforeseen events In work distribution, requiring reallocation, escalation, delegation… In process development, requiring redesign, termination, suspension… Monitoring and intervention Algedonic channel
  • 26. Strategy (System 4) Forecasting Monitoring trends in the wider world Implementing strategy
  • 27. Recursions and perspectives Work Item Work Package Project Team Unit Department University/Company Consortium
  • 28. From LAMS to RAMS Flexible role definitions supporting dynamic processes and shared ownership Choice of work distribution models, not just “simple assignment” Processes able to be redesigned while running by the participants Monitoring interfaces available for all participants, not just “teacher” role Analog and asserted digital indicators for monitoring Dashboard for multiple-level monitoring Tools to interact with more structured processes (e.g. bid/RQF submission, grid data processes)
  • 30.  
  • 31.  
  • 32.  
  • 33. Observations Collaborative processes do not lend themselves to todays BPM methods Requirements for eResearch turned up using VSM-driven approach are also useful in eLearning
  • 34. Future work Aligning process and policy (and the gray area inbetween) Capability management Validation of the approach