SlideShare a Scribd company logo
FP7 Serenoa (ICT Call 5)
                Multi-Dimensional Context-Aware
                Adaptation of Service Front-ends
                      www.serenoa-fp7.eu


                     On behalf of Serenoa project
                          Jean Vanderdonckt
                    Université catholique de Louvain
                   jean.vanderdonckt@uclouvain.be
http://www.slideshare.net/jeanvdd/multidimensional-contextaware-adaptation-of-service-frontends
Overview
• Serenoa is aimed at developing a novel, open platform for
  enabling the creation of context sensitive service front-
  ends (SFEs)
• Context-sensitive SFE provides a user interface (UI) that
   – exhibits some capability to be aware of the context
       • User
       • Platform
       • Environment
   – and to react to changes of this context in a continuous
      way
• Goal: improving people’s satisfaction and performance
  compared to traditional SFEs based on manually designed
  UIs
Computational Framework Domain



CADS                             CARF                           CARFO – OWL
Design                           Refer.
Space                            Frame.




    Context + Reference Models (UML)
                                                Context of Use
                                                Management
    Advanced Adaptation Algorithms
                                                                Adaptation
                            Task & Domain                       Engine
    Authoring Tool
                            Abstract UI        Runtime UI
                                               Generation
    Enabling                Concrete UI
    Technologies
                            Final UI
  Methodology                               Adaptation Engine

Technology Domain
Example: the Google Home Page
According to the Cameleon Ref. Framework


                                                       Task & Domain (T&D)

                   Abstract Interact.
                      Unit (group)
                                                    Abstract User Interface (AUI)
           AIU               AIU             AIU
      DataInputOutput   Trigger         Trigger


                          Window
                                                    Concrete User Interface (CUI)
       textInput          button           button



                                                      Final User Interface (FUI)
Cameleon Reference Framework
 Reification: from high- to lower-level
    T&D → AUI
    AUI → CUI: e.g., a GUI, a vocal UI
    CUI → FUI: e.g., HTML, VB for GUI
     VoiceXML, X+V for Vocal UI                 Task & Domain (T&D)
 Abstraction: from low- to higher-level
    FUI → CUI: e.g., reverse HTML
    CUI → AUI: e.g. for changing modality   Abstract User Interface (AUI)
    AUI → T&D: e.g., for recovering task
 Reflexion: at the same level
      FUI: e.g. transcoding                 Concrete User Interface (CUI)
      CUI: e.g., graceful degradation
      AUI: e.g., restructuring
      T&D: e.g., for retasking                Final User Interface (FUI)
Standardization action with
W3C
• Step 1: W3C Incubator Group on Model-
  Based User Interface Design
  – The Cameleon Reference Framework is a
    reference for expressing the levels of
    abstraction during user interface
    development
  – Recommended in the final report at
    http://www.w3.org/2005/Incubator/model
    -based-ui/XGR-mbui-20100504/ (July 2010)
Standardization action with
W3C
• Step 2: Serenoa partners join their effort
  – IDEAL2 (CTIC): http://files.morfeo-
    project.org/mymobileweb/public/specs/ide
    al2/
  – Maria (ISTI):
    http://giove.isti.cnr.it/tools/MARIA/home
  – UsiXML (UCL): www.usixml.eu,
    www.usixml.org
Standardization action with
W3C
• Step 3: W3C Charter Group on Model-Based User
  Interface Design (http://www.w3.org/wiki/Model-
  Based_User_Interfaces)
   – Also see http://www.w3.org/2011/mbui/
   – Started Feb. 2012, end in Nov. 2013
   – Lead by Dave Raggett <dsr@w3.org>
• Contents
   –   Introduction to MBUI
   –   Glossary of MBUI terms
   –   Task meta-model
   –   Abstract user interface meta-model
Task meta-model
Abstract UI meta-model
(work in progress)
Next steps
• Finalizing the meta-models and interchange
  formats
  – UML2.0 Class Diagram and OWL2 Full ontology
  – XML Schema
• Coverage of use cases
• Software implementation compliant with the
  W3C MBUI format
• Quill – A Collaborative model-based UI editor
  using WebSockets
  – http://www.w3.org/2012/quill/
Thank you very much!
• Some links
  – http://www.w3.org/2011/01/mbui-wg-charter
  – http://www.w3.org/wiki/Model-
    Based_User_Interfaces
  – http://www.w3.org/2012/quill/
  – www.serenoa-fp7.eu

More Related Content

PDF
WPF Intro
PDF
Introduction to java advanced imaging
PPTX
Towards Standardisation in User Interface Development: the UsiXML Contribution
PPT
Communication Dispatch Centers
PPT
A Brief History of Police Technology
PPT
911 Domestic Violence Dispatch Training
PPS
2017 slideshow for hiring
PDF
Modelling the User Interface
WPF Intro
Introduction to java advanced imaging
Towards Standardisation in User Interface Development: the UsiXML Contribution
Communication Dispatch Centers
A Brief History of Police Technology
911 Domestic Violence Dispatch Training
2017 slideshow for hiring
Modelling the User Interface

Similar to Multi-Dimensional Context-Aware Adaptation of Service Front-ends (20)

PDF
Brokerage 2007 presentation hci
PPT
A MDA-Compliant Environment for Developing User Interfaces of Information Sys...
PDF
Paper Alejandro Medrano - Use of hierarchical model-view-controller architect...
PPT
Model-based engineering of multi-platform, synchronous & collaborative UIs
PDF
Second Serenoa Newsletter
PPTX
ARI2132 lecture2
PPT
Model-Driven Engineering of User Interfaces: Promises, Successes, Failures, a...
PDF
ICS2208 Lecture 3
PPTX
Distributing user interfaces. 4th Distributed User Interfaces Workshop on 14t...
PDF
ICS2208 Lecture3 2023-2024 - Model Based User Interfaces
PPTX
ICS2208 lecture2
PDF
Mobile Computing Principles Designing and Developing Mobile Applications with...
PDF
fundamental.pdfhiwuwhsudydjdoshnskahdjsksj
PDF
Sirris presentation
PDF
Poster Serenoa
PDF
Ux Meets Code Interaction Usability
PDF
Framework Engineering
PPT
User Interface Derivation from Business Processes: A Model-Driven Approach fo...
PDF
Mobile Computing Principles Designing And Developing Mobile Applications With...
Brokerage 2007 presentation hci
A MDA-Compliant Environment for Developing User Interfaces of Information Sys...
Paper Alejandro Medrano - Use of hierarchical model-view-controller architect...
Model-based engineering of multi-platform, synchronous & collaborative UIs
Second Serenoa Newsletter
ARI2132 lecture2
Model-Driven Engineering of User Interfaces: Promises, Successes, Failures, a...
ICS2208 Lecture 3
Distributing user interfaces. 4th Distributed User Interfaces Workshop on 14t...
ICS2208 Lecture3 2023-2024 - Model Based User Interfaces
ICS2208 lecture2
Mobile Computing Principles Designing and Developing Mobile Applications with...
fundamental.pdfhiwuwhsudydjdoshnskahdjsksj
Sirris presentation
Poster Serenoa
Ux Meets Code Interaction Usability
Framework Engineering
User Interface Derivation from Business Processes: A Model-Driven Approach fo...
Mobile Computing Principles Designing And Developing Mobile Applications With...
Ad

More from Jean Vanderdonckt (20)

PPTX
https://dl.acm.org/doi/10.1145/3715336.3735706
PPTX
TapStrapGest: Elicitation and Recognition of Ring-based Multi-Finger Gestures
PPTX
Congruent and Hierarchical Gesture Set Design
PPTX
Paired Sketching of Distributed User Interfaces:Workflow, Protocol, Software ...
PPTX
Comparative Testing of 2D Stroke Gesture Recognizers in Multiple Contexts of Use
PPTX
Human-AI Interaction in Space: Insights from a Mars Analog Mission with the H...
PPTX
Gestural Interaction in Virtual/Augmented Reality
PPTX
User-controlled Form Adaptation by Unsupervised Learning
PPTX
Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and Cla...
PPTX
To the end of our possibilities with Adaptive User Interfaces
PPTX
Engineering the Transition of Interactive Collaborative Software from Cloud C...
PPTX
UsyBus: A Communication Framework among Reusable Agents integrating Eye-Track...
PPTX
µV: An Articulation, Rotation, Scaling, and Translation Invariant (ARST) Mult...
PPTX
RepliGES and GEStory: Visual Tools for Systematizing and Consolidating Knowle...
PPTX
Gesture-based information systems: from DesignOps to DevOps
PPTX
Engineering Slidable User Interfaces with Slime
PPTX
Evaluating Gestural Interaction: Models, Methods, and Measures
PPTX
Conducting a Gesture Elicitation Study: How to Get the Best Gestures From Peo...
PPTX
Designing Gestural Interaction: Challenges and Pitfalls
PPTX
Fundamentals of Gestural Interaction
https://dl.acm.org/doi/10.1145/3715336.3735706
TapStrapGest: Elicitation and Recognition of Ring-based Multi-Finger Gestures
Congruent and Hierarchical Gesture Set Design
Paired Sketching of Distributed User Interfaces:Workflow, Protocol, Software ...
Comparative Testing of 2D Stroke Gesture Recognizers in Multiple Contexts of Use
Human-AI Interaction in Space: Insights from a Mars Analog Mission with the H...
Gestural Interaction in Virtual/Augmented Reality
User-controlled Form Adaptation by Unsupervised Learning
Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and Cla...
To the end of our possibilities with Adaptive User Interfaces
Engineering the Transition of Interactive Collaborative Software from Cloud C...
UsyBus: A Communication Framework among Reusable Agents integrating Eye-Track...
µV: An Articulation, Rotation, Scaling, and Translation Invariant (ARST) Mult...
RepliGES and GEStory: Visual Tools for Systematizing and Consolidating Knowle...
Gesture-based information systems: from DesignOps to DevOps
Engineering Slidable User Interfaces with Slime
Evaluating Gestural Interaction: Models, Methods, and Measures
Conducting a Gesture Elicitation Study: How to Get the Best Gestures From Peo...
Designing Gestural Interaction: Challenges and Pitfalls
Fundamentals of Gestural Interaction
Ad

Recently uploaded (20)

PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Big Data Technologies - Introduction.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
KodekX | Application Modernization Development
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Electronic commerce courselecture one. Pdf
PDF
Empathic Computing: Creating Shared Understanding
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
sap open course for s4hana steps from ECC to s4
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
Spectroscopy.pptx food analysis technology
PPTX
MYSQL Presentation for SQL database connectivity
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Reach Out and Touch Someone: Haptics and Empathic Computing
20250228 LYD VKU AI Blended-Learning.pptx
Big Data Technologies - Introduction.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Agricultural_Statistics_at_a_Glance_2022_0.pdf
KodekX | Application Modernization Development
Unlocking AI with Model Context Protocol (MCP)
Electronic commerce courselecture one. Pdf
Empathic Computing: Creating Shared Understanding
Programs and apps: productivity, graphics, security and other tools
sap open course for s4hana steps from ECC to s4
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
The AUB Centre for AI in Media Proposal.docx
Spectroscopy.pptx food analysis technology
MYSQL Presentation for SQL database connectivity
MIND Revenue Release Quarter 2 2025 Press Release
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf

Multi-Dimensional Context-Aware Adaptation of Service Front-ends

  • 1. FP7 Serenoa (ICT Call 5) Multi-Dimensional Context-Aware Adaptation of Service Front-ends www.serenoa-fp7.eu On behalf of Serenoa project Jean Vanderdonckt Université catholique de Louvain jean.vanderdonckt@uclouvain.be http://www.slideshare.net/jeanvdd/multidimensional-contextaware-adaptation-of-service-frontends
  • 2. Overview • Serenoa is aimed at developing a novel, open platform for enabling the creation of context sensitive service front- ends (SFEs) • Context-sensitive SFE provides a user interface (UI) that – exhibits some capability to be aware of the context • User • Platform • Environment – and to react to changes of this context in a continuous way • Goal: improving people’s satisfaction and performance compared to traditional SFEs based on manually designed UIs
  • 3. Computational Framework Domain CADS CARF CARFO – OWL Design Refer. Space Frame. Context + Reference Models (UML) Context of Use Management Advanced Adaptation Algorithms Adaptation Task & Domain Engine Authoring Tool Abstract UI Runtime UI Generation Enabling Concrete UI Technologies Final UI Methodology Adaptation Engine Technology Domain
  • 4. Example: the Google Home Page According to the Cameleon Ref. Framework Task & Domain (T&D) Abstract Interact. Unit (group) Abstract User Interface (AUI) AIU AIU AIU DataInputOutput Trigger Trigger Window Concrete User Interface (CUI) textInput button button Final User Interface (FUI)
  • 5. Cameleon Reference Framework  Reification: from high- to lower-level  T&D → AUI  AUI → CUI: e.g., a GUI, a vocal UI  CUI → FUI: e.g., HTML, VB for GUI VoiceXML, X+V for Vocal UI Task & Domain (T&D)  Abstraction: from low- to higher-level  FUI → CUI: e.g., reverse HTML  CUI → AUI: e.g. for changing modality Abstract User Interface (AUI)  AUI → T&D: e.g., for recovering task  Reflexion: at the same level  FUI: e.g. transcoding Concrete User Interface (CUI)  CUI: e.g., graceful degradation  AUI: e.g., restructuring  T&D: e.g., for retasking Final User Interface (FUI)
  • 6. Standardization action with W3C • Step 1: W3C Incubator Group on Model- Based User Interface Design – The Cameleon Reference Framework is a reference for expressing the levels of abstraction during user interface development – Recommended in the final report at http://www.w3.org/2005/Incubator/model -based-ui/XGR-mbui-20100504/ (July 2010)
  • 7. Standardization action with W3C • Step 2: Serenoa partners join their effort – IDEAL2 (CTIC): http://files.morfeo- project.org/mymobileweb/public/specs/ide al2/ – Maria (ISTI): http://giove.isti.cnr.it/tools/MARIA/home – UsiXML (UCL): www.usixml.eu, www.usixml.org
  • 8. Standardization action with W3C • Step 3: W3C Charter Group on Model-Based User Interface Design (http://www.w3.org/wiki/Model- Based_User_Interfaces) – Also see http://www.w3.org/2011/mbui/ – Started Feb. 2012, end in Nov. 2013 – Lead by Dave Raggett <dsr@w3.org> • Contents – Introduction to MBUI – Glossary of MBUI terms – Task meta-model – Abstract user interface meta-model
  • 11. Next steps • Finalizing the meta-models and interchange formats – UML2.0 Class Diagram and OWL2 Full ontology – XML Schema • Coverage of use cases • Software implementation compliant with the W3C MBUI format • Quill – A Collaborative model-based UI editor using WebSockets – http://www.w3.org/2012/quill/
  • 12. Thank you very much! • Some links – http://www.w3.org/2011/01/mbui-wg-charter – http://www.w3.org/wiki/Model- Based_User_Interfaces – http://www.w3.org/2012/quill/ – www.serenoa-fp7.eu

Editor's Notes

  • #4: GivenThe context consists of CADS + CARF: it is a generic meta-model that defines context information (in a broad approach)The context of use management includes: pre-processing (sensing and treating information) by instantiating the RMThe adaptation engine takes the instances of the RM given by the Context of Use Management and matches them with the AAA, producing as a result a selection of methods, techniques and strategies to perform and present (respectively) adapted UIThe main open questions that remainHow the runtime UI generation is related with the “Cameleon RF”How the authoring tool and the enabling technologies are involved? (the enabling technologies can be ‘decided’/’inferred’ by the AAA based on information provided by the set: Contex+RM+Context of Use Management)
  • #7: GivenThe context consists of CADS + CARF: it is a generic meta-model that defines context information (in a broad approach)The context of use management includes: pre-processing (sensing and treating information) by instantiating the RMThe adaptation engine takes the instances of the RM given by the Context of Use Management and matches them with the AAA, producing as a result a selection of methods, techniques and strategies to perform and present (respectively) adapted UIThe main open questions that remainHow the runtime UI generation is related with the “Cameleon RF”How the authoring tool and the enabling technologies are involved? (the enabling technologies can be ‘decided’/’inferred’ by the AAA based on information provided by the set: Contex+RM+Context of Use Management)
  • #8: GivenThe context consists of CADS + CARF: it is a generic meta-model that defines context information (in a broad approach)The context of use management includes: pre-processing (sensing and treating information) by instantiating the RMThe adaptation engine takes the instances of the RM given by the Context of Use Management and matches them with the AAA, producing as a result a selection of methods, techniques and strategies to perform and present (respectively) adapted UIThe main open questions that remainHow the runtime UI generation is related with the “Cameleon RF”How the authoring tool and the enabling technologies are involved? (the enabling technologies can be ‘decided’/’inferred’ by the AAA based on information provided by the set: Contex+RM+Context of Use Management)
  • #9: GivenThe context consists of CADS + CARF: it is a generic meta-model that defines context information (in a broad approach)The context of use management includes: pre-processing (sensing and treating information) by instantiating the RMThe adaptation engine takes the instances of the RM given by the Context of Use Management and matches them with the AAA, producing as a result a selection of methods, techniques and strategies to perform and present (respectively) adapted UIThe main open questions that remainHow the runtime UI generation is related with the “Cameleon RF”How the authoring tool and the enabling technologies are involved? (the enabling technologies can be ‘decided’/’inferred’ by the AAA based on information provided by the set: Contex+RM+Context of Use Management)
  • #10: GivenThe context consists of CADS + CARF: it is a generic meta-model that defines context information (in a broad approach)The context of use management includes: pre-processing (sensing and treating information) by instantiating the RMThe adaptation engine takes the instances of the RM given by the Context of Use Management and matches them with the AAA, producing as a result a selection of methods, techniques and strategies to perform and present (respectively) adapted UIThe main open questions that remainHow the runtime UI generation is related with the “Cameleon RF”How the authoring tool and the enabling technologies are involved? (the enabling technologies can be ‘decided’/’inferred’ by the AAA based on information provided by the set: Contex+RM+Context of Use Management)
  • #11: GivenThe context consists of CADS + CARF: it is a generic meta-model that defines context information (in a broad approach)The context of use management includes: pre-processing (sensing and treating information) by instantiating the RMThe adaptation engine takes the instances of the RM given by the Context of Use Management and matches them with the AAA, producing as a result a selection of methods, techniques and strategies to perform and present (respectively) adapted UIThe main open questions that remainHow the runtime UI generation is related with the “Cameleon RF”How the authoring tool and the enabling technologies are involved? (the enabling technologies can be ‘decided’/’inferred’ by the AAA based on information provided by the set: Contex+RM+Context of Use Management)