SlideShare a Scribd company logo
OP: A Novel Programming Model
for Integrated Design and Prototyping
           of Mixed Objects
           Céline Coutrix, Laurence Nigay
    Laboratoire d’Informatique de Grenoble, France




                          1
Context
• Mixed Reality Interfaces




                     2
Problem

• Prototyping mixed physical-digital interfaces:
  Different problems
  -   Lower technical difficulties
  -   Enable new users
  -   Adequacy to the design problem


                         3
Problem
              • The design problem




[Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann
Publishers Inc., San Francisco, CA, USA]

                                                           4
Problem
              • The design problem




[Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann
Publishers Inc., San Francisco, CA, USA]

                                                           5
Problem
              • The design problem




[Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann
Publishers Inc., San Francisco, CA, USA]

                                                           6
Problem
              • The design problem




[Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann
Publishers Inc., San Francisco, CA, USA]

                                                           7
Problem
              • The design problem: Elaboration

    Conceptual                                                                                 Practical
     activity                                                                                   activity



[Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann
Publishers Inc., San Francisco, CA, USA]

                                                           8
Problem
              • The design problem: Elaboration

    Interaction                                                                              Prototyping
      Models                                                                                   toolkits



[Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann
Publishers Inc., San Francisco, CA, USA]

                                                           9
Problem
• Gap between interaction models and
  prototyping toolkits

 Interaction                   Prototyping
   Models                        toolkits


 -   Slows down the elaboration of ideas

                     10
Problem

• Lower technical difficulties
• Enable new users
• Adequacy to the design problem

                   11
Contribution
     • OP (Object Prototyping) Toolkit
      - Library of software elements
         •   Materializing the concepts of an
             interaction model
         •   Using Qt signals and slots mechanism

Mixed Interaction
                                       OP toolkit
     Model
                            12
OP
• Underlying interaction model:
  The Mixed Interaction Model
• Why this one?
 - Has been compared to others and
     proved interesting
 -   Not easily used though, like the others


                      13
OP

• Concepts implemented by OP
 - Core concept: the mixed (physical-digital)
    object




                     14
OP

• Concepts implemented by OP
 - Core concept: the mixed (physical-digital)
    object




                     15
OP
• Concepts implemented by OP
        Digital Properties           is exposed to light




       Physical Properties   shape, colors, weight, markers, etc.
                    16
OP
• Concepts implemented by OP
        Digital Properties           is exposed to light




        Linking Modalities



       Physical Properties   shape, colors, weight, markers, etc.
                    17
OP
• Concepts implemented by OP
        Digital Properties             is exposed to light




        Linking Languages    threshold               impulse




          Linking Devices      light
                              sensor
                                                       LED




       Physical Properties   shape, colors, weight, markers, etc.
                    18
OP
• Concepts implemented by OP
        Digital Properties             is exposed to light




        Linking Languages    threshold               impulse




          Linking Devices      light
                              sensor
                                                       LED




       Physical Properties   shape, colors, weight, markers, etc.
                    19
OP
• Concepts implemented by OP
        Digital Properties

Composition of modalities                         Complementarity




        Linking Languages

          Linking Devices

       Physical Properties   shape, colors, weight, markers, etc.
                    20
OP
• Concepts implemented by OP
        Digital Properties             is exposed to light



Composition of modalities
                             threshold               impulse

        Linking Languages
                               light
                                                       LED
                              sensor
          Linking Devices

       Physical Properties   shape, colors, weight, markers, etc.
                    21
OP
• Software elementary blocks for:
                               generic
         Digital Properties     digital
                              property


 Composition of modalities         complementarity          ...

         Linking Languages
                                               ARToolKit
                              threshold        computer
                                                 vision
                                                            ...
                                                Phidget       Interface-
           Linking Devices    camera            sensor/
                                               controller
                                                              Z sensor/
                                                              controller   ...

        Physical Properties
                     22
OP
• Inserting the use of an interaction model
  into design practice: example




                     23
24
25
26
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
27
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
28
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
29
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
30
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
31
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
32
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
33
34
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
35
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
36
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
37
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
38
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
39
is exposed to light




      threshold    impulse



       light
                    LED
      sensor



     shape, colors, weight,
         markers, etc.
40
OP




41
Benefits
• For design: Systematic exploration of the
  design space
  -   Physical properties
  -   Linking devices
  -   Linking languages
  -   Composition of linking modalities
  -   Digital Properties

                          42
Benefits
• Exploration of input linking devices
 - Phidgets         →Interface-Z




                      43
Benefits
• Exploration of input linking devices
 - Phidgets         →Interface-Z




                      44
Benefits
• Exploration of input linking languages
 - Threshold




                       45
Benefits
• Exploration of input linking languages
 - Threshold + Repetition




                       46
Benefits
• Exploration of input linking languages
 - Threshold + Repetition




                       47
Benefits
• Exploration of output linking modality
 - Impulse + LED




                       48
Benefits
• Exploration of output linking modality
 - Impulse + sound




                       49
Benefits
• Exploration of output linking language
 - Repetition + Impulse




                       50
Conclusion
    • For design
     - Designers can explore a mixed object
         similarly to the underlying Mixed
         Interaction Model

Mixed Interaction
                                      OP toolkit
     Model

                          51
Future Work
• Lower technical difficulties
• Adequacy to the design problem
• Enable new users



                   52
Future Work
• Enable new users




                     53
OP: A Novel Programming Model
for Integrated Design and Prototyping
           of Mixed Objects
           Céline Coutrix, Laurence Nigay
    Laboratoire d’Informatique de Grenoble, France




                          54

More Related Content

PDF
iEst-Rental Apartment(Report)
PDF
Portfolio 2012
PDF
Wiley About Face 3 The Essentials Of Interaction Design May 2007
PDF
Portfolio final
PDF
My Portfolio 2013
PDF
Suhas Bambardekar | Portfolio | Professional Works
PDF
DOCX
Memoria descriptiva chapa impri
iEst-Rental Apartment(Report)
Portfolio 2012
Wiley About Face 3 The Essentials Of Interaction Design May 2007
Portfolio final
My Portfolio 2013
Suhas Bambardekar | Portfolio | Professional Works
Memoria descriptiva chapa impri

Viewers also liked (10)

PDF
disablitynadchildsupportletter.
PDF
marcus paul kia mitchell- medical reports
PPTX
Me and my family
PDF
MEDICALPAPERS-2007[1]-peoplehelping
PDF
NOTÍCIA
PPTX
SEPHORA INTERNSHIP PROJECT
PDF
Ātrie kredīti ar sliktu kredītvēsturi
PPTX
Rapid Prototyping for Instructional Design over Time
PPTX
Marketing training Manual
ODP
la vie est un long fleuve tranquille
disablitynadchildsupportletter.
marcus paul kia mitchell- medical reports
Me and my family
MEDICALPAPERS-2007[1]-peoplehelping
NOTÍCIA
SEPHORA INTERNSHIP PROJECT
Ātrie kredīti ar sliktu kredītvēsturi
Rapid Prototyping for Instructional Design over Time
Marketing training Manual
la vie est un long fleuve tranquille
Ad

Similar to OP: A Novel Programming Model for Integrated Design and Prototyping of Mixed Objects (20)

PDF
Introduction to Interaction Design
PDF
ASE01.ppt
PPTX
Single-Window Integrated Development Environment
PDF
A hand kano-model-boston_upa_may-12-2004
PDF
Wiley.About.Face.3.The.Essentials.Of.Interaction.Design.May.2007
PPT
Fundamental principles of Usability and User Centred Design
PDF
It's Better To Have a Permanent Income Than to Be Fascinating: Killer Feature...
PDF
Mobile Information Architecture and Interaction Design (InfoCamp 2010)
PDF
Mobile Information Architecture and Interaction Design
KEY
E design hci team intro
PPTX
Application software
PPTX
CUbRIK at SMILA Conference in Berlin
PPT
OOSE Ch1 Introduction
PDF
Design Thinking for Social Innovation RossNetImpact_Oct2011
PDF
Modelling the User Interface
KEY
Effective Prototyping Process for Software Creation
PDF
Portfolios Matter: Building the Portfolio to Win the Job
PDF
UX Portfolios Matter
PDF
Bringing ideas to life – the dimensions of prototyping
Introduction to Interaction Design
ASE01.ppt
Single-Window Integrated Development Environment
A hand kano-model-boston_upa_may-12-2004
Wiley.About.Face.3.The.Essentials.Of.Interaction.Design.May.2007
Fundamental principles of Usability and User Centred Design
It's Better To Have a Permanent Income Than to Be Fascinating: Killer Feature...
Mobile Information Architecture and Interaction Design (InfoCamp 2010)
Mobile Information Architecture and Interaction Design
E design hci team intro
Application software
CUbRIK at SMILA Conference in Berlin
OOSE Ch1 Introduction
Design Thinking for Social Innovation RossNetImpact_Oct2011
Modelling the User Interface
Effective Prototyping Process for Software Creation
Portfolios Matter: Building the Portfolio to Win the Job
UX Portfolios Matter
Bringing ideas to life – the dimensions of prototyping
Ad

Recently uploaded (20)

PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Spectroscopy.pptx food analysis technology
PDF
Getting Started with Data Integration: FME Form 101
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
TLE Review Electricity (Electricity).pptx
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Machine Learning_overview_presentation.pptx
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PPTX
Tartificialntelligence_presentation.pptx
PPTX
OMC Textile Division Presentation 2021.pptx
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
August Patch Tuesday
PDF
Encapsulation theory and applications.pdf
PPTX
1. Introduction to Computer Programming.pptx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Network Security Unit 5.pdf for BCA BBA.
Diabetes mellitus diagnosis method based random forest with bat algorithm
Spectroscopy.pptx food analysis technology
Getting Started with Data Integration: FME Form 101
NewMind AI Weekly Chronicles - August'25-Week II
Digital-Transformation-Roadmap-for-Companies.pptx
Encapsulation_ Review paper, used for researhc scholars
TLE Review Electricity (Electricity).pptx
A comparative study of natural language inference in Swahili using monolingua...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Machine learning based COVID-19 study performance prediction
Machine Learning_overview_presentation.pptx
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Tartificialntelligence_presentation.pptx
OMC Textile Division Presentation 2021.pptx
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
August Patch Tuesday
Encapsulation theory and applications.pdf
1. Introduction to Computer Programming.pptx
Per capita expenditure prediction using model stacking based on satellite ima...
Network Security Unit 5.pdf for BCA BBA.

OP: A Novel Programming Model for Integrated Design and Prototyping of Mixed Objects

  • 1. OP: A Novel Programming Model for Integrated Design and Prototyping of Mixed Objects Céline Coutrix, Laurence Nigay Laboratoire d’Informatique de Grenoble, France 1
  • 3. Problem • Prototyping mixed physical-digital interfaces: Different problems - Lower technical difficulties - Enable new users - Adequacy to the design problem 3
  • 4. Problem • The design problem [Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA] 4
  • 5. Problem • The design problem [Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA] 5
  • 6. Problem • The design problem [Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA] 6
  • 7. Problem • The design problem [Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA] 7
  • 8. Problem • The design problem: Elaboration Conceptual Practical activity activity [Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA] 8
  • 9. Problem • The design problem: Elaboration Interaction Prototyping Models toolkits [Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA] 9
  • 10. Problem • Gap between interaction models and prototyping toolkits Interaction Prototyping Models toolkits - Slows down the elaboration of ideas 10
  • 11. Problem • Lower technical difficulties • Enable new users • Adequacy to the design problem 11
  • 12. Contribution • OP (Object Prototyping) Toolkit - Library of software elements • Materializing the concepts of an interaction model • Using Qt signals and slots mechanism Mixed Interaction OP toolkit Model 12
  • 13. OP • Underlying interaction model: The Mixed Interaction Model • Why this one? - Has been compared to others and proved interesting - Not easily used though, like the others 13
  • 14. OP • Concepts implemented by OP - Core concept: the mixed (physical-digital) object 14
  • 15. OP • Concepts implemented by OP - Core concept: the mixed (physical-digital) object 15
  • 16. OP • Concepts implemented by OP Digital Properties is exposed to light Physical Properties shape, colors, weight, markers, etc. 16
  • 17. OP • Concepts implemented by OP Digital Properties is exposed to light Linking Modalities Physical Properties shape, colors, weight, markers, etc. 17
  • 18. OP • Concepts implemented by OP Digital Properties is exposed to light Linking Languages threshold impulse Linking Devices light sensor LED Physical Properties shape, colors, weight, markers, etc. 18
  • 19. OP • Concepts implemented by OP Digital Properties is exposed to light Linking Languages threshold impulse Linking Devices light sensor LED Physical Properties shape, colors, weight, markers, etc. 19
  • 20. OP • Concepts implemented by OP Digital Properties Composition of modalities Complementarity Linking Languages Linking Devices Physical Properties shape, colors, weight, markers, etc. 20
  • 21. OP • Concepts implemented by OP Digital Properties is exposed to light Composition of modalities threshold impulse Linking Languages light LED sensor Linking Devices Physical Properties shape, colors, weight, markers, etc. 21
  • 22. OP • Software elementary blocks for: generic Digital Properties digital property Composition of modalities complementarity ... Linking Languages ARToolKit threshold computer vision ... Phidget Interface- Linking Devices camera sensor/ controller Z sensor/ controller ... Physical Properties 22
  • 23. OP • Inserting the use of an interaction model into design practice: example 23
  • 24. 24
  • 25. 25
  • 26. 26
  • 27. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 27
  • 28. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 28
  • 29. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 29
  • 30. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 30
  • 31. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 31
  • 32. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 32
  • 33. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 33
  • 34. 34
  • 35. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 35
  • 36. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 36
  • 37. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 37
  • 38. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 38
  • 39. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 39
  • 40. is exposed to light threshold impulse light LED sensor shape, colors, weight, markers, etc. 40
  • 41. OP 41
  • 42. Benefits • For design: Systematic exploration of the design space - Physical properties - Linking devices - Linking languages - Composition of linking modalities - Digital Properties 42
  • 43. Benefits • Exploration of input linking devices - Phidgets →Interface-Z 43
  • 44. Benefits • Exploration of input linking devices - Phidgets →Interface-Z 44
  • 45. Benefits • Exploration of input linking languages - Threshold 45
  • 46. Benefits • Exploration of input linking languages - Threshold + Repetition 46
  • 47. Benefits • Exploration of input linking languages - Threshold + Repetition 47
  • 48. Benefits • Exploration of output linking modality - Impulse + LED 48
  • 49. Benefits • Exploration of output linking modality - Impulse + sound 49
  • 50. Benefits • Exploration of output linking language - Repetition + Impulse 50
  • 51. Conclusion • For design - Designers can explore a mixed object similarly to the underlying Mixed Interaction Model Mixed Interaction OP toolkit Model 51
  • 52. Future Work • Lower technical difficulties • Adequacy to the design problem • Enable new users 52
  • 53. Future Work • Enable new users 53
  • 54. OP: A Novel Programming Model for Integrated Design and Prototyping of Mixed Objects Céline Coutrix, Laurence Nigay Laboratoire d’Informatique de Grenoble, France 54