Reflection Logs as a Dashboard
             John Gordon
              Ken Currie
            Opus Learning
         22nd November 2012
The problem

• Opus Learning provides online
  education, so the usual problems
  – Tracking learning
  – Authentication
  – Identifying problems in learning
  – Recognising need for intervention
The Solution
                       Student interacts with content

Learner
interacting
with content,                                           Makes notes, responds to
leaving traces                                          quiz, send messages, etc



        Store in MLE                    Capture notes




                            Print off
                            record of
                            learning
Digital Work Book: Challenge

• To develop tools for:
  – Teachers as authors
  – Audit trails from the learning process
  – Identify and understand behaviours
  – Authenticate candidates
  – Identify intervention requirements
  – Develop scalable assessment
What we wanted

•   Interactive content
•   Student to Content Interaction
•   Recording interactions, and reflection
•   Embedded activity and Assessment
•   Multi-user activity
•   Logging and monitoring of learning
What we made

• A portfolio embedded in the content
• A dashboard for learning, from all user points
  of view
• Recording of legacy from learning
• Rich seam of data and behaviours for mining
• Ongoing formative assessment, and potential
  summative assessment
Digital Workbook
Digital Work Book: Features


– Content based, an integral part of the learning
  materials
– Context based, a support mechanism for testing
  concept understanding
– Supporting Reflective Thinking
– A longitudinal form of assessment
The Digital Workbook
Learners interactions

• Classical view - four types of interaction
  – learner-content
  – learner-learner
  – learner-tutor
  – learner-interface
• The Opus view
  – there’s more!
  – the sum of interactions leads to meaningful
    learning
∑ Interactions = Meaningful Learning
                                    Student/Student

                                       Student
                                                       Student/Tutor
                  Student/Content

                                      Student/Environment

        Content                                                        Tutor
                          Tutor/Content
                                                                          Tutor/Tutor
Content/Content

               Content/Environment                    Tutor/Environment

                                     Environment

Based on diagram in
                               Environment/Environment
Anderson 2003
Interaction Table
Interaction                    Methodology
Student/Content                Digital Work Book
Student/Tutor                  Environment + Digital Work Book
Student/Student                Environment + Multiuser Digital
                               Workbook
Student/Environment            Standard VLE such as Moodle 2.3 ( or
                               others)
Content/Content                Rich Single Source Publishing + high level
                               of linkage/integration + objects
Tutor/Tutor                    VLE Features+ SQA QA Processes
Tutor/Environment              VLE Features+ Digital Work Book
                               Dashboard
Content /Environment           VLE Features+ CAPDM Enhancements
Environment/Environment        VLE Audit trail.
Tutor/Content                  CAPDM Single Source Publishing System
DWB Examples – Source Page
Presentation at eAssessment Tomorrow
Presentation at eAssessment Tomorrow
DWB Example workbook
The DigitalWork Book: Benefits
– Learner reflections form a legacy
   • A physical recorded book for the learner
   • A set of behaviour records for the learning provider
– Learning content feedback – improvement of
  content
– A behaviour trail
– A rich source for data mining
– Holistic assessment, across courses and
  programmes
– Authentication Support
DWB Dashboard
Digital Work Book:
            Assessment Strategy

– Provides ‘longitudinal’ assessment to augment
  assignments, exams, quizzes, etc.
– Integrates assessment across courses and
  programmes
– Is part of the ‘dashboard’ for Opus assessment
Example of Assessment screen
Standard Templates
Standardised programme design – all modules have the same feature set




                                                                        21
Concept Maps & Gateways

• The DWB can be used anywhere, but it is
  effective when contextually relevant
  – Study Guides can be useful Concept Maps
  – Key concepts can be thought of a ‘gateways’
    through which a student must pass successfully
  – The DWB can be used to assess understanding of
    these concepts
     • Contextually aware student input
Digital Work Book: Applications
• Audit Trail
   – Very useful to check on student progress
   – Relevant in compliance related training
• Personal portfolio
   – A reflective log
   – Augments and provides alternative to file stores
• Student support
   – Intervention assessment
   – Authentication
   – A navigational aid
Creating the Social Learner

• DWB is part of a social learner strategy
  – Rich interaction spaces
  – Personal interaction with the content (DWB)
  – Interaction on specific issues (traversing the web)
  – Social learner (Forums, Facebook, etc.)
• The DWB is interaction
The Future

• The DWB is sharable, including
   – with the Tutor
   – with other students,
• In the future it will
   – support groups
   – support many content types
   – integrate with other portfolio components
• The DWB will be our main assessment toolset
• The DWB will be our main behaviour manager
References
•   Veronica Thurmond, Karen Wambach “Understanding Interactions in Distance Education: A Review of the Literature”, International
    Journal of Instructional Technology and Distance Learning, 2004, http://www.itdl.org/journal/jan_04/article02.htm
•   Su, Bonk, Magjuka, Liu and Lee; The Importance of Interaction in Web-Based Education: A Program-level Case Study of Online MBA
    Courses; Journal of Interactive Online Learning, Volume 4, Number 1 Summer 2005. http://www.ncolr.org/jiol/issues/pdf/4.1.1.pdf
•   Terry Anderson, Getting the Mix Right Again: An updated and theoretical rationale for interaction, The International Review of
    Research in Open and Distance Learning, Vol 4, No 2 (2003). http://www.irrodl.org/index.php/irrodl/article/view/149/230




• THANK YOU

• www.opuslearning.com

More Related Content

PDF
Best Ways of Using Moodle
KEY
What Makes a Good Moodle course
PPTX
Online Teaching Basics: what I continue to learn
PPTX
Conference presentation 25 august 2013
PPTX
Models for open learning workshop slides 27 oct
PPTX
Policy input open_online_education
PPTX
Creating Engaging Learning Experiences in Moodle
PPT
The librarian as lecturer : experiences on the other side of the fence. Autho...
Best Ways of Using Moodle
What Makes a Good Moodle course
Online Teaching Basics: what I continue to learn
Conference presentation 25 august 2013
Models for open learning workshop slides 27 oct
Policy input open_online_education
Creating Engaging Learning Experiences in Moodle
The librarian as lecturer : experiences on the other side of the fence. Autho...

What's hot (19)

PPT
Moodle Presentation for Teachers
PPTX
E learning presentation
PPT
Making it real : information literacy and student engagement. Authors: Ursula...
PDF
Online Teaching on NKI
PDF
Blog-based courses in higher education: experience from Tallinn University
PDF
Futurelearning! Reflections on teaching in the Futurelearn Play MOOC
PPT
Blended Webinar ppt
PPT
What is Moodle explained with Lego
PDF
A focus on structuring learning in Moodle
PPTX
Affordances of VLE and teaching presence
PPTX
Customizable and Scalable Information Literacy Learning Objects
PPT
On the shelf in time : developing a strategy to improve reading list support....
PDF
Blended Learning Models
PDF
The Structure and Components for the Open Education Ecosystem
PPTX
7 cs update
PPTX
Conole learning design_final
PPTX
Personal learning environments brenton dass 201225820
PPTX
Lak12 learning designs and learning analytics workshop
PPTX
Information Literacy Instruction in Zero Gravity: Online Learning in Academic...
Moodle Presentation for Teachers
E learning presentation
Making it real : information literacy and student engagement. Authors: Ursula...
Online Teaching on NKI
Blog-based courses in higher education: experience from Tallinn University
Futurelearning! Reflections on teaching in the Futurelearn Play MOOC
Blended Webinar ppt
What is Moodle explained with Lego
A focus on structuring learning in Moodle
Affordances of VLE and teaching presence
Customizable and Scalable Information Literacy Learning Objects
On the shelf in time : developing a strategy to improve reading list support....
Blended Learning Models
The Structure and Components for the Open Education Ecosystem
7 cs update
Conole learning design_final
Personal learning environments brenton dass 201225820
Lak12 learning designs and learning analytics workshop
Information Literacy Instruction in Zero Gravity: Online Learning in Academic...
Ad

Viewers also liked (8)

PPTX
Building MOOCs: Scalable Course Development & Delivery
PPTX
Tracking and Assessing Vocational Qualifications
PPTX
Staff training day 10 jan 2013 090113
PPTX
Assessment and Credit in Online Open Qualifications
PPTX
Balancing commercial pressure with pedagogic needs v2
PPTX
Opus learning - british education online
PPTX
A new HND in Financial and Business Management
PPTX
Learning from Usain Bolt: Integrating Ipsative Assessments Into Our Learning
Building MOOCs: Scalable Course Development & Delivery
Tracking and Assessing Vocational Qualifications
Staff training day 10 jan 2013 090113
Assessment and Credit in Online Open Qualifications
Balancing commercial pressure with pedagogic needs v2
Opus learning - british education online
A new HND in Financial and Business Management
Learning from Usain Bolt: Integrating Ipsative Assessments Into Our Learning
Ad

Similar to Presentation at eAssessment Tomorrow (20)

PPTX
Technology in the Classroom: It's More Than Just Word & Powerpoint
PPTX
Meeting the challenges of contemporary online learning head-on
PPT
Conole overview tel
PPS
PPTX
Conole hertfordshire
PPTX
Conole icem plenary
PPTX
Conole masterclass
PDF
Eeveloping Interactive Logbook A Personal Learning Environment
PPSX
Science presentation 1st november
PDF
Blended Learning Models: Scotch PL 27.04.2011
PPTX
Conole learning design_final
PPT
Pedagogy2.0: A Missing or Broken Link
PPTX
Conole soton final
PPTX
Conole keynote eden
PPTX
Rethinking Assessment post-COVID: Authentic, collaborative and active
PPTX
Emerging hybrid staff roles in the new e-learning environment
PDF
Akonga #M
PDF
Trend Teknologi Pembelajaran
PDF
ACT Education and Training Directorate Leadership Conference 2012
PPTX
Conole dundee
Technology in the Classroom: It's More Than Just Word & Powerpoint
Meeting the challenges of contemporary online learning head-on
Conole overview tel
Conole hertfordshire
Conole icem plenary
Conole masterclass
Eeveloping Interactive Logbook A Personal Learning Environment
Science presentation 1st november
Blended Learning Models: Scotch PL 27.04.2011
Conole learning design_final
Pedagogy2.0: A Missing or Broken Link
Conole soton final
Conole keynote eden
Rethinking Assessment post-COVID: Authentic, collaborative and active
Emerging hybrid staff roles in the new e-learning environment
Akonga #M
Trend Teknologi Pembelajaran
ACT Education and Training Directorate Leadership Conference 2012
Conole dundee

Presentation at eAssessment Tomorrow

  • 1. Reflection Logs as a Dashboard John Gordon Ken Currie Opus Learning 22nd November 2012
  • 2. The problem • Opus Learning provides online education, so the usual problems – Tracking learning – Authentication – Identifying problems in learning – Recognising need for intervention
  • 3. The Solution Student interacts with content Learner interacting with content, Makes notes, responds to leaving traces quiz, send messages, etc Store in MLE Capture notes Print off record of learning
  • 4. Digital Work Book: Challenge • To develop tools for: – Teachers as authors – Audit trails from the learning process – Identify and understand behaviours – Authenticate candidates – Identify intervention requirements – Develop scalable assessment
  • 5. What we wanted • Interactive content • Student to Content Interaction • Recording interactions, and reflection • Embedded activity and Assessment • Multi-user activity • Logging and monitoring of learning
  • 6. What we made • A portfolio embedded in the content • A dashboard for learning, from all user points of view • Recording of legacy from learning • Rich seam of data and behaviours for mining • Ongoing formative assessment, and potential summative assessment
  • 8. Digital Work Book: Features – Content based, an integral part of the learning materials – Context based, a support mechanism for testing concept understanding – Supporting Reflective Thinking – A longitudinal form of assessment
  • 10. Learners interactions • Classical view - four types of interaction – learner-content – learner-learner – learner-tutor – learner-interface • The Opus view – there’s more! – the sum of interactions leads to meaningful learning
  • 11. ∑ Interactions = Meaningful Learning Student/Student Student Student/Tutor Student/Content Student/Environment Content Tutor Tutor/Content Tutor/Tutor Content/Content Content/Environment Tutor/Environment Environment Based on diagram in Environment/Environment Anderson 2003
  • 12. Interaction Table Interaction Methodology Student/Content Digital Work Book Student/Tutor Environment + Digital Work Book Student/Student Environment + Multiuser Digital Workbook Student/Environment Standard VLE such as Moodle 2.3 ( or others) Content/Content Rich Single Source Publishing + high level of linkage/integration + objects Tutor/Tutor VLE Features+ SQA QA Processes Tutor/Environment VLE Features+ Digital Work Book Dashboard Content /Environment VLE Features+ CAPDM Enhancements Environment/Environment VLE Audit trail. Tutor/Content CAPDM Single Source Publishing System
  • 13. DWB Examples – Source Page
  • 17. The DigitalWork Book: Benefits – Learner reflections form a legacy • A physical recorded book for the learner • A set of behaviour records for the learning provider – Learning content feedback – improvement of content – A behaviour trail – A rich source for data mining – Holistic assessment, across courses and programmes – Authentication Support
  • 19. Digital Work Book: Assessment Strategy – Provides ‘longitudinal’ assessment to augment assignments, exams, quizzes, etc. – Integrates assessment across courses and programmes – Is part of the ‘dashboard’ for Opus assessment
  • 21. Standard Templates Standardised programme design – all modules have the same feature set 21
  • 22. Concept Maps & Gateways • The DWB can be used anywhere, but it is effective when contextually relevant – Study Guides can be useful Concept Maps – Key concepts can be thought of a ‘gateways’ through which a student must pass successfully – The DWB can be used to assess understanding of these concepts • Contextually aware student input
  • 23. Digital Work Book: Applications • Audit Trail – Very useful to check on student progress – Relevant in compliance related training • Personal portfolio – A reflective log – Augments and provides alternative to file stores • Student support – Intervention assessment – Authentication – A navigational aid
  • 24. Creating the Social Learner • DWB is part of a social learner strategy – Rich interaction spaces – Personal interaction with the content (DWB) – Interaction on specific issues (traversing the web) – Social learner (Forums, Facebook, etc.) • The DWB is interaction
  • 25. The Future • The DWB is sharable, including – with the Tutor – with other students, • In the future it will – support groups – support many content types – integrate with other portfolio components • The DWB will be our main assessment toolset • The DWB will be our main behaviour manager
  • 26. References • Veronica Thurmond, Karen Wambach “Understanding Interactions in Distance Education: A Review of the Literature”, International Journal of Instructional Technology and Distance Learning, 2004, http://www.itdl.org/journal/jan_04/article02.htm • Su, Bonk, Magjuka, Liu and Lee; The Importance of Interaction in Web-Based Education: A Program-level Case Study of Online MBA Courses; Journal of Interactive Online Learning, Volume 4, Number 1 Summer 2005. http://www.ncolr.org/jiol/issues/pdf/4.1.1.pdf • Terry Anderson, Getting the Mix Right Again: An updated and theoretical rationale for interaction, The International Review of Research in Open and Distance Learning, Vol 4, No 2 (2003). http://www.irrodl.org/index.php/irrodl/article/view/149/230 • THANK YOU • www.opuslearning.com