From Pilot to Service: Our Users’
Experience with Collaborate Ultra and our
review of the Virtual Classroom tools
Kelly Hall
Learning Technology Advisor
University of Edinburgh
Session Plan
1. Brief review of Use of 12.6 and
Collaborate Ultra Pilot
2. Discussion of Four Use-Cases
3. Summary of Virtual Classrooms
Tool Review
The University of Edinburgh
• Founded 1583
• 9000 Staff
• 24,000 UG, 14,000 PG
• VLE Integrations- Blackboard (Main
campus VLE and Moodle(ODL
programmes)
• Online distance learning tutorials,
Virtual office hours
• Bespoke Portal Integration
• Staff use -Online Meetings, Face-to-
face/online meetings, webinars
• Student led collaborative activities
Collaborate 12.6
• Survey March 2015 (45 responses)
• 74% users satisfied
• 42% of staff used it with external contacts
• Tools used:
• Audio (95%)
• Text chat (93%)
• Powerpoint presentations (91%)
Java Issues- downloading the Launcher
Audio quality often poor
The interface
Not able to pre-load presentations
Collaborate Ultra
Pilot September 2015
3 Programmes:
Msc Internal Medicine (ODL)
Student Recruitment
Msc Design & Digital Media (ODL)
Moved Summer 2016
Users liked the new interface, easier for beginners to use
Better audio and video
Session size limits caused an issue for some users
Break-out rooms were missed by some users
Initial technical issue with users being dropped from sessions
Private chat was missed by some users
Use Case 1: Online Postgraduate Information
Events
• Run from Jan to Aug – 12 session
last Wednesday of the month.
• Information sessions for
prospective postgrads
• Issues with size limit
• Missed breakout rooms and
private chat, text chat in
recordings
• Like how easy for students to
access Collaborate – No Java
Use Case 2: UG Student Induction Pilot
• Pilot run by Student Induction
team to create an online
welcome programme for UG
Students starting in September
• All day sessions ran August 16th
and August 23rd, 2017
• conversion rate averaged 58%
• Only negative feedback was the
100 participant limit(should have
been 250) – Blackboard resolved
within a few days
Use Case 3: Biosafety Training Institute (BTI)
• This course was originally run as a
5 day face to face training
• Now fully online with 8-10 people
in 6 week course. Assessment via
presentation in Collaborate
• They missed the private chat til
reintroduced in July 2017
• Want embedding media within
Collaborate
• Issues with sound – seems to be
flash issue
Enabling Flash (especially on Macs!)
• In Safari 10 – automatically
disables adobe flash within
browser.
• In both Firefox and Chrome you
need to “allow” collaborate to use
your microphone and camera.
Hands-on
Drop-ins and clinics
Courses
Training
Videos and
screencasts
UoE videos
Echo360 videos
Short topics
Full process
Webinars and
classroom-based
presentations
Short written guides
Cheatsheet – Panopto was
v. Echo360 is
UoE web pages
PDFs
Case studies
Workshops
UoE web page articles
Videos
Blogs
Links to other web pages of
other universities
Recorded
Live
Use Case 4: UoE Lecture Recording Rollout
Online course in Learn
Purple indicates delivery
mechanisms actually used
Classroom-based
delivered across campuses
Online
centralised access via Lecture
Recording web pages
FAQs
Delivery
Presentation
Information sessions
Use Case 4: UoE Lecture Recording Rollout
• Preparing for Lecture Recording
• Bookable sessions ran from 7th July
• 23 sessions delivered over eight weeks
• 14 classroom-based, 9 webinars
• 114 attendees f2f, 45 online
• Sessions ran really well
• tech worked well
• Bonus able to record session and send
recording
• Had Learning Tech moderate session to begin
with for support
Virtual Classroom Tool Review
Objectives
Review the market place
Review user requirements
Compare selected products against user requirements
Look at what other institutions in the UK are using
Gathering Requirements
• Online survey sent to members
of the user group and teaching
staff
• Requirements prioritised by
MoSCoW method (Must,
Should, Could and Would)
MoSCoW Prioritisation - Must, Could,
Should, Would
Durham 2018 from pilot to service  kelly hall
Durham 2018 from pilot to service  kelly hall
Conclusions
• Collaborate Ultra and Adobe Connect met most requirements
• Collaborate Ultra was in it’s infancy as a product
• Skype for Business lacked functionality required by a virtual classroom
• Substantial change would be required to move product, especially at
such a late stage
• Renew Collaborate for a further year from July 2017.
Contact Info:
Kelly.Hall@ed.ac.uk
Twitter: @kellymhall3
Thank you & Any Questions?

More Related Content

PPTX
Want to know how to use Blackboard? Use Blackboard.
PPTX
'The Good the Bad and the Ugly' of Collaborate Ultra
PPTX
The Good, the Bad and the Ugly of digital competency development
PPT
Lessons Learned: Implementation of a Virtual Classroom
PPTX
Bridging the Accessibility Gap: Improving Communication and Collaboration wit...
PPTX
Online evaluations: using proctoring tools, Open book assessments and Group E...
PPTX
Facilitating in and with the Fully Online Learning Community (FOLC) Model
PDF
Tips for Getting Your Colleagues to Adopt Universal Design for Learning
Want to know how to use Blackboard? Use Blackboard.
'The Good the Bad and the Ugly' of Collaborate Ultra
The Good, the Bad and the Ugly of digital competency development
Lessons Learned: Implementation of a Virtual Classroom
Bridging the Accessibility Gap: Improving Communication and Collaboration wit...
Online evaluations: using proctoring tools, Open book assessments and Group E...
Facilitating in and with the Fully Online Learning Community (FOLC) Model
Tips for Getting Your Colleagues to Adopt Universal Design for Learning

What's hot (20)

PPTX
Safari live cps live instructional purposes
PPTX
The Instructor is In: Sustaining Presence in the Online Environment
PPT
Webinar REC:all
PPTX
2011 OTC Online Remote Adjunct Orientation
PPTX
Increasing interaction
PPTX
The State of Closed Captioning in Higher Education
PPTX
The Role of Video in the Flipped Classroom
PPTX
Alternative Professional Development
PPT
Presentation Title
PPT
CCA eLearning Conference Presentation -
PDF
What does good practice look like?
PPTX
Capture av
PDF
Minutes 3rd May NBN Digital Learning Project workshop hvha v3
PPTX
Engagement in Online and Blended Learning Environments
PPTX
Lecture Capture
PDF
Wiki Technology in the Classroom
PDF
KySTE 2015 Flipped Instruction PD
PPTX
Online collaborative learning with audiencefeedback
PPTX
UBC Chinese Visiting Scholars keynote Jan 2019 Robert Peregoodoff slideshare ...
PPTX
Flipped instruction pd 10 9-14 short v2
Safari live cps live instructional purposes
The Instructor is In: Sustaining Presence in the Online Environment
Webinar REC:all
2011 OTC Online Remote Adjunct Orientation
Increasing interaction
The State of Closed Captioning in Higher Education
The Role of Video in the Flipped Classroom
Alternative Professional Development
Presentation Title
CCA eLearning Conference Presentation -
What does good practice look like?
Capture av
Minutes 3rd May NBN Digital Learning Project workshop hvha v3
Engagement in Online and Blended Learning Environments
Lecture Capture
Wiki Technology in the Classroom
KySTE 2015 Flipped Instruction PD
Online collaborative learning with audiencefeedback
UBC Chinese Visiting Scholars keynote Jan 2019 Robert Peregoodoff slideshare ...
Flipped instruction pd 10 9-14 short v2
Ad

Similar to Durham 2018 from pilot to service kelly hall (20)

PPTX
Making the Switch From Wimba to Blackboard Collaborate
PPTX
Collaboration through technology: moving from possibility to practice - Noel ...
PPT
JISC LADIE project Learning Design In Education
PPT
Are we ready for OER?
PPT
e-learning Reality Check: Keynote Durham University 2009
PDF
PPTX
Bringing together internal and external students on Blackboard - Brett Fyfiel...
PDF
Teaching Continuity: Supporting staff teaching online when face-to-face class...
PPTX
FIE2010: Orchestrating Groupware in Engineering Education
PDF
Presentation at School Meeting (BEPP)
PPTX
Future Online Learning Environment Project Update February 2015
PDF
Wow! That’s a great use of Blackboard Collaborate | Mark Bailye & Foong Yee L...
PDF
March 2009
PPTX
Outcomes from JISC Anytime Learning Literacies Environment (ALLE) project
PPTX
Ultranet at nhs 2012
PDF
Diglit and student experience
PPT
Cdl april 2012_blended_conference_presentati_april_22
PDF
Step inside the virtual classroom with unified communications (UC)
PPT
Postgraduate Certificate E-learning
PPT
Profiling+participant+institutions+ +what+are+our+experiences
Making the Switch From Wimba to Blackboard Collaborate
Collaboration through technology: moving from possibility to practice - Noel ...
JISC LADIE project Learning Design In Education
Are we ready for OER?
e-learning Reality Check: Keynote Durham University 2009
Bringing together internal and external students on Blackboard - Brett Fyfiel...
Teaching Continuity: Supporting staff teaching online when face-to-face class...
FIE2010: Orchestrating Groupware in Engineering Education
Presentation at School Meeting (BEPP)
Future Online Learning Environment Project Update February 2015
Wow! That’s a great use of Blackboard Collaborate | Mark Bailye & Foong Yee L...
March 2009
Outcomes from JISC Anytime Learning Literacies Environment (ALLE) project
Ultranet at nhs 2012
Diglit and student experience
Cdl april 2012_blended_conference_presentati_april_22
Step inside the virtual classroom with unified communications (UC)
Postgraduate Certificate E-learning
Profiling+participant+institutions+ +what+are+our+experiences
Ad

Recently uploaded (20)

PDF
English Textual Question & Ans (12th Class).pdf
PDF
semiconductor packaging in vlsi design fab
PDF
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
PPTX
Climate Change and Its Global Impact.pptx
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PPTX
Module on health assessment of CHN. pptx
PDF
fundamentals-of-heat-and-mass-transfer-6th-edition_incropera.pdf
PDF
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
DOCX
Cambridge-Practice-Tests-for-IELTS-12.docx
PDF
Empowerment Technology for Senior High School Guide
PDF
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
PPTX
MICROPARA INTRODUCTION XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
PDF
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
PPTX
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
PDF
Race Reva University – Shaping Future Leaders in Artificial Intelligence
PDF
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
plant tissues class 6-7 mcqs chatgpt.pdf
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
English Textual Question & Ans (12th Class).pdf
semiconductor packaging in vlsi design fab
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
Climate Change and Its Global Impact.pptx
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
Module on health assessment of CHN. pptx
fundamentals-of-heat-and-mass-transfer-6th-edition_incropera.pdf
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
Cambridge-Practice-Tests-for-IELTS-12.docx
Empowerment Technology for Senior High School Guide
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
MICROPARA INTRODUCTION XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
Race Reva University – Shaping Future Leaders in Artificial Intelligence
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
plant tissues class 6-7 mcqs chatgpt.pdf
FORM 1 BIOLOGY MIND MAPS and their schemes

Durham 2018 from pilot to service kelly hall

  • 1. From Pilot to Service: Our Users’ Experience with Collaborate Ultra and our review of the Virtual Classroom tools Kelly Hall Learning Technology Advisor University of Edinburgh
  • 2. Session Plan 1. Brief review of Use of 12.6 and Collaborate Ultra Pilot 2. Discussion of Four Use-Cases 3. Summary of Virtual Classrooms Tool Review
  • 3. The University of Edinburgh • Founded 1583 • 9000 Staff • 24,000 UG, 14,000 PG • VLE Integrations- Blackboard (Main campus VLE and Moodle(ODL programmes) • Online distance learning tutorials, Virtual office hours • Bespoke Portal Integration • Staff use -Online Meetings, Face-to- face/online meetings, webinars • Student led collaborative activities
  • 4. Collaborate 12.6 • Survey March 2015 (45 responses) • 74% users satisfied • 42% of staff used it with external contacts • Tools used: • Audio (95%) • Text chat (93%) • Powerpoint presentations (91%) Java Issues- downloading the Launcher Audio quality often poor The interface Not able to pre-load presentations
  • 5. Collaborate Ultra Pilot September 2015 3 Programmes: Msc Internal Medicine (ODL) Student Recruitment Msc Design & Digital Media (ODL) Moved Summer 2016 Users liked the new interface, easier for beginners to use Better audio and video Session size limits caused an issue for some users Break-out rooms were missed by some users Initial technical issue with users being dropped from sessions Private chat was missed by some users
  • 6. Use Case 1: Online Postgraduate Information Events • Run from Jan to Aug – 12 session last Wednesday of the month. • Information sessions for prospective postgrads • Issues with size limit • Missed breakout rooms and private chat, text chat in recordings • Like how easy for students to access Collaborate – No Java
  • 7. Use Case 2: UG Student Induction Pilot • Pilot run by Student Induction team to create an online welcome programme for UG Students starting in September • All day sessions ran August 16th and August 23rd, 2017 • conversion rate averaged 58% • Only negative feedback was the 100 participant limit(should have been 250) – Blackboard resolved within a few days
  • 8. Use Case 3: Biosafety Training Institute (BTI) • This course was originally run as a 5 day face to face training • Now fully online with 8-10 people in 6 week course. Assessment via presentation in Collaborate • They missed the private chat til reintroduced in July 2017 • Want embedding media within Collaborate • Issues with sound – seems to be flash issue
  • 9. Enabling Flash (especially on Macs!) • In Safari 10 – automatically disables adobe flash within browser. • In both Firefox and Chrome you need to “allow” collaborate to use your microphone and camera.
  • 10. Hands-on Drop-ins and clinics Courses Training Videos and screencasts UoE videos Echo360 videos Short topics Full process Webinars and classroom-based presentations Short written guides Cheatsheet – Panopto was v. Echo360 is UoE web pages PDFs Case studies Workshops UoE web page articles Videos Blogs Links to other web pages of other universities Recorded Live Use Case 4: UoE Lecture Recording Rollout Online course in Learn Purple indicates delivery mechanisms actually used Classroom-based delivered across campuses Online centralised access via Lecture Recording web pages FAQs Delivery Presentation Information sessions
  • 11. Use Case 4: UoE Lecture Recording Rollout • Preparing for Lecture Recording • Bookable sessions ran from 7th July • 23 sessions delivered over eight weeks • 14 classroom-based, 9 webinars • 114 attendees f2f, 45 online • Sessions ran really well • tech worked well • Bonus able to record session and send recording • Had Learning Tech moderate session to begin with for support
  • 12. Virtual Classroom Tool Review Objectives Review the market place Review user requirements Compare selected products against user requirements Look at what other institutions in the UK are using
  • 13. Gathering Requirements • Online survey sent to members of the user group and teaching staff • Requirements prioritised by MoSCoW method (Must, Should, Could and Would) MoSCoW Prioritisation - Must, Could, Should, Would
  • 16. Conclusions • Collaborate Ultra and Adobe Connect met most requirements • Collaborate Ultra was in it’s infancy as a product • Skype for Business lacked functionality required by a virtual classroom • Substantial change would be required to move product, especially at such a late stage • Renew Collaborate for a further year from July 2017.

Editor's Notes

  • #4: The University of Edinburgh is located in the city center of the capital city of Scotland and was founded in 1583 We have around 9000 staff, and 32,000 students, 24,000 of which are UG Blackboard is the main campus VLE- 90% of courses but we also have moodle for online distance learning courses and we have around 12 bespoke VLEs for specific programmes I am part of the Educational Design and Engagement team - def….. Collaborate is integrated into both Learn and Moodle and used for online tutorials and virtual office hours -Adobe connect is also used by one program in the Medical School – particular use We also provide a bespoke integration without University portal This allows non-teaching staff to use Collaborate for online meetings which can be useful when there is a room shortage and it saves time as no travel across campus (Blended meetings) students can also set up meetings, for example we a have a PhD student using it as part of a Universitats 21 project to link up with researched from international Universities
  • #5: In 2015, we were using Collaborate 12.6 (or now known as Collaborate Classic) We carried out a survey amongst our user group which gave us some useful feedback The majority of users were satisfied The most used features of Collaborate were audio, text chat and PowerPoint However the survey also pointed out that participants were having issues with the launcher –java issues mean some student and guest could not attend sessions Audio quality was often poor Users thought that interface was a bit clunky Not able to pre-load sessions
  • #6: So in Sept 2015, we ran a pilot of Ultra Across 3 programmes Feedback was positive and we moved to Ultra in July 2016 Lots of issues initially but there have been improving over the year The new interface was liked – it was easy to use and easier for beginners to learn Issues in moving Initial session size caused problems but that has gone from 50 to 100 and now 250 in the EU (in USA it’s 500) Users missed breakout rooms and private chat but thankfully this has been resolved Technical issues – sessions dropping – user kicked out – audio issues – but have improved as the year has gone on Still have one or two features such as -indicator when people are typing -individually shutting of someone's microphone -whiteboard – saving images and anitations staying when you leave the page But Blackboard is continutally in development to improve Ultra.
  • #7: Use Case 1: PG Online Information Events These are run from Jan to August by the student recruitment team – 12 sessions in a day These information events are aimed at international students who can’t easily attend the on-campus open days Topics include : How to pay tuition fees Accommodation in Edinburgh English language support Disability support Participants sign up to the event via Eventbrite in which they get sent instructions on how to access Collaborate along with the guest link A presentation is often given followed by Q &A and often current students attend to give their experience. In 2015/16 the sessions had attendance between 200 and 400 over he various topics They did experience issues with session size limits Managed move to smaller sessions Missed breakout rooms and private chats to answer individual student questions Also missed text chat in recordings –now resolved Looking to integrate a booking system so they can track and follow-up with attendees Currently guest can sign in and no way to follow up with them – can put in whatever name as well. They put the recordings of the sessions into our Media Asset management system (Media Hopper Create/Kalture) embed them onto the webpages
  • #8: This was a Pilot to increase student access and engagement for pre-arrival information and support. Student Induction Team coordinated an online welcome programme before UG student arrived in September. Two big days of sessions August 16th and August 23rd, both Wednesdays Kelly and Catherine ran training Topics Covered: Making the most of your first few weeks ResLife – your new home from home Student Life – Students’ Association Funding & Fees (support and paying your fees (process) How to succeed in your new study environment Welcome specifically for new CAHSS Visiting Students Some sessions were fully booked and the conversion rate on the day averaged 58% Sent out survey to students asking them how the sessions were. As for Collaborate doesn’t seem like any negative feedback except for issue with getting into the session on the 16th. Feedback from Students Only 3% said not useful at all – so great success Could not get on to first session. When I finally did the session was full - only 100 participants! Gave up after that. Figured why bother when so few participants and so difficult to participate. Please, continue doing this online informative sessions because as an international incoming student it helps a lot!!! It is a wonderful idea that made us feel welcome and appreciated in every single aspect. Indeed, Edinburgh it is already my second home and I have never been there yet! My sincerely and deeply THANK YOU!! I hope my home University follows your example Feedback from Staff Issue on August 16th – only 100 people Need to let people know to have headsets Use Chrome and Firefox for best use Run test sessions Mostly improvements on the content of the sessions rather then the actual Tech.
  • #9: Use case 2: Bio-safety institute Biosafety practitioner level 1 This course was originally run as a 5 day face to face training The team has developed a blended course and now a fully online course as well. Only UK provider to offer alternative method of delivery for this course. Online – groups of 8-10 people sign up and after the 6 weeks are assessed by a 10 minute presentation done via collaborate For the online course this is done using Collaborate for classrooms and assessments. Students send their presentations to the course admin and she pre-loads them Practice sessions are set up to familiarize with Ultra She moderates the session and gives presenter rights to each student when it is their time to present. They did miss the private chat so it was useful for fixing any technical issues a student was having and the presenter could keep on presenting without disruption the text chat Wanting for video to work in Collaborate – so being able to embed video into Collaborate – we have provided a work around – I do know that Blackboard is working on this as it is a wish list from many institutions.
  • #11: Massive rollout of Lecture Recording at the University this summer – 3 year plan 130 rooms initially – opt in Needed to train over 350 academics over the summer Needed to reach the masses Wanted to make training available to all – many campuses – people travel especially during the summer Make sure everyone had the opportunity to attend or view training (f2f, online, recording)
  • #12: Didn't have huge numbers in the sessions, more about making sure training was available for people to take up   People prefer face to face and was much higher attendance but wanted the extra options and were attended Advice: Have some training before you run the sessions Need some IT support to just get started and to have someone else into the session for the first few sessions or and then the first 15 minutes to get everyone set up.
  • #13: Why Moving from collaborate to ultra was not the smoothest so some users voiced interest in a review We wanted to ensure we have a tool fit for purpose and use requirements Skype for business was available at the university as well License was due for renewal Objectives of review Clear understanding of what was in the marketplace and what features and functionality was available Gather user requirements to be sure we were providing the best solution Once we had both of these we could compare products against requirements Point 1 – Gain a clear understanding of the functionality and features of virtual classroom and web meeting solutions currently available in the marketplace. Point 2 – A survey was sent to members of the VCMUG user group. The survey was designed to establish what the requirements were and to prioritize them using the MoSCoW method (Must haves, should haves, could haves, would haves) In February this year we decided to carry out a virtual classroom tool review
  • #14: A survey was sent to our user group to ask them for their prioritization of features The user requirements followed MoSCoW method and allowed us to refine the matrix https://en.wikipedia.org/wiki/MoSCoW_method
  • #15: Then went on to Identify market leaders in Virtual Classroom and Web Conferencing technology Create a matrix to compare products against requirements Comparison Matrix: Licence model Operating system support Browser support Mobile devices Features Sound and video quality Integration Support
  • #16: Russell Group: Contacted all Universities within the Russell Group Received 9 replies to request for information, but also gathered information on University websites Main solutions currently in use were Collaborate, AdobeConnect, BigBlueButton and Skype for Business Edinburgh ahead of others in the provision of virtual classroom solutions Russell Group
  • #17: Matrix refined to 6 providers and the functionality and technical features looked at in more detail This led us to Adobe Connect and Collaborate Adobe is currently used by one programme in the medical school Want multiple video streams for online tutorials Campus solution – Collaborate is still best solution Exercise also allowed a comparison of skype and collaborate to provide used with advice on what tool they should use to best fit their activity