SlideShare a Scribd company logo
Different Questions, Same Answers?
How we have approached exploring & disseminating the results of the JISC Staff Digital Insights Survey
data and our Internal Students Survey
a
Kate Soper (k.soper@mmu.ac.uk) & Rod Cullen (r.Cullen@mmu.ac.uk)
06/06/2019
0 20
Manchester Met Surveys
06/06/2019 Different Questions, Same Answers? 2
0 20
The Challenge
06/06/2019 Different Questions, Same Answers? 3
0 20
Sample Sizes
06/06/2019 Different Questions, Same Answers? 4
Survey Sample Respondents Response Rate Comments
Dec 2014 29,546 10,204 35% 47,802
Dec 2015 30,749 9,291 30% 46,842
Dec 2016 31,342 11, 200 36% 50,934
2017-18 30,551 11,233 37% 43,704
0 20
What our ISS looks like
06/06/2019 Different Questions, Same Answers? 5
Questions about your course:
 Staff on my course are good at explaining things
 Feedback on my work helped to clarify things I did
not understand
 I have received sufficient advice and support with my
studies
 The course is well organised and running smoothly
 University resources are appropriate to my learning
needs
 The course has helped me develop confidence and
skills to succeed
 Overall I am satisfied with the quality of my course
 I have had useful meetings with my PersonalTutor
 I am receiving good supervision on my
project/dissertation (postgraduate taught students
only)
Questions about each unit you take:
 This unit was taught well
 The tutor(s) responded to our mid-unit feedback
 Moodle resources were useful/well organised
 Free text questions
 Best things about this course/unit *
 Things I would most like improved on this course/unit
*
0 20
Embedded through the CMI process
06/06/2019 Different Questions, Same Answers? 6
0 20
JISC Digital Insights Survey
06/06/2019 Different Questions, Same Answers? 7
1. "How can Moodle, the University'sVirtual
Leaning Environment, be improved to support
your teaching and assessment practice?"
2."How can the University's teaching spaces be
improved (with or without technology) to enhance
your teaching and assessment practice?"
3. "Overall, do you think student learning is
enhanced by the use of technology?"
0 20
Where we are now
06/06/2019 Different Questions, Same Answers? 8
0 20
How we analyse the ISS data
06/06/2019 Different Questions, Same Answers? 9
0 20
Headline best results
06/06/2019 Different Questions, Same Answers? 10
0 20
ISS Reporting and Dissemination
06/06/2019 Different Questions, Same Answers? 11
0 20
Our Analysis Plan
06/06/2019 Different Questions, Same Answers? 12
0 20
Digital Insights Data Set
06/06/2019 Different Questions, Same Answers? 13
333 Responses =
21% Academic Staff
0 20
Relating Digital Insights Survey to ISS
06/06/2019 Different Questions, Same Answers? 14
ISS
Moodle
question
Staff Insights
Free
Text Questions
Staff Insights
Questions
ISS
TEL related
freeText
Comments
Staff
Focus Groups
0 20
Comparing the ISS with Digital Insights
06/06/2019 Different Questions, Same Answers? 15
ISS
Moodle
question
Staff Insights
Questions
0 20
Comparing the ISS with Digital Insights
06/06/2019 Different Questions, Same Answers? 16
Staff Insights
Free
Text Questions
ISS
TEL related
freeText
Comments
0 20
Staff Focus Groups
06/06/2019 Different Questions, Same Answers? 17
Staff
Focus Groups
ISS
Data TEL initial
findings
Staff Digital
Insights Survey
initial findings
0 20
Institutional Benchmarking
06/06/2019 Different Questions, Same Answers? 18
Benchmarking
0 20
Outputs
»ISS Report at Institutional, Faculty and Departmental level
»Digital Insights report at Institutional level supplemented with
Faculty specific insights
»Focus Groups' Collaborative Insights Report
› Results shared with
–All staff via intranet resources
–VC, PVC for Education, Faculty PVCs, Faculty Heads of
Education
–Education Committees
– ISDS Extended LeadershipTeam
06/06/2019 Different Questions, Same Answers? 19
0 20
Going forward
»Professional Services Pilot
»Signed up for Digital Insights 2020
»Promoting the impact of the survey
06/06/2019 Different Questions, Same Answers? 20

More Related Content

PDF
Prior and Brooksby- Refining information literacy online: library search smar...
PPTX
"School Closures" Survey Results
PPTX
"Technology in the Classroom" Survey Results
PPTX
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
PDF
LAK18: Jennifer Tan & Elizabeth Koh — Formative learning analytics to foster ...
PPTX
State of Education Survey
PPTX
Ipsef malaysia what matters most -simon dweck capita education
PDF
PISA 2012 Evaluating systems to improve education
Prior and Brooksby- Refining information literacy online: library search smar...
"School Closures" Survey Results
"Technology in the Classroom" Survey Results
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
LAK18: Jennifer Tan & Elizabeth Koh — Formative learning analytics to foster ...
State of Education Survey
Ipsef malaysia what matters most -simon dweck capita education
PISA 2012 Evaluating systems to improve education

What's hot (7)

PPTX
Class Size Survey
PPTX
how schools use external evaluations
PPTX
Utilisation of White Boards in Promoting Learning of Mathematics
PPSX
Poster Guichet du Savoir
PPTX
Technology Survey Summary
PPT
Job Embedded Presentation
PDF
Engaging & Retaining Youth in STEM: Lessons from Canadian Research
Class Size Survey
how schools use external evaluations
Utilisation of White Boards in Promoting Learning of Mathematics
Poster Guichet du Savoir
Technology Survey Summary
Job Embedded Presentation
Engaging & Retaining Youth in STEM: Lessons from Canadian Research
Ad

Similar to Different questions, same answers? (20)

PPTX
Insights webinar 16th oct 2019 surveys launch - vr2
PPTX
What the students and staff are telling us
PDF
Learning and teaching reimagined - how are student needs changing?
PPTX
Getting started with your 2020/21 digital experience insights surveys
PPTX
Findings from the pilot of staff in UK higher education
PPTX
Digital student slides 21st May 2014
PPT
Digital Student workshop for HeLF, May 2014
PPTX
Using staff and student technology enhanced learning (TEL) narratives to info...
PPTX
Moodle moot Dublin May 2015
PPTX
Digital experience insights and the student voice.
PDF
Analysing students' digital experience: personas and key drivers
PPTX
Jisc Digital student data collection and analysis workshop
PPTX
Insightswebinar23 janv2
PPTX
How are students' expectations and experiences of their digital environment c...
PPTX
Jisc Student Digital Experience Data Service
PPTX
Ascilite2018 steven warburton
PPTX
One System, Different Expectations (Laura Morse)
PPTX
Creating Library Spaces of the Future
PPTX
What organisational variables support a positive student digital experience?
PPTX
Study Day 10.11.12 Evaluation
Insights webinar 16th oct 2019 surveys launch - vr2
What the students and staff are telling us
Learning and teaching reimagined - how are student needs changing?
Getting started with your 2020/21 digital experience insights surveys
Findings from the pilot of staff in UK higher education
Digital student slides 21st May 2014
Digital Student workshop for HeLF, May 2014
Using staff and student technology enhanced learning (TEL) narratives to info...
Moodle moot Dublin May 2015
Digital experience insights and the student voice.
Analysing students' digital experience: personas and key drivers
Jisc Digital student data collection and analysis workshop
Insightswebinar23 janv2
How are students' expectations and experiences of their digital environment c...
Jisc Student Digital Experience Data Service
Ascilite2018 steven warburton
One System, Different Expectations (Laura Morse)
Creating Library Spaces of the Future
What organisational variables support a positive student digital experience?
Study Day 10.11.12 Evaluation
Ad

More from Jisc (20)

PPTX
Strengthening open access through collaboration: building connections with OP...
PPTX
Andrew-Brown-JUSP-showcase-20240730.pptx
PPTX
JUSP Showcase - Rebuilding Data presentation
PPTX
Adobe Express Engagement Webinar (Delegate).pptx
PPTX
FE Accessibility training matrix partnership - information session
PPTX
Procuring a research management system: why is it so hard?
PPTX
Adobe Express Engagement Webinar (Delegate).pptx
PPTX
How libraries can support authors with open access requirements for UKRI fund...
PPTX
Supporting (UKRI) OA monographs at Salford.pptx
PPTX
The approach at University of Liverpool.pptx
PPTX
Jisc's value to HE: the University of Sheffield
PPTX
Towards a code of practice for AI in AT.pptx
PPTX
Jamworks pilot and AI at Jisc (20/03/2024)
PPTX
Wellbeing inclusion and digital dystopias.pptx
PPTX
Accessible Digital Futures project (20/03/2024)
PPTX
Procuring digital preservation CAN be quick and painless with our new dynamic...
PPTX
International students’ digital experience: understanding and mitigating the ...
PPTX
Digital Storytelling Community Launch!.pptx
PPTX
Open Access book publishing understanding your options (1).pptx
PPTX
Scottish Universities Press supporting authors with requirements for open acc...
Strengthening open access through collaboration: building connections with OP...
Andrew-Brown-JUSP-showcase-20240730.pptx
JUSP Showcase - Rebuilding Data presentation
Adobe Express Engagement Webinar (Delegate).pptx
FE Accessibility training matrix partnership - information session
Procuring a research management system: why is it so hard?
Adobe Express Engagement Webinar (Delegate).pptx
How libraries can support authors with open access requirements for UKRI fund...
Supporting (UKRI) OA monographs at Salford.pptx
The approach at University of Liverpool.pptx
Jisc's value to HE: the University of Sheffield
Towards a code of practice for AI in AT.pptx
Jamworks pilot and AI at Jisc (20/03/2024)
Wellbeing inclusion and digital dystopias.pptx
Accessible Digital Futures project (20/03/2024)
Procuring digital preservation CAN be quick and painless with our new dynamic...
International students’ digital experience: understanding and mitigating the ...
Digital Storytelling Community Launch!.pptx
Open Access book publishing understanding your options (1).pptx
Scottish Universities Press supporting authors with requirements for open acc...

Recently uploaded (20)

PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
PDF
1_English_Language_Set_2.pdf probationary
PPTX
Introduction to Building Materials
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
My India Quiz Book_20210205121199924.pdf
PDF
Indian roads congress 037 - 2012 Flexible pavement
PDF
Weekly quiz Compilation Jan -July 25.pdf
PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PPTX
History, Philosophy and sociology of education (1).pptx
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
Trump Administration's workforce development strategy
PDF
Hazard Identification & Risk Assessment .pdf
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
What if we spent less time fighting change, and more time building what’s rig...
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
1_English_Language_Set_2.pdf probationary
Introduction to Building Materials
Practical Manual AGRO-233 Principles and Practices of Natural Farming
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
My India Quiz Book_20210205121199924.pdf
Indian roads congress 037 - 2012 Flexible pavement
Weekly quiz Compilation Jan -July 25.pdf
B.Sc. DS Unit 2 Software Engineering.pptx
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
History, Philosophy and sociology of education (1).pptx
A powerpoint presentation on the Revised K-10 Science Shaping Paper
Trump Administration's workforce development strategy
Hazard Identification & Risk Assessment .pdf
Chinmaya Tiranga quiz Grand Finale.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf

Different questions, same answers?

  • 1. Different Questions, Same Answers? How we have approached exploring & disseminating the results of the JISC Staff Digital Insights Survey data and our Internal Students Survey a Kate Soper (k.soper@mmu.ac.uk) & Rod Cullen (r.Cullen@mmu.ac.uk) 06/06/2019
  • 2. 0 20 Manchester Met Surveys 06/06/2019 Different Questions, Same Answers? 2
  • 3. 0 20 The Challenge 06/06/2019 Different Questions, Same Answers? 3
  • 4. 0 20 Sample Sizes 06/06/2019 Different Questions, Same Answers? 4 Survey Sample Respondents Response Rate Comments Dec 2014 29,546 10,204 35% 47,802 Dec 2015 30,749 9,291 30% 46,842 Dec 2016 31,342 11, 200 36% 50,934 2017-18 30,551 11,233 37% 43,704
  • 5. 0 20 What our ISS looks like 06/06/2019 Different Questions, Same Answers? 5 Questions about your course:  Staff on my course are good at explaining things  Feedback on my work helped to clarify things I did not understand  I have received sufficient advice and support with my studies  The course is well organised and running smoothly  University resources are appropriate to my learning needs  The course has helped me develop confidence and skills to succeed  Overall I am satisfied with the quality of my course  I have had useful meetings with my PersonalTutor  I am receiving good supervision on my project/dissertation (postgraduate taught students only) Questions about each unit you take:  This unit was taught well  The tutor(s) responded to our mid-unit feedback  Moodle resources were useful/well organised  Free text questions  Best things about this course/unit *  Things I would most like improved on this course/unit *
  • 6. 0 20 Embedded through the CMI process 06/06/2019 Different Questions, Same Answers? 6
  • 7. 0 20 JISC Digital Insights Survey 06/06/2019 Different Questions, Same Answers? 7 1. "How can Moodle, the University'sVirtual Leaning Environment, be improved to support your teaching and assessment practice?" 2."How can the University's teaching spaces be improved (with or without technology) to enhance your teaching and assessment practice?" 3. "Overall, do you think student learning is enhanced by the use of technology?"
  • 8. 0 20 Where we are now 06/06/2019 Different Questions, Same Answers? 8
  • 9. 0 20 How we analyse the ISS data 06/06/2019 Different Questions, Same Answers? 9
  • 10. 0 20 Headline best results 06/06/2019 Different Questions, Same Answers? 10
  • 11. 0 20 ISS Reporting and Dissemination 06/06/2019 Different Questions, Same Answers? 11
  • 12. 0 20 Our Analysis Plan 06/06/2019 Different Questions, Same Answers? 12
  • 13. 0 20 Digital Insights Data Set 06/06/2019 Different Questions, Same Answers? 13 333 Responses = 21% Academic Staff
  • 14. 0 20 Relating Digital Insights Survey to ISS 06/06/2019 Different Questions, Same Answers? 14 ISS Moodle question Staff Insights Free Text Questions Staff Insights Questions ISS TEL related freeText Comments Staff Focus Groups
  • 15. 0 20 Comparing the ISS with Digital Insights 06/06/2019 Different Questions, Same Answers? 15 ISS Moodle question Staff Insights Questions
  • 16. 0 20 Comparing the ISS with Digital Insights 06/06/2019 Different Questions, Same Answers? 16 Staff Insights Free Text Questions ISS TEL related freeText Comments
  • 17. 0 20 Staff Focus Groups 06/06/2019 Different Questions, Same Answers? 17 Staff Focus Groups ISS Data TEL initial findings Staff Digital Insights Survey initial findings
  • 18. 0 20 Institutional Benchmarking 06/06/2019 Different Questions, Same Answers? 18 Benchmarking
  • 19. 0 20 Outputs »ISS Report at Institutional, Faculty and Departmental level »Digital Insights report at Institutional level supplemented with Faculty specific insights »Focus Groups' Collaborative Insights Report › Results shared with –All staff via intranet resources –VC, PVC for Education, Faculty PVCs, Faculty Heads of Education –Education Committees – ISDS Extended LeadershipTeam 06/06/2019 Different Questions, Same Answers? 19
  • 20. 0 20 Going forward »Professional Services Pilot »Signed up for Digital Insights 2020 »Promoting the impact of the survey 06/06/2019 Different Questions, Same Answers? 20