Measuring the impact on student
engagement in the redesigned Blended
Course using Quality Matters standards

Bill Knapp, Dean of Learning Technologies
Joanna Paull, Associate Professor, English
Lakeland Community College
Agenda
Hybrid Workshop Series
•Objectives
•Structure
•Demographics
•Outcomes
Research Project
•Student Engagement
•Survey Design
•Results
•Recommendations
Presentation Questions/Discussion
We welcome your questions at any time during the
presentation. However, you may also post your
questions or comments to Poll everywhere or Tweet
tag: #qm4engage
Text 772896 and your message to 37607
- or visit Pollev.com
Post to Twitter #qm4engage
Objectives for Workshop
 Provide information about hybrid pedagogy
Formative & summative student assessment
Pedagogical scholarship
Creating active learning environments
Instructional materials choices

 Create a cohort of informed hybrid instructors
 Establish hybrid pedagogy faculty community
Workshop Structure
 Eight-week hybrid course that covers:
Hybrid definitions
Active Learning
Instructional Design
Course and Student Assessment
Demographics
●
●
●
●
●
●
●
●
●
●
●

American Sign Language
Communication/Speech
Composition
Sociology
Geography
Health & Information Data Management
Biology
Psychology
Engineering
Accounting
Math
Learner Engagement, QM Standards and the Blended Course
Ties to structure of course
screen shots to reflect navigation
QM Standard: Active
Learning
Active Learning: Group Wiki
Active Learning: Student Discussion
Instructional Design
 What are QM Standards?
 How does our workshop course site reflect those
elements?
 What are some ways to make our courses more
broadly accessible by our students?
 What role does media and/or tools play in how we
share our courses with students?
Active Learning:
Build a Hybrid Module
Our Results: New Hybrid Courses
 Intro to Sociology
 Sociology of Aging
 Environmental Geography
 Intro to Accounting
 Interpersonal Communication
Assessment







Discuss previous assessment experiences.
Read assessment scholarship.
Differentiate between formative & summative
Ask students to assess our workshop.
Provide letters of appreciation & participation.
Mail out certificates of completion.
Student Engagement
The findings from 20 years of research on undergraduate
education have been unequivocal: The more actively
engaged students are – with college faculty and staff, with
other students, and with the subject matter they study – the
more likely they are to learn, to stick with their studies, and
to attain their academic goals.
- Community College Leadership Program
CCSSE Benchmarks &
Quality Matters Standards
 Active and Collaborative Learning
 Student Effort
 Academic Challenge
 Student-Faculty Interaction
 Support for Learners
Active and Collaborative Learning
 The Active and collaborative learning benchmark measures
the extent to which student participate in class, interact
with other students, and extend learning outside the
classroom…
 Active and collaborative learning is linked with higher
grades and course completion measures as well as long
term persistence…
Student Effort
 The Student Effort benchmark measures time on task,
preparation, and use of student services…
 …the Student Effort benchmark is predictably related to
retention measures and moderately predictive of academic
measures.
Academic Challenge
 The Academic Challenge benchmark measures the extent
to which students engage in challenging mental activities,
such as evaluation and synthesis, as well as the quantity
and rigor of their academic work…
 Academic Challenge was most consistently associated with
academic outcomes…
Student-Faculty Interaction
 The Student to Faculty Interaction benchmark measures
the extent to which students and faculty communicate
about academic performance, career plans, and course
content and assignments…
 …the Student-Faculty Interaction benchmark is related to
both academic and persistence outcomes.
Support for Learners
 The Support for Learners benchmark measures student’
perceptions of their colleges and assesses their use of
advising and counseling services…
 …the Support for Learners benchmark analysis suggest
that this benchmark has its greatest impact on
persistence…
Modified Survey Instrument
•

1) Asked questions in class or contributed to a class discussion

•

2) Made a class presentation

•

3) Prepared two or more drafts of a paper or assignment before turning it in

•

4) Come to class without completing or reading assignments

•

5) Worked with other students on projects during class

•

6) Worked with classmates outside of class to prepare class assignments

•

7) Tutored or taught students (paid or voluntary)

•

8) Participated in a community-based project as a part of this course

•

9) Used the Internet or instant messaging to work on an assignment

•

10) Used email to communicate with your instructor

•

11) Discussed grades or assignments with your instructor

•

12) Talked about career plans with an instructor or advisor

•

13) Discussed ideas from your readings or classes (with faculty members) outside or class

•

14) Received prompt feedback (written or oral) from your instructor on your performance

•

15) Worked harder than you thought you could to meet your instructor's standards or expectations

•

16) Worked with instructors on activities other than coursework

•

17) Discussed ideas from your readings or class with others outside of class (with students, family members, co-workers, etc.)

•

18) Had serious conversations with students of a different race or ethnicity other than your own

•

19) Had serious conversations with students who differ from you in terms of religious beliefs, political opinions, or personal
values
Study Sample Size
 Seven sections of Sociology with 212 total number
of students enrolled in all sections and n=132
students completing the survey (62%).
 In the three face-to-face sections, 61 out of 115
(53%) participated,
 for the two online, 33 out of 45 (73%), and
 38 out of 52 students participated in the survey
(73%) from the blended sections.
Results by delivery modality
Result by Questions
CCSSE Benchmarks Results
Further Discussion
 The high bar is set by face-to-face; how can we make
our online courses more active and collaborative?
 Is the blended course actually easier? Why might
students perceive it as such?
 Is the blended course indeed the “best of both
worlds” in regards to student to faculty interaction
and student support?
Further Study
 More closely align the QM Standards with CCSSE
Benchmarks.
 Look at redesigning the survey to include a more
balanced number of questions from each benchmark
area.
 Include a larger number of courses (possibly across
multiple institutions) for a comparison study and
meta analysis.
References:
Junco, R., Heibergert, G. & Loken, E. (2010) The effect of Twitter
on college student engagement and grades. Journal of
Computer Assisted Learning. Blackwell Publishing 2010.
Kuh, G.D., Cruce, T., Shoup, R., Kinzie, J., & Gonyea, R.M.
(2007). Unmasking the effects of student engagement on
college grades and persistence. Journal of Higher Education.
McClenney, K., Marti, C.N., & Adkins, C. (2006). Student
engagement and student outcomes: Key findings from CCSSE
validation research. Austin, TX: University of Texas at Austin,
Community College Leadership Program.

More Related Content

PPTX
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
PDF
Mixing Measures: How We Used Quantitative and Qualitative Techniques to Asses...
PPTX
NVivo in educational research two examples from new mexico
PPTX
Recommendations on Formative Assessment and Feedback Practices for stronger e...
PPTX
Building Data Literacy Among Middle School Administrators and Teachers
DOCX
Keeping the faith: Conversations to advance the middle school concept with i...
PPTX
Feeling supported: Enabling students in diverse cohorts through personalised ...
PPTX
Exploring learners’ motivations on Assessment in a Massive Open Online Course...
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
Mixing Measures: How We Used Quantitative and Qualitative Techniques to Asses...
NVivo in educational research two examples from new mexico
Recommendations on Formative Assessment and Feedback Practices for stronger e...
Building Data Literacy Among Middle School Administrators and Teachers
Keeping the faith: Conversations to advance the middle school concept with i...
Feeling supported: Enabling students in diverse cohorts through personalised ...
Exploring learners’ motivations on Assessment in a Massive Open Online Course...

What's hot (20)

PPTX
UCEA presentation by Neiderhouse (11-7-13)
PDF
Using Muddiest Point Formative Feedback to Encourage Reflective Teaching and ...
PPT
Sreb March 2010 5
PPTX
Enhancing Online Learning
PPTX
3.7 Evaluating impacts of VLE use
PPTX
Promoting academic integrity through robust assessment design
PPT
Post 7. comparative and non comparative evaluation in educational technology
PPTX
SMS Reminders and Improvement of Course Outcomes
PPTX
Creating learning environments for self-generated feedback to thrive
PPT
Book Launch: Designing effective feedback processes
PPTX
Cunningham and Allardice
PPT
Partnership with students in designing feedback processes for large classes
PPTX
Analyzing exemplars
PDF
A Preliminary Exploration of the Relationships Between Student-Created OER, S...
PPTX
Improving the 6th Grade Transition for Middle School Students
PPTX
Active learning strategies in the information literacy classroom. Evaluating ...
PPT
Comparative And Non Comparative Study
PPTX
Beyond MOOCS – A Catalyst for Change
PPT
Teaching for quality student learning
PPTX
Flipped classroom brief, NYMU
UCEA presentation by Neiderhouse (11-7-13)
Using Muddiest Point Formative Feedback to Encourage Reflective Teaching and ...
Sreb March 2010 5
Enhancing Online Learning
3.7 Evaluating impacts of VLE use
Promoting academic integrity through robust assessment design
Post 7. comparative and non comparative evaluation in educational technology
SMS Reminders and Improvement of Course Outcomes
Creating learning environments for self-generated feedback to thrive
Book Launch: Designing effective feedback processes
Cunningham and Allardice
Partnership with students in designing feedback processes for large classes
Analyzing exemplars
A Preliminary Exploration of the Relationships Between Student-Created OER, S...
Improving the 6th Grade Transition for Middle School Students
Active learning strategies in the information literacy classroom. Evaluating ...
Comparative And Non Comparative Study
Beyond MOOCS – A Catalyst for Change
Teaching for quality student learning
Flipped classroom brief, NYMU
Ad

Similar to Learner Engagement, QM Standards and the Blended Course (20)

PPT
The HeforShe Campaign
PPTX
Participation vs Engagement. Together Everyone Achieve More
PPTX
Online Student Engagement Practices New Horizons 2015
PPTX
Using engagement surveys to evaluate institutional students enhancement initi...
PPTX
Using Learning Analytics to Assess Innovation & Improve Student Achievement
PPTX
Symposium visual final
PPTX
Ccsse & millennials
PPTX
Learner enhanced technology #HETL15 #HETLUtah
PDF
LIT5091 - Original Contribution Final
PDF
STUDENT ENGAGEMENT MONITORING IN ONLINE LEARNING ENVIRONMENT USING FACE DETEC...
PPTX
Faculty Workshop: Boost Student Engagement and Retention
PDF
LIT5091 - Original Contribution.pdf
PPTX
People Who Need People, Enhancing Student Engagement in Undergraduate Blended...
PPTX
The QM Rubric and Learner Outcomes: A Study
PPT
Capstone mock job talk
PPTX
Encouraging Engagement
PPTX
Measuring & Maximizing Learner Engagement
DOCX
Adult Learning Theories ChartPart 1 Theories o.docx
PPTX
Wsu guest lecture_2015_czlv_v3
PPTX
Learner enhanced technology
The HeforShe Campaign
Participation vs Engagement. Together Everyone Achieve More
Online Student Engagement Practices New Horizons 2015
Using engagement surveys to evaluate institutional students enhancement initi...
Using Learning Analytics to Assess Innovation & Improve Student Achievement
Symposium visual final
Ccsse & millennials
Learner enhanced technology #HETL15 #HETLUtah
LIT5091 - Original Contribution Final
STUDENT ENGAGEMENT MONITORING IN ONLINE LEARNING ENVIRONMENT USING FACE DETEC...
Faculty Workshop: Boost Student Engagement and Retention
LIT5091 - Original Contribution.pdf
People Who Need People, Enhancing Student Engagement in Undergraduate Blended...
The QM Rubric and Learner Outcomes: A Study
Capstone mock job talk
Encouraging Engagement
Measuring & Maximizing Learner Engagement
Adult Learning Theories ChartPart 1 Theories o.docx
Wsu guest lecture_2015_czlv_v3
Learner enhanced technology
Ad

More from Lakeland Community College (16)

PPTX
Smartphone Learning: Designing for the Emerging Mobile Learning Environment
PPT
Student Voices: Online Student Success
PPT
Can Digital Badges Increase Capacity for Teaching Online?
PPT
Using Technology to Enhance Teaching effectiveness
PPT
Strategies for Student Engagement in the Online Course
PPT
Blended Design: Active learning
PPT
Blended Learning: Feedback and Assessment
PPT
Sorting It Out: Using Task-Affordance Analysis to Design Blended Courses
PPTX
Holden University Center
PPTX
What's so Special about Blended Learning?
PPTX
What's so special about blended learning?
PPTX
Twitter for Teaching & Learning
PPTX
Sustainable Learning Technologies
PPTX
Smartphone Learning: Designing for the Emerging Mobile Learning Environment
Student Voices: Online Student Success
Can Digital Badges Increase Capacity for Teaching Online?
Using Technology to Enhance Teaching effectiveness
Strategies for Student Engagement in the Online Course
Blended Design: Active learning
Blended Learning: Feedback and Assessment
Sorting It Out: Using Task-Affordance Analysis to Design Blended Courses
Holden University Center
What's so Special about Blended Learning?
What's so special about blended learning?
Twitter for Teaching & Learning
Sustainable Learning Technologies

Recently uploaded (20)

PDF
My India Quiz Book_20210205121199924.pdf
PDF
What if we spent less time fighting change, and more time building what’s rig...
PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
PPTX
Computer Architecture Input Output Memory.pptx
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
Empowerment Technology for Senior High School Guide
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PPTX
Virtual and Augmented Reality in Current Scenario
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
My India Quiz Book_20210205121199924.pdf
What if we spent less time fighting change, and more time building what’s rig...
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
202450812 BayCHI UCSC-SV 20250812 v17.pptx
Unit 4 Computer Architecture Multicore Processor.pptx
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
Chinmaya Tiranga quiz Grand Finale.pdf
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
Computer Architecture Input Output Memory.pptx
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Paper A Mock Exam 9_ Attempt review.pdf.
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
Weekly quiz Compilation Jan -July 25.pdf
Empowerment Technology for Senior High School Guide
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Virtual and Augmented Reality in Current Scenario
LDMMIA Reiki Yoga Finals Review Spring Summer

Learner Engagement, QM Standards and the Blended Course

  • 1. Measuring the impact on student engagement in the redesigned Blended Course using Quality Matters standards Bill Knapp, Dean of Learning Technologies Joanna Paull, Associate Professor, English Lakeland Community College
  • 2. Agenda Hybrid Workshop Series •Objectives •Structure •Demographics •Outcomes Research Project •Student Engagement •Survey Design •Results •Recommendations
  • 3. Presentation Questions/Discussion We welcome your questions at any time during the presentation. However, you may also post your questions or comments to Poll everywhere or Tweet tag: #qm4engage Text 772896 and your message to 37607 - or visit Pollev.com Post to Twitter #qm4engage
  • 4. Objectives for Workshop  Provide information about hybrid pedagogy Formative & summative student assessment Pedagogical scholarship Creating active learning environments Instructional materials choices  Create a cohort of informed hybrid instructors  Establish hybrid pedagogy faculty community
  • 5. Workshop Structure  Eight-week hybrid course that covers: Hybrid definitions Active Learning Instructional Design Course and Student Assessment
  • 8. Ties to structure of course screen shots to reflect navigation
  • 12. Instructional Design  What are QM Standards?  How does our workshop course site reflect those elements?  What are some ways to make our courses more broadly accessible by our students?  What role does media and/or tools play in how we share our courses with students?
  • 13. Active Learning: Build a Hybrid Module
  • 14. Our Results: New Hybrid Courses  Intro to Sociology  Sociology of Aging  Environmental Geography  Intro to Accounting  Interpersonal Communication
  • 15. Assessment       Discuss previous assessment experiences. Read assessment scholarship. Differentiate between formative & summative Ask students to assess our workshop. Provide letters of appreciation & participation. Mail out certificates of completion.
  • 16. Student Engagement The findings from 20 years of research on undergraduate education have been unequivocal: The more actively engaged students are – with college faculty and staff, with other students, and with the subject matter they study – the more likely they are to learn, to stick with their studies, and to attain their academic goals. - Community College Leadership Program
  • 17. CCSSE Benchmarks & Quality Matters Standards  Active and Collaborative Learning  Student Effort  Academic Challenge  Student-Faculty Interaction  Support for Learners
  • 18. Active and Collaborative Learning  The Active and collaborative learning benchmark measures the extent to which student participate in class, interact with other students, and extend learning outside the classroom…  Active and collaborative learning is linked with higher grades and course completion measures as well as long term persistence…
  • 19. Student Effort  The Student Effort benchmark measures time on task, preparation, and use of student services…  …the Student Effort benchmark is predictably related to retention measures and moderately predictive of academic measures.
  • 20. Academic Challenge  The Academic Challenge benchmark measures the extent to which students engage in challenging mental activities, such as evaluation and synthesis, as well as the quantity and rigor of their academic work…  Academic Challenge was most consistently associated with academic outcomes…
  • 21. Student-Faculty Interaction  The Student to Faculty Interaction benchmark measures the extent to which students and faculty communicate about academic performance, career plans, and course content and assignments…  …the Student-Faculty Interaction benchmark is related to both academic and persistence outcomes.
  • 22. Support for Learners  The Support for Learners benchmark measures student’ perceptions of their colleges and assesses their use of advising and counseling services…  …the Support for Learners benchmark analysis suggest that this benchmark has its greatest impact on persistence…
  • 23. Modified Survey Instrument • 1) Asked questions in class or contributed to a class discussion • 2) Made a class presentation • 3) Prepared two or more drafts of a paper or assignment before turning it in • 4) Come to class without completing or reading assignments • 5) Worked with other students on projects during class • 6) Worked with classmates outside of class to prepare class assignments • 7) Tutored or taught students (paid or voluntary) • 8) Participated in a community-based project as a part of this course • 9) Used the Internet or instant messaging to work on an assignment • 10) Used email to communicate with your instructor • 11) Discussed grades or assignments with your instructor • 12) Talked about career plans with an instructor or advisor • 13) Discussed ideas from your readings or classes (with faculty members) outside or class • 14) Received prompt feedback (written or oral) from your instructor on your performance • 15) Worked harder than you thought you could to meet your instructor's standards or expectations • 16) Worked with instructors on activities other than coursework • 17) Discussed ideas from your readings or class with others outside of class (with students, family members, co-workers, etc.) • 18) Had serious conversations with students of a different race or ethnicity other than your own • 19) Had serious conversations with students who differ from you in terms of religious beliefs, political opinions, or personal values
  • 24. Study Sample Size  Seven sections of Sociology with 212 total number of students enrolled in all sections and n=132 students completing the survey (62%).  In the three face-to-face sections, 61 out of 115 (53%) participated,  for the two online, 33 out of 45 (73%), and  38 out of 52 students participated in the survey (73%) from the blended sections.
  • 28. Further Discussion  The high bar is set by face-to-face; how can we make our online courses more active and collaborative?  Is the blended course actually easier? Why might students perceive it as such?  Is the blended course indeed the “best of both worlds” in regards to student to faculty interaction and student support?
  • 29. Further Study  More closely align the QM Standards with CCSSE Benchmarks.  Look at redesigning the survey to include a more balanced number of questions from each benchmark area.  Include a larger number of courses (possibly across multiple institutions) for a comparison study and meta analysis.
  • 30. References: Junco, R., Heibergert, G. & Loken, E. (2010) The effect of Twitter on college student engagement and grades. Journal of Computer Assisted Learning. Blackwell Publishing 2010. Kuh, G.D., Cruce, T., Shoup, R., Kinzie, J., & Gonyea, R.M. (2007). Unmasking the effects of student engagement on college grades and persistence. Journal of Higher Education. McClenney, K., Marti, C.N., & Adkins, C. (2006). Student engagement and student outcomes: Key findings from CCSSE validation research. Austin, TX: University of Texas at Austin, Community College Leadership Program.