1
Comparing the Efficacy of Face to Face,
MOOC and Hybrid Computer Science
Teacher Professional Development
Carol L. Fletcher, Ph.D., The University of Texas at Austin
W. Wesley Monroe, The University of Texas at Austin
Jayce Warner, The University of Texas at Austin
Kristin Anthony, Planview
October 6, 2016
2
 Overview of CS Education Landscape In Texas
 Preparing Teachers for CS Certification:
 Face to Face Workshops
 Scaling the Program with a MOOC
 Research Question
 Analysis
 Conclusions and Thoughts on Future Research
3
All High Schools in Texas are Required to Offer CS
Curriculum Requirement
4
CS In Texas High Schools
What do you think
these dots represent?
5
CS In Texas High Schools
These high schools
had no CS course
offerings in the
2014-2015 school year!
6
CS In Texas High Schools
These high schools
did have CS offerings
in 2014-15
7
Only 2% of
TX graduates
take a CS
course
CS Facts
Only 14 teachers
completed a pre-service
teacher certification
program in CS in
2014-15.
Only 27% of
TX high
schools
even offer a
CS course
8
WeTeach_CS Program Overview
9
Teachers Must:
pass a State administered test
covering 9 core competencies
across 3 domains
Teacher Qualifications
10
WeTeach_CS Certification Prep
11
Online Course Design
1. Use pseudo code for coding examples.
2. Create a Diagnostic Quiz at the start of the course to establish current
understanding.
3. Gather base level information about teachers demographics,
experience and interest.
4. Six week course with a weekly quiz at the end of each week.
5. There must be a full practice exam at the end of the course.
6. Use 80% as the passing grade: the same as required for the actual
certification exam.
7. Spend more time on the more difficult topic areas.
12
Online Course Design
13
Teacher Demographics
14
Teacher Demographics
15
Teacher Demographics
16
Teacher Demographics
17
Research Questions
1. What background or contextual factors are related to
the likelihood of getting certified to teach Computer
Science?
18
Research Questions
1. What background or contextual factors are related to
the likelihood of getting certified to teach Computer
Science?
2. How do the online, face-to-face and hybrid professional
development formats compare in terms of the likelihood
of participants getting certified in Computer Science?
19
Hypothesized Factors Related to Success in
Attaining Certification
We grouped the variables into 4 separate models in
order to test whether each model was related to
obtaining CS certification above and beyond other
factors:
1 – Education and Certification Background
2 – Prior Experience and Interest in Programming
3 – Connection to the CS Community
4 – Type of Certification Prep Participation
20
Hypothesized Factors Related to Success in
Attaining Certification
Model 1 Education and Certification Background -
Hypothesis:
Teachers with STEM, advanced degrees, or
Math/Science/Tech Apps Certification might be
more likely to get certified.
21
Number of
Participants
Hypothesized Factors Related to Success in
Attaining Certification
22
Model 2 Programming Background and Interest -
Hypothesis:
Teachers with experience and interest
in programming are more likely to get
certified.
Hypothesized Factors Related to Success in
Attaining Certification
23
Hypothesized Factors Related to Success in
Attaining Certification
Number of
Participants
Experience and Interest in Programming
24
Hypothesized Factors Related to Success in
Attaining Certification
Number of
Participants
Experience and Interest in Programming
25
Model 3 Connection to the CS Community –
Hypothesis:
The likelihood of getting certified is related to
whether teachers are connected to the CS
community or teach at a school that offers CS.
Hypothesized Factors Related to Success in
Attaining Certification
C
S
26
Hypothesized Factors Related to Success in
Attaining Certification
Number of
Participants
27
Model 4 Participation in Certification Prep -
Hypothesis:
Teachers that participate in the
Certification Prep training are more
likely to get certified.
Hypothesized Factors Related to Success in
Attaining Certification
28
Hypothesized Factors Related to Success in
Attaining Certification
29
Research Questions:
1. What background or contextual factors are related to
the likelihood of getting certified to teach Computer
Science?
30
Conclusions
Research Question 1:
Participants were more likely to get certified if they:
• Had a current math certification
• Had a STEM degree
• Had an advanced degree
• Had a connection to the CS community
• CS was NOT offered at their school.
31
Conclusions
Research Question 1:
We found no relationship between the following factors and
obtaining CS certification.
• Science or technology apps certifications.
• Teacher programming background.
32
Research Questions:
1. What background or contextual factors are related to
the likelihood of getting certified to teach Computer
Science?
2. How do the online, face-to-face and hybrid professional
development formats compare in terms of the likelihood
of participants getting certified in Computer Science?
33
Conclusions
Research Question 2:
• Participation in any of the 3 PD models increased
the likelihood of certification.
• There was no significant difference in the odds of
getting certified between online and F2F models
of PD.
• Participants who engaged in both online and F2F
were more likely to get certified than those that
only participated in one or the other alone.
34
Limitations and Future Research
• Self-reporting of CS experience rather than
objective diagnostic measure
• Insufficient data regarding PD and experience
outside of WTCS
• Results are still coming in: participating teachers
continue to obtain certification
• Have we accounted for all the important factors
related to teacher motivation?

More Related Content

PDF
Priming the Computer Science Pump
PPTX
Why computer science in K-12 by Code.org
PDF
Devising EdTech Products for Dyslexic Individuals
PDF
ITHAKA The Next Wave 2016: Charles Isbell - Online MS in Computer Science
PPTX
Building the CS Pipeline - CS4TX
PDF
Building a Computer Science Pipeline in Your District
PPTX
WeTeach_CS CS Collaboratives Pre-Applicant Meeting
PPTX
Carol Fletcher CS Summit Welcome
Priming the Computer Science Pump
Why computer science in K-12 by Code.org
Devising EdTech Products for Dyslexic Individuals
ITHAKA The Next Wave 2016: Charles Isbell - Online MS in Computer Science
Building the CS Pipeline - CS4TX
Building a Computer Science Pipeline in Your District
WeTeach_CS CS Collaboratives Pre-Applicant Meeting
Carol Fletcher CS Summit Welcome

What's hot (20)

PPTX
Computer Science for All in Texas
PPTX
TASA/TASB 2015 Computer Science Imperative for K-12
PPTX
Computer Science Imperative
PPTX
WeTeach_CS and You Can Too! DFW CSTA
PPTX
Building a K-12 CS Pipeline TCEA 2 6-18
PPTX
CS Education in Texas ISDs: Partnerships for Success
PPTX
WTCS and You Can Too! (TASA Midwinter)
PPTX
WTCS and You Can Too!
PPTX
Preparing Your Students for the Innovation Economy with WeTeach_CS
PPTX
2021_05_21 «Failure to Disrupt: Why Technology Alone Can't Transform Education»
PPTX
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
PPTX
Big data in education
PDF
Resources For Computer Science Teachers
PPTX
Computer science curriculum based on Program learning outcomes and objectives
PDF
PPTX
CHEDTEB - Student Survey
PPTX
Reform of Informatics Curriculum and Teacher Training in Estonia
PPTX
Ocr GCSE computer science introduction
PPTX
Presentation @ #cesicon 2017 on the Provision of Computer Science in Upper Se...
PPTX
«Learning Analytics at the Open University and the UK»
Computer Science for All in Texas
TASA/TASB 2015 Computer Science Imperative for K-12
Computer Science Imperative
WeTeach_CS and You Can Too! DFW CSTA
Building a K-12 CS Pipeline TCEA 2 6-18
CS Education in Texas ISDs: Partnerships for Success
WTCS and You Can Too! (TASA Midwinter)
WTCS and You Can Too!
Preparing Your Students for the Innovation Economy with WeTeach_CS
2021_05_21 «Failure to Disrupt: Why Technology Alone Can't Transform Education»
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
Big data in education
Resources For Computer Science Teachers
Computer science curriculum based on Program learning outcomes and objectives
CHEDTEB - Student Survey
Reform of Informatics Curriculum and Teacher Training in Estonia
Ocr GCSE computer science introduction
Presentation @ #cesicon 2017 on the Provision of Computer Science in Upper Se...
«Learning Analytics at the Open University and the UK»
Ad

Similar to Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teacher Professional Development (20)

PPTX
FTCC - Distance Education Track
PPTX
Understanding learning analytics
PDF
AASA AACC Dual Credit Webinar
PPTX
Common core, common assessments, and education talent bringing everything to...
PPTX
Vss2009 Going Virtual III Presentation
PDF
Goingvirtual1
PPT
Education
PPTX
John SanGiovanni - Transitioning and Implementing the Common Core State Stand...
PPTX
Saad Chahine Thesis
PPTX
Saad Chahine Thesis Presentation Final
PPTX
Non-Cognitive Testing
PDF
Speak Up Data Featured at FETC 2022
PPT
2011 trends webinar deck 083111
PDF
Connecting with Today's Prospective Students - Hong Kong Report
PPTX
HealthCARE Montana and EdReady June 2015
PDF
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
PPT
Preparing Teachers: Building Evidence for Sound Policy
PPT
Cart Before The Horse
PDF
EERS Presentation (Justin and Sarah)
PPTX
Higher Education & Massachusetts' Next-Generation Assessment
FTCC - Distance Education Track
Understanding learning analytics
AASA AACC Dual Credit Webinar
Common core, common assessments, and education talent bringing everything to...
Vss2009 Going Virtual III Presentation
Goingvirtual1
Education
John SanGiovanni - Transitioning and Implementing the Common Core State Stand...
Saad Chahine Thesis
Saad Chahine Thesis Presentation Final
Non-Cognitive Testing
Speak Up Data Featured at FETC 2022
2011 trends webinar deck 083111
Connecting with Today's Prospective Students - Hong Kong Report
HealthCARE Montana and EdReady June 2015
FETC 2019 Metrics Messaging Blended Learning julie evans 012919 final
Preparing Teachers: Building Evidence for Sound Policy
Cart Before The Horse
EERS Presentation (Justin and Sarah)
Higher Education & Massachusetts' Next-Generation Assessment
Ad

More from WeTeach_CS (19)

PPTX
WeTeach_CS and You Can Too! / Texas STEM Conference Jan. 2019
PPTX
WTCS for HS / Texas STEM Conference Jan. 2019
PDF
C3: Coding Clubs and Camps / Texas STEM Conference Jan. 2019
PPTX
El Paso CS Policy & Code
PPTX
Education in the Innovation Age: Meeting the K-12 CS Challenge
PPTX
WeTeach_CS: What's Next?
PPTX
Texas K-12 Computer Science Education Policy
PPTX
WTCS 2018: WeTeach_CS Support for AP Computer Science: "A" Test and CS Princi...
PPTX
Implementing the Tri-Agency Report & Preparing All Students for 60x30 TX
PPTX
TI Leadership Summit – WeTeach_CS and you can too!
PPTX
Leveling Up in Texas CS Education
PPTX
WeTeach_CS Summit 2017 (Closing Presentation)
PPTX
WeTeach_CS Summit 2017 (Opening Presentation)
PPTX
WeTeach_CS: Strategies for Scale (100Kin10)
PPTX
WeTeach_CS: Strategies for Scale (NSF)
PPTX
WeTeach_CS CS Principles Mini-Conference
PDF
WeTeach_CS Summit 2016 background prezi
PDF
Computer Science In Texas
PDF
Building the Texas Computer Science Pipeline - Strategic Recommendations for ...
WeTeach_CS and You Can Too! / Texas STEM Conference Jan. 2019
WTCS for HS / Texas STEM Conference Jan. 2019
C3: Coding Clubs and Camps / Texas STEM Conference Jan. 2019
El Paso CS Policy & Code
Education in the Innovation Age: Meeting the K-12 CS Challenge
WeTeach_CS: What's Next?
Texas K-12 Computer Science Education Policy
WTCS 2018: WeTeach_CS Support for AP Computer Science: "A" Test and CS Princi...
Implementing the Tri-Agency Report & Preparing All Students for 60x30 TX
TI Leadership Summit – WeTeach_CS and you can too!
Leveling Up in Texas CS Education
WeTeach_CS Summit 2017 (Closing Presentation)
WeTeach_CS Summit 2017 (Opening Presentation)
WeTeach_CS: Strategies for Scale (100Kin10)
WeTeach_CS: Strategies for Scale (NSF)
WeTeach_CS CS Principles Mini-Conference
WeTeach_CS Summit 2016 background prezi
Computer Science In Texas
Building the Texas Computer Science Pipeline - Strategic Recommendations for ...

Recently uploaded (20)

PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PPTX
History, Philosophy and sociology of education (1).pptx
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PPTX
Computer Architecture Input Output Memory.pptx
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
Complications of Minimal Access-Surgery.pdf
PDF
Empowerment Technology for Senior High School Guide
PDF
Hazard Identification & Risk Assessment .pdf
PDF
IGGE1 Understanding the Self1234567891011
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
International_Financial_Reporting_Standa.pdf
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
History, Philosophy and sociology of education (1).pptx
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
A powerpoint presentation on the Revised K-10 Science Shaping Paper
B.Sc. DS Unit 2 Software Engineering.pptx
Computer Architecture Input Output Memory.pptx
TNA_Presentation-1-Final(SAVE)) (1).pptx
Weekly quiz Compilation Jan -July 25.pdf
Uderstanding digital marketing and marketing stratergie for engaging the digi...
Share_Module_2_Power_conflict_and_negotiation.pptx
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Chinmaya Tiranga quiz Grand Finale.pdf
Complications of Minimal Access-Surgery.pdf
Empowerment Technology for Senior High School Guide
Hazard Identification & Risk Assessment .pdf
IGGE1 Understanding the Self1234567891011
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
LDMMIA Reiki Yoga Finals Review Spring Summer
Unit 4 Computer Architecture Multicore Processor.pptx
International_Financial_Reporting_Standa.pdf

Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teacher Professional Development

  • 1. 1 Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teacher Professional Development Carol L. Fletcher, Ph.D., The University of Texas at Austin W. Wesley Monroe, The University of Texas at Austin Jayce Warner, The University of Texas at Austin Kristin Anthony, Planview October 6, 2016
  • 2. 2  Overview of CS Education Landscape In Texas  Preparing Teachers for CS Certification:  Face to Face Workshops  Scaling the Program with a MOOC  Research Question  Analysis  Conclusions and Thoughts on Future Research
  • 3. 3 All High Schools in Texas are Required to Offer CS Curriculum Requirement
  • 4. 4 CS In Texas High Schools What do you think these dots represent?
  • 5. 5 CS In Texas High Schools These high schools had no CS course offerings in the 2014-2015 school year!
  • 6. 6 CS In Texas High Schools These high schools did have CS offerings in 2014-15
  • 7. 7 Only 2% of TX graduates take a CS course CS Facts Only 14 teachers completed a pre-service teacher certification program in CS in 2014-15. Only 27% of TX high schools even offer a CS course
  • 9. 9 Teachers Must: pass a State administered test covering 9 core competencies across 3 domains Teacher Qualifications
  • 11. 11 Online Course Design 1. Use pseudo code for coding examples. 2. Create a Diagnostic Quiz at the start of the course to establish current understanding. 3. Gather base level information about teachers demographics, experience and interest. 4. Six week course with a weekly quiz at the end of each week. 5. There must be a full practice exam at the end of the course. 6. Use 80% as the passing grade: the same as required for the actual certification exam. 7. Spend more time on the more difficult topic areas.
  • 17. 17 Research Questions 1. What background or contextual factors are related to the likelihood of getting certified to teach Computer Science?
  • 18. 18 Research Questions 1. What background or contextual factors are related to the likelihood of getting certified to teach Computer Science? 2. How do the online, face-to-face and hybrid professional development formats compare in terms of the likelihood of participants getting certified in Computer Science?
  • 19. 19 Hypothesized Factors Related to Success in Attaining Certification We grouped the variables into 4 separate models in order to test whether each model was related to obtaining CS certification above and beyond other factors: 1 – Education and Certification Background 2 – Prior Experience and Interest in Programming 3 – Connection to the CS Community 4 – Type of Certification Prep Participation
  • 20. 20 Hypothesized Factors Related to Success in Attaining Certification Model 1 Education and Certification Background - Hypothesis: Teachers with STEM, advanced degrees, or Math/Science/Tech Apps Certification might be more likely to get certified.
  • 21. 21 Number of Participants Hypothesized Factors Related to Success in Attaining Certification
  • 22. 22 Model 2 Programming Background and Interest - Hypothesis: Teachers with experience and interest in programming are more likely to get certified. Hypothesized Factors Related to Success in Attaining Certification
  • 23. 23 Hypothesized Factors Related to Success in Attaining Certification Number of Participants Experience and Interest in Programming
  • 24. 24 Hypothesized Factors Related to Success in Attaining Certification Number of Participants Experience and Interest in Programming
  • 25. 25 Model 3 Connection to the CS Community – Hypothesis: The likelihood of getting certified is related to whether teachers are connected to the CS community or teach at a school that offers CS. Hypothesized Factors Related to Success in Attaining Certification C S
  • 26. 26 Hypothesized Factors Related to Success in Attaining Certification Number of Participants
  • 27. 27 Model 4 Participation in Certification Prep - Hypothesis: Teachers that participate in the Certification Prep training are more likely to get certified. Hypothesized Factors Related to Success in Attaining Certification
  • 28. 28 Hypothesized Factors Related to Success in Attaining Certification
  • 29. 29 Research Questions: 1. What background or contextual factors are related to the likelihood of getting certified to teach Computer Science?
  • 30. 30 Conclusions Research Question 1: Participants were more likely to get certified if they: • Had a current math certification • Had a STEM degree • Had an advanced degree • Had a connection to the CS community • CS was NOT offered at their school.
  • 31. 31 Conclusions Research Question 1: We found no relationship between the following factors and obtaining CS certification. • Science or technology apps certifications. • Teacher programming background.
  • 32. 32 Research Questions: 1. What background or contextual factors are related to the likelihood of getting certified to teach Computer Science? 2. How do the online, face-to-face and hybrid professional development formats compare in terms of the likelihood of participants getting certified in Computer Science?
  • 33. 33 Conclusions Research Question 2: • Participation in any of the 3 PD models increased the likelihood of certification. • There was no significant difference in the odds of getting certified between online and F2F models of PD. • Participants who engaged in both online and F2F were more likely to get certified than those that only participated in one or the other alone.
  • 34. 34 Limitations and Future Research • Self-reporting of CS experience rather than objective diagnostic measure • Insufficient data regarding PD and experience outside of WTCS • Results are still coming in: participating teachers continue to obtain certification • Have we accounted for all the important factors related to teacher motivation?

Editor's Notes

  • #3: Presenters Notes
  • #5: Here is map showing the zipcode of ¾ of the HS’s in Texas.
  • #6: What’s disappointing is that this figure is showing all of the HS’s that Do NOT offer CS in High School.
  • #11: Content and Order is the same. The only difference is in the interaction model and the amount opportunities for practice. In the class the instructor works problems with the class while in the online class there are 100’s of practice questions and the only opportunity for interaction is in the discussion boards. We did NOT see many questions in the discussion boards.
  • #12: Diagnostic Quiz – 20 questions instructed not to guess Survey gathers info that we use in this study as predictors
  • #13: We developed a design guide for the kinds of video’s used, and interleaved video and text content with many practice assessments.
  • #15: Females are slightly under represented vis-a-via Texas at large, but they still outnumber the males in the study.
  • #16: Females are slightly under represented vis-a-via Texas at large, but they still outnumber the males in the study.
  • #17: More aferican american and Asian than in Texas at large.
  • #20: We grouped factors that might be related to the outcome into 4 groups. We did basic univariate and bivariant stats to identify outliners and make sure there were not any patterns of missing data. We then performed a linear regression analysis with each group of predictors entered as separate blocks. We did sensitivity analysis with sets of predictors to make sure that each set of predictors was effecting the outcome. So what follows is a description of the groups of predictors and a look at the actual data.
  • #22: 1/3 of teachers had STEM and Advanced Degrees. We really thought that Teach Apps teachers would be more likely to succeed because of the computer literacy background.
  • #24: The way we studied these factors was we After controlling for Ed BG, none of these variables were related to the outcome of getting certified.
  • #25: The way we studied these factors was we After controlling for Ed BG, none of these variables were related to the outcome of getting certified.
  • #29: There were only a few people that took both but did not go on to take the certification exam. There have been 2 testing window since the course was offered, 1 was ½ way through the course. We decided to allow any that were taking the text before the end of the course to access the content early and in fact changed our model from releasing content weekly to releasing it all at once to avoid this issue going forward. 17% of the teachers that stated they intended to take the exam actually did.