SlideShare a Scribd company logo
  The importance of formative data    Scott McLeod, J.D., Ph.D. University of Minnesota
DDDM  ≠  NCLB NCLB  = external accountability to federal government and citizenry We have to stop  equating these
DDDM  ≠  NCLB DDDM  = getting better information into the hands of educators so that they can make  good instructional decisions for the benefit  of students We have to stop  equating these
DDDM  ≠  NCLB DDDM  = helping schools know whether what they are doing is working We have to stop  equating these
DDDM  ≠  NCLB DDDM  = helping schools navigate the educational change process more intelligently We have to stop  equating these
What most schools are doing Good  baseline data Measurable instructional goals
The problem with what  most schools are doing Good  baseline data Measurable instructional goals This is important but insufficient  to drive meaningful changes  in student achievement There has been too much  focus on ‘big data’ and not  enough on ‘little data’
Frequency of assessment Renaissance Learning ™ big little
9 essential elements of  data-driven PLCs Frequent formative assessments Professional learning communities rooted in student information Making instructional changes Data safety  Data transparency Technology Alignment for results Good  baseline data Measurable instructional goals
The power of  formative assessments Quicker feedback to teachers Not “autopsy data” Black & Wiliam. (1998). Inside the black box.  Phi Delta Kappan . Review of over 280 research articles Effect sizes of 0.4 to 0.7    this is HUGE!
The power of formative assessments Black & Wiliam. (1998). Inside the black box.  Phi Delta Kappan . (continued) “ Formative assessment … can raise standards of achievement … no other [intervention] for which such a strong prima facie case can be made” Helps low achievers more than other students
‘ Little data’ is useful! CPRE
Formative assessments should be  common Typically periodic, not daily Given by all teachers to all students Grade level Subject area Formats Pre-made Teacher-created from item banks of questions Teacher-created from self-made questions
The power of  common assessments Teachers have shared understanding and consensus agreement about what is important to teach / learn Common language for discussions
The power of  common assessments Similar information for comparison Reduced variability across teachers Highlight strengths Replication of best practice More chances to make changes to benefit kids  while you have them in front of you
Regular team meetings Old model Topic A Topic B Topic C Topic A Topic A Topic A New model
When teacher teams  (PLCs) meet… Note the expectation that teacher conversations will be rooted in data / information Also the expectation that changes will be made based on the results teachers are seeing “Subtle accountability,” but reporting for support and information up, not  just  to be held accountable
Statewide DDDM readiness study Teachers (n = 3,135 / 11,120?)  (28%?) Principals (n = 791 / 1,770)  (45%) Superintendents (n = 202 / 351)  (58%) District technology coordinators  (n = 139 / 351)  (40%) 4,267 Minnesota educators Awesome!
Measurable instructional goals
Teacher teams (PLCs) that meet regularly
Making instructional changes
Data access and transparency
Data safety
Technology
Alignment for results
Leadership and support
Professional development
Beliefs
Technology You can do data-driven decision-making without technology, but it’s awfully difficult. - McLeod, 2005
Useful Excel skills www.scottmcleod.net/yorkbarr www.schooldatatutorials.org
Wrap-up Questions / comments? Thanks for the invite! [email_address]

More Related Content

PPTX
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
PPT
2009 ECNO Conference - Teaching Learning Critical Pathway
PPT
Logic Model and Education
PPTX
WSU new standards mean new baseline
PDF
Introduction to Logic Models
PDF
CIPP Evaluation Model
PDF
ABLE - Inside Government Nov 2017 - Rebecca Edwards
PPT
Evaluating Student Success Initiatives
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
2009 ECNO Conference - Teaching Learning Critical Pathway
Logic Model and Education
WSU new standards mean new baseline
Introduction to Logic Models
CIPP Evaluation Model
ABLE - Inside Government Nov 2017 - Rebecca Edwards
Evaluating Student Success Initiatives

What's hot (20)

PPTX
Ncea and standards based education
PDF
Using Naviance Data to Drive College & Career Readiness
DOCX
Logic models
PPT
Introduction to logic models
PDF
Unleashing Analytics in the Classroom
PPTX
Program Logic Models
PPTX
T44u 2015, marketing analytics data driven decision making
PDF
Logic Model Workbook
PPTX
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
PPTX
Using Data to Drive Personalized Math Learning Needs
PPT
2010 bush foundation inputs, process indicators, and intermediate outcomes
DOCX
Quality Evaluation of the Higher Education Programmes
PPTX
TESTA Interactive Masterclass
PPT
Program logic models: design and use
PPTX
Region 4 Coherence for Boards
PPS
PPTX
Fasp pd skills & beliefs
PPTX
2011 2012 parker data analysis
PPTX
cipp model
PPT
Quality Matters0809
Ncea and standards based education
Using Naviance Data to Drive College & Career Readiness
Logic models
Introduction to logic models
Unleashing Analytics in the Classroom
Program Logic Models
T44u 2015, marketing analytics data driven decision making
Logic Model Workbook
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
Using Data to Drive Personalized Math Learning Needs
2010 bush foundation inputs, process indicators, and intermediate outcomes
Quality Evaluation of the Higher Education Programmes
TESTA Interactive Masterclass
Program logic models: design and use
Region 4 Coherence for Boards
Fasp pd skills & beliefs
2011 2012 parker data analysis
cipp model
Quality Matters0809
Ad

Viewers also liked (20)

PDF
IT bez lukru. Prezentacja Macieja Aniserowicza - devstyle.pl
PDF
Modulo 2 herramientas de investigación tema 3
PPTX
América
PPTX
Chokololis productos
PDF
Program spotkania #MamoPracujwIT we Wrocławiu
PPTX
Spotkanie Mamo Pracuj w IT - program i partnerzy spotkania
PDF
PDF
婚禮服務網站企劃
PPTX
Automated layout testing using Galen Framework
PDF
JPoint 2016 - Bytecode
PDF
Oredev 2015 - Taming Java Agents
PPT
ERP Outsourcing, Dynamics AX, and Managed Services by OneNeck IT Services
PPTX
El mundo comunista durante la guerra fría
PPT
Chokololis
PDF
Hr 016 物理系進路圖1
PDF
Pxl marktonderzoek december 2015
PPS
幸福創業計畫
PPT
Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...
IT bez lukru. Prezentacja Macieja Aniserowicza - devstyle.pl
Modulo 2 herramientas de investigación tema 3
América
Chokololis productos
Program spotkania #MamoPracujwIT we Wrocławiu
Spotkanie Mamo Pracuj w IT - program i partnerzy spotkania
婚禮服務網站企劃
Automated layout testing using Galen Framework
JPoint 2016 - Bytecode
Oredev 2015 - Taming Java Agents
ERP Outsourcing, Dynamics AX, and Managed Services by OneNeck IT Services
El mundo comunista durante la guerra fría
Chokololis
Hr 016 物理系進路圖1
Pxl marktonderzoek december 2015
幸福創業計畫
Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...
Ad

Similar to 2007 Guest Speaker Session for Dr. Jen York-Barr (20)

PPT
McLeod 2007 MN-SDC PowerPoint
PPT
2007 MESPA Data-Driven Elementary School Principals
PPTX
Data Informed Decisions
PPTX
07 18-13 webinar - sharnell jackson - using data to personalize learning
PPTX
Leveraging Professional Development and Data to Transform Math Instruction
PPTX
From theory to practice blending the math classroom and creating a data cultu...
PPT
Data driven ppt_presentation[1]
PDF
How data informs decision making 2
PDF
HB Online Inspired
PPTX
Cottle ppt edpsych510
PPTX
Data Driven Instruction for Online Learning
PPTX
Data informed decision-making
PPT
Lacuesite 2013 accountability
PPTX
data driven decision making
PDF
DreamBoxWP_ActionableData_V6A (1)
DOCX
Data Driven Instructional Decision MakingA framework.docx
PDF
4th Telstra Education White Paper
PPTX
Didd 2014
PDF
ετπε2017 invited speech-april2017
PPTX
Analyzing and Interpreting Assessment Data.pptx
McLeod 2007 MN-SDC PowerPoint
2007 MESPA Data-Driven Elementary School Principals
Data Informed Decisions
07 18-13 webinar - sharnell jackson - using data to personalize learning
Leveraging Professional Development and Data to Transform Math Instruction
From theory to practice blending the math classroom and creating a data cultu...
Data driven ppt_presentation[1]
How data informs decision making 2
HB Online Inspired
Cottle ppt edpsych510
Data Driven Instruction for Online Learning
Data informed decision-making
Lacuesite 2013 accountability
data driven decision making
DreamBoxWP_ActionableData_V6A (1)
Data Driven Instructional Decision MakingA framework.docx
4th Telstra Education White Paper
Didd 2014
ετπε2017 invited speech-april2017
Analyzing and Interpreting Assessment Data.pptx

More from Scott McLeod (20)

PPTX
2012 Franklin Schools
PPTX
Understanding the Education System [Trace Pickering]
PPTX
2011 McLeod TEDU 370 Group 1
PPTX
Two Big Shifts, One Big Problem - Archdiocese of Philadelphia
PPT
The t-shirt game
PPTX
Why be social?
PPTX
Why be social?
PPT
Blogs, Twitter, YouTube, and More
PPTX
District 112
PPTX
Teaching and learning in an era of disruptive innovation
PPTX
Digital Technology Impact Slides
PPTX
2009 Presentation to the UCEA Executive Committee
PPT
Q-Man! The Amazing Magnetic Man!
PPTX
Pathway Builder In LAePortal
PPT
SAISD - The Times They Are A-Changin'
PDF
SAISD Administrator Blogs
PDF
SAISD Cyberbullying
PPT
Cretin-Derham Hall 02
PPT
2007 CALI
PPT
How to get from here to there: An action agenda
2012 Franklin Schools
Understanding the Education System [Trace Pickering]
2011 McLeod TEDU 370 Group 1
Two Big Shifts, One Big Problem - Archdiocese of Philadelphia
The t-shirt game
Why be social?
Why be social?
Blogs, Twitter, YouTube, and More
District 112
Teaching and learning in an era of disruptive innovation
Digital Technology Impact Slides
2009 Presentation to the UCEA Executive Committee
Q-Man! The Amazing Magnetic Man!
Pathway Builder In LAePortal
SAISD - The Times They Are A-Changin'
SAISD Administrator Blogs
SAISD Cyberbullying
Cretin-Derham Hall 02
2007 CALI
How to get from here to there: An action agenda

Recently uploaded (20)

PPTX
PPH.pptx obstetrics and gynecology in nursing
PDF
RMMM.pdf make it easy to upload and study
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PPTX
Pharma ospi slides which help in ospi learning
PDF
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
Basic Mud Logging Guide for educational purpose
PDF
Classroom Observation Tools for Teachers
PPTX
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
PDF
Business Ethics Teaching Materials for college
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPTX
Cell Types and Its function , kingdom of life
PPH.pptx obstetrics and gynecology in nursing
RMMM.pdf make it easy to upload and study
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Pharma ospi slides which help in ospi learning
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
102 student loan defaulters named and shamed – Is someone you know on the list?
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Basic Mud Logging Guide for educational purpose
Classroom Observation Tools for Teachers
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
Business Ethics Teaching Materials for college
FourierSeries-QuestionsWithAnswers(Part-A).pdf
VCE English Exam - Section C Student Revision Booklet
2.FourierTransform-ShortQuestionswithAnswers.pdf
Final Presentation General Medicine 03-08-2024.pptx
Supply Chain Operations Speaking Notes -ICLT Program
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Cell Types and Its function , kingdom of life

2007 Guest Speaker Session for Dr. Jen York-Barr

  • 1. The importance of formative data Scott McLeod, J.D., Ph.D. University of Minnesota
  • 2. DDDM ≠ NCLB NCLB = external accountability to federal government and citizenry We have to stop equating these
  • 3. DDDM ≠ NCLB DDDM = getting better information into the hands of educators so that they can make good instructional decisions for the benefit of students We have to stop equating these
  • 4. DDDM ≠ NCLB DDDM = helping schools know whether what they are doing is working We have to stop equating these
  • 5. DDDM ≠ NCLB DDDM = helping schools navigate the educational change process more intelligently We have to stop equating these
  • 6. What most schools are doing Good baseline data Measurable instructional goals
  • 7. The problem with what most schools are doing Good baseline data Measurable instructional goals This is important but insufficient to drive meaningful changes in student achievement There has been too much focus on ‘big data’ and not enough on ‘little data’
  • 8. Frequency of assessment Renaissance Learning ™ big little
  • 9. 9 essential elements of data-driven PLCs Frequent formative assessments Professional learning communities rooted in student information Making instructional changes Data safety Data transparency Technology Alignment for results Good baseline data Measurable instructional goals
  • 10. The power of formative assessments Quicker feedback to teachers Not “autopsy data” Black & Wiliam. (1998). Inside the black box. Phi Delta Kappan . Review of over 280 research articles Effect sizes of 0.4 to 0.7  this is HUGE!
  • 11. The power of formative assessments Black & Wiliam. (1998). Inside the black box. Phi Delta Kappan . (continued) “ Formative assessment … can raise standards of achievement … no other [intervention] for which such a strong prima facie case can be made” Helps low achievers more than other students
  • 12. ‘ Little data’ is useful! CPRE
  • 13. Formative assessments should be common Typically periodic, not daily Given by all teachers to all students Grade level Subject area Formats Pre-made Teacher-created from item banks of questions Teacher-created from self-made questions
  • 14. The power of common assessments Teachers have shared understanding and consensus agreement about what is important to teach / learn Common language for discussions
  • 15. The power of common assessments Similar information for comparison Reduced variability across teachers Highlight strengths Replication of best practice More chances to make changes to benefit kids while you have them in front of you
  • 16. Regular team meetings Old model Topic A Topic B Topic C Topic A Topic A Topic A New model
  • 17. When teacher teams (PLCs) meet… Note the expectation that teacher conversations will be rooted in data / information Also the expectation that changes will be made based on the results teachers are seeing “Subtle accountability,” but reporting for support and information up, not just to be held accountable
  • 18. Statewide DDDM readiness study Teachers (n = 3,135 / 11,120?) (28%?) Principals (n = 791 / 1,770) (45%) Superintendents (n = 202 / 351) (58%) District technology coordinators (n = 139 / 351) (40%) 4,267 Minnesota educators Awesome!
  • 20. Teacher teams (PLCs) that meet regularly
  • 22. Data access and transparency
  • 29. Technology You can do data-driven decision-making without technology, but it’s awfully difficult. - McLeod, 2005
  • 30. Useful Excel skills www.scottmcleod.net/yorkbarr www.schooldatatutorials.org
  • 31. Wrap-up Questions / comments? Thanks for the invite! [email_address]