Learning Outcomes1
Flight Deck byWayanVolta on flickr CC
Do you understand
how to fly an airplane?
Yes
Okay, but let’s look at
this checklist.
[trust and verify]
CTD Weekly Workshops:
Learning Outcomes
Peter Newbury, Ph.D.
Center forTeaching Development,
University of California, San Diego
pnewbury@ucsd.edu
@polarisdotca #ctducsd ctd.ucsd.edu
CTD Weekly Workshops:
Learning Outcomes
Unless otherwise noted, content is licensed under a Creative CommonsAttribution-Non Commercial 3.0 License.
resources: ctd.ucsd.edu/programs/weekly-workshops-spring-2015/
please
sign in
Scholarly approach to teaching:
Learning Outcomes3
CarlWieman
Science Education Initiative
cwsei.ubc.ca
What should
students
learn?
learning
outcomes
(goals, objectives)
assessment
active learning,
peer instruction
What should
students
learn?
What are
students
learning?
What instructional
approaches
help students
learn?
(Image: NASA)Learning Outcomes4
Introductory “Astro 101”
Traditional Course Syllabus
Course with
Learning Outcomes
Learning Outcomes5
This course covers Chapters
1. Mercury
2. Venus
…
8. Neptune
9. Asteroids and Comets
10. Formation of the
Solar System
 deduce from patterns in the
properties of the planets,
moons, asteroids and other
bodies that the Solar System
had single formation event.
 provide notable examples of
how comets influenced
history, art and science
Learning outcomes
Learning Outcomes6
 completes the sentence,“By this end of this
lesson/unit/course, you will be able to…”
 begins with an action verb (“deduce”) (more below)
 tells the students what they must do to demonstrate
they “understand” the concept
Learning outcomes are valuable to…
Learning Outcomes7
 the instructor
o crystallizes what the instructor cares about
o helps the instructor select instructional strategies
and activities, write the final exam
“select instructional activities…”
Learning Outcomes8 ClassAction http://astro.unl.edu/classaction/
Does this peer
instruction question
support the
learning outcomes?
don’t
use it
use it
yesno
“write the final exam…”
Learning Outcomes9
(10 marks) List 3 patterns of the Solar System as a
whole.Then, outline in some detail the current model for
the formation of the Solar System. In particular, make sure
you explain how the observed patterns and regularities are
related to this theory of formation.
teaching to
the test? Yes!
Learning outcomes are valuable to…
Learning Outcomes10
 the students
o reveal what the instructor is looking for: no more
guessing what “understand” means or what will be
on the exam
o big picture of the next part of the course
o allow student to check that s/he has mastered the
concept (especially when studying later)
A course should have
Course-level LOs Topic-level LOs
Learning Outcomes
 several LOs giving big
picture, attitudes,
behaviors
 (likely) can’t be assessed
with a single exam
question
 supported by many
topic-level LOs
 many LOs defining what
it means to “understand”
at this level (freshman,…)
 can be (should be)
repeatedly assessed on
homework, exams
 support one or more
course-level LOs
11
Topic-level
LO
Topic-level
LO
Topic-
level LO
Course-level LO #4
Learning Outcomes12
Course-level LO #2
Course-level LO #3Course-level
learning outcome (LO) #1
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LOTopic-level
LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-level
learning outcome
Topic-level
LO
Topic-level
LO
Topic-
level LO
Course-level LO #4
Learning Outcomes13
Course-level LO #2
Course-level LO #3Course-level
learning outcome (LO) #1
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LOTopic-level
LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO Topic-
level LO
Topic-
level LO
Topic-level
LO
Topic-level
learning outcome
Topic-level
LO
Topic-level
LO
Topic-
level LO
Course-level LO #4
Learning Outcomes14
Course-level LO #2
Course-level LO #3Course-level
learning outcome (LO) #1
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LOTopic-level
LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO Topic-
level LO
Topic-
level LO
Topic-level
LO
Topic-level
learning outcome
Topic-level
LO
Topic-level
LO
Topic-
level LO
Course-level LO #4
Learning Outcomes15
Course-level LO #2
Course-level LO #3Course-level
learning outcome (LO) #1
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LO
Topic-level
LOTopic-level
LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO
Topic-
level LO Topic-
level LO
Topic-
level LO
Topic-level
LO
Topic-level
learning outcome
sync your LOs see ASTR 310 handout
Writing topic-level LOs
Learning Outcomes16
Writing learning outcomes is hard because you have to
 recognize
 declare
 (admit)
what you want your students to be capable of doing.
A good start is picking the verb describing the
action the students will perform to demonstrate their
mastery of the concept.
Bloom’s Taxonomy [2,3]
Learning Outcomes17
transform or combine ideas to create
something new
think critically about and
defend a position
break down concepts into parts
apply comprehension to unfamiliar
situations
demonstrate understanding of ideas
and concepts
remember and recall factual
information
6 Create
5 Evaluate
4 Analyze
3 Apply
2 Understand
1 Remember
Bloom’s Taxonomy [2,3]
Learning Outcomes18
higher order thinking
lower order thinking
6 Create
5 Evaluate
4 Analyze
3 Apply
2 Understand
1 Remember
Bloom’s Taxonomy Verbs
Learning Outcomes19
develop, create, propose, formulate,
design, invent
judge, appraise, recommend, justify,
defend, criticize, evaluate
compare, contrast, categorize,
distinguish, identify, infer
apply, demonstrate, use, compute,
solve, predict, construct, modify
describe, explain, summarize, interpret,
illustrate
define, list, state, label, name, describe
6 Create
5 Evaluate
4 Analyze
3 Apply
2 Understand
1 Remember
Adapted from CarlWieman (2007)
www.cwsei.ubc.ca/resources/learn_goals.htm
1. Draft LOs from course outline
Learning Outcomes20
Work through the list of topics. For each topic, decide
 What do I want students to be able to do, to
demonstrate they “get” this topic?
 Don’t worry about drafting too many low-level LOs.
When you revise, you’ll start grouping them into
higher-level LOs.
2. “Back-engineer” LOs from exams
Learning Outcomes21
Use last year’s (or several years’) final exam. For each good
question, ask yourself
 What is this question assessing?What is the learning
outcome I want students to demonstrate to properly
answer this question?
 Is that the outcome I want? Is it too low? Too high?
When you have a list of LOs,
 Does it cover everything I want for this course?
 Have I over- or under-represented any concepts?
Driver’s Ed 101:
How to Drive in California
Learning Outcomes22
Task:Write a learning outcome
that your group’s question assesses.
(refer toWieman handout
for Bloom’sTaxonomy verbs)
Learning Outcomes23
Sample Class CWrittenTest 5
California Department of MotorVehicles
http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
Learning Outcomes24
Sample Class CWrittenTest 5
California Department of MotorVehicles
http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
Learning Outcomes25
Sample Class CWrittenTest 5
California Department of MotorVehicles
http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
Learning Outcomes26
Sample Class CWrittenTest 5
California Department of MotorVehicles
http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
Share your LOs with your students
Learning Outcomes27
 (good) Publish your LOs as part of your syllabus.
 (better) Publish them in your syllabus AND include relevant
learning goals in your lecture slides at the beginning of each
topic, even each class.
 Be wary of reading them aloud: your students may not yet
have the knowledge (or jargon) to appreciate the LOs.
The LOs will be there when they study.
 Don’t worry about “spoon-feeding” them – help the
students do exactly what you feel demonstrates
understanding
What is the Value of Course-Specific
Learning Outcomes?
Learning Outcomes28
Simon &Taylor [1] asked students to complete this
sentence:
For me,the use of learning goals in this course is…
They received 597 responses from students in computer
science and microbiology. Responses were put into
categories that emerged from the responses.
Learning Outcomes29
Simon &Taylor (2009)
Scholarly approach to teaching:
Learning Outcomes30
CarlWieman
Science Education Initiative
cwsei.ubc.ca
What should
students
learn?
learning
outcomes
(goals, objectives)
assessment
active learning,
peer instruction
What should
students
learn?
What are
students
learning?
What instructional
approaches
help students
learn?
References
Learning Outcomes31
1. Simon, B., &Taylor, J. (2009).What is theValue of Course-Specific Learning Goals? Journal of
College ScienceTeaching, 39, 2, 52-57. PDF available at
www.cwsei.ubc.ca/SEI_research/files/LifeSci/Simon_Taylor_ValueOfCourseSpecificLG.pdf
2. Bloom B. S. (1956). Taxonomy of Educational Objectives,Handbook I:The Cognitive Domain. NewYork:
David McKay Co Inc.
Adapted from Anderson, L.W., & Krathwohl, D. R. (2001).ATaxonomy for Learning. Teaching,
and assessing:A revision of bloom's taxonomy of educational objectives.
Revised Bloom’sTaxonomy www.celt.iastate.edu/teaching/RevisedBlooms1.html
3. Excerpt fromWieman, C. (2007). Slides from theWieman Learning GoalsWorkshop.
www.cwsei.ubc.ca/resources/learn_goals.htm
4. California DMV Sample Class CWrittenTest 5
www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
6 Create: transform and combine ideas to create something new
develop,create,propose,formulate,design,invent
5 Evaluate: think critically about and defend a position
judge,appraise,recommend,justify,defend,criticize,evaluate
4 Analyze:: break down concepts into parts
compare,contrast,categorize,distinguish,identify,infer
3 Apply: apply comprehension to unfamiliar situations
apply,demonstrate,use,compute,solve,predict,construct,modify
2 Understand: demonstrate understanding of ideas, concepts
describe,explain,summarize,interpret,illustrate
1 Remember: remember and recall factual knowledge
define,list,state,label,name,describe
Bloom’s Taxonomy of the Cognitive Domain
(Levels of Learning)
Learning Outcomes Adapted from CarlWieman (2007)
www.cwsei.ubc.ca/resources/learn_goals.htm
32

More Related Content

PDF
CTD Fa14 Weekly Workshop: Learning outcomes
PDF
Learning Outcomes: Blueprints for Teaching and Learning
PDF
SIO Workshop: Course Design 1 - Learning outcomes
PDF
The College Classroom Fa15 Meeting 3: Learning Outcomes
PDF
CTD Sp14 Weekly Workshop: Learning Outcomes
PDF
CTD Wi14 Weekly Workshop: Learning Outcomes
PDF
Learning Outcomes
PDF
How (you can help) People Learn
CTD Fa14 Weekly Workshop: Learning outcomes
Learning Outcomes: Blueprints for Teaching and Learning
SIO Workshop: Course Design 1 - Learning outcomes
The College Classroom Fa15 Meeting 3: Learning Outcomes
CTD Sp14 Weekly Workshop: Learning Outcomes
CTD Wi14 Weekly Workshop: Learning Outcomes
Learning Outcomes
How (you can help) People Learn

What's hot (20)

PDF
The College Classroom Wi16 Meeting 3: Learning Outcomes
PDF
The College Classroom Wi16 Meeting 4: Fixed and Growth Mindset, and Assessmen...
PPTX
Identfying test objecctives (Assessment and Evaluation)
PDF
CIRTL Spring 2016 College Classroom Meeting 9: Transparency
PDF
Assessment to the Core Webinar by Jay McTighe
PDF
SIO Workshop: Course Design 2 - Alternatives to Lecture
PDF
SIO Workshop: Course Design 3 - Assessment that supports learning
PPT
Writing Effective Learning Outcomes
PPT
Learning outcomes
PDF
The College Classroom Wi16 Meeting 9: Writing Your Teaching Statement
DOC
Objective led lessons_progression_table
PPT
Writing Effective Learning Outcomes
PPT
Learning Intentions Tk
PPT
How to make classroom effective By Sajjad Ahmad Awan PhD Research Scholar TE...
PPT
Instructional strategies
PDF
Designs 2010 Session 2 Secondary
PPTX
Instructional objectives
PPTX
Tiip presentation 1
PPT
Assessment of Learning 1
DOC
Designing and developing content part 3
The College Classroom Wi16 Meeting 3: Learning Outcomes
The College Classroom Wi16 Meeting 4: Fixed and Growth Mindset, and Assessmen...
Identfying test objecctives (Assessment and Evaluation)
CIRTL Spring 2016 College Classroom Meeting 9: Transparency
Assessment to the Core Webinar by Jay McTighe
SIO Workshop: Course Design 2 - Alternatives to Lecture
SIO Workshop: Course Design 3 - Assessment that supports learning
Writing Effective Learning Outcomes
Learning outcomes
The College Classroom Wi16 Meeting 9: Writing Your Teaching Statement
Objective led lessons_progression_table
Writing Effective Learning Outcomes
Learning Intentions Tk
How to make classroom effective By Sajjad Ahmad Awan PhD Research Scholar TE...
Instructional strategies
Designs 2010 Session 2 Secondary
Instructional objectives
Tiip presentation 1
Assessment of Learning 1
Designing and developing content part 3
Ad

Similar to CTD Spring 2015 Weekly Workshop: Learning outcomes (20)

PDF
TMPH Fa14 Week 3: Learning Outcomes
PDF
CIRTL Spring 2016 The College Classroom Meeting 3: Learning Outcomes
PDF
The College Classroom (Wi15) Session 3: Learning Outcomes
PDF
CTD Weekly Workshops: Learning Outcomes
PDF
The College Classroom (Fa14) Week 3: Learning Outcomes
PDF
2015 SGTS Preparing to Teach 2: Learning Outcomes
PDF
The College Classroom Week 4: Learning Outcomes
PDF
SGTS Practical 3 - Learning Outcomes
PDF
CIRTL Class Meeting 9: Teaching as research
PPTX
Teaching statement workshop science_bridge
PPTX
Clarity in the curriculum: Using Constructive Alignment to improve your module
PPT
Course design
PPT
Ubd Edi Soh Presentation
PDF
The College Classroom (Wi14) Week 4: Learning outcomes
PPT
Learning Objectives
PDF
The College Classroom Fa15 Meeting 7: Teaching-as-Research
PDF
CTD Fa14 Weekly Workshop: Assessment that supports learning
PPTX
696_Ch#_3.pptx Models for effective science Teaching
PPTX
Teaching statement workshop
PPTX
SPS Inquiry Learning PD Session 1 2015
TMPH Fa14 Week 3: Learning Outcomes
CIRTL Spring 2016 The College Classroom Meeting 3: Learning Outcomes
The College Classroom (Wi15) Session 3: Learning Outcomes
CTD Weekly Workshops: Learning Outcomes
The College Classroom (Fa14) Week 3: Learning Outcomes
2015 SGTS Preparing to Teach 2: Learning Outcomes
The College Classroom Week 4: Learning Outcomes
SGTS Practical 3 - Learning Outcomes
CIRTL Class Meeting 9: Teaching as research
Teaching statement workshop science_bridge
Clarity in the curriculum: Using Constructive Alignment to improve your module
Course design
Ubd Edi Soh Presentation
The College Classroom (Wi14) Week 4: Learning outcomes
Learning Objectives
The College Classroom Fa15 Meeting 7: Teaching-as-Research
CTD Fa14 Weekly Workshop: Assessment that supports learning
696_Ch#_3.pptx Models for effective science Teaching
Teaching statement workshop
SPS Inquiry Learning PD Session 1 2015
Ad

More from Peter Newbury (20)

PDF
The right tool for the job
PDF
Getting to Know You
PDF
Preparing to Teach 5: What do YOU want to learn this Summer?
PDF
Preparing to Teach 3: Active Learning Strategies
PDF
Preparing to Teach 2: Learing Outcomes and Assessment
PDF
Preparing to Teach 1: A Student-facing Syllabus
PDF
CIRTL Spring 2016 The College Classroom Meeting 10 - The First Day of Class
PDF
The College Classroom Wi16 Meeting 10: The First Day of Class
PDF
CIRTL Spring 2016 The College Classroom Meeting 8 - Teaching-as-Research
PDF
CIRTL Spring 2016 The College Classroom Meeting 7 - They're not dumb, they're...
PDF
CIRTL Spring 2016 The College Classroom Meeting 6 - Peer Instruction
PDF
The College Classroom Wi16 Meeting 8: Teaching as Research
PDF
The College Classroom Wi16 Meeting 7: They're not dumb, they're different
PDF
CIRTL Spring 2016 The College Classroom Meeting 5 - Active Learning
PDF
CIRTL Spring 2016 The College Classroom Meeting 4 - Fixed and Growth Mindset ...
PDF
The College Classroom Wi16: Sample Peer Instruction Questions
PDF
The College Classroom Wi16 Meeting 6: Peer Instruction
PDF
CIRTL Spring 2016 The College Classroom Meeting 2 - Developing Expertise
PDF
The College Classroom Wi16 Meeting 5: Active Learning
PDF
CIRTL Spring 2016 The College Classroom Meeting 1 - How People Learn
The right tool for the job
Getting to Know You
Preparing to Teach 5: What do YOU want to learn this Summer?
Preparing to Teach 3: Active Learning Strategies
Preparing to Teach 2: Learing Outcomes and Assessment
Preparing to Teach 1: A Student-facing Syllabus
CIRTL Spring 2016 The College Classroom Meeting 10 - The First Day of Class
The College Classroom Wi16 Meeting 10: The First Day of Class
CIRTL Spring 2016 The College Classroom Meeting 8 - Teaching-as-Research
CIRTL Spring 2016 The College Classroom Meeting 7 - They're not dumb, they're...
CIRTL Spring 2016 The College Classroom Meeting 6 - Peer Instruction
The College Classroom Wi16 Meeting 8: Teaching as Research
The College Classroom Wi16 Meeting 7: They're not dumb, they're different
CIRTL Spring 2016 The College Classroom Meeting 5 - Active Learning
CIRTL Spring 2016 The College Classroom Meeting 4 - Fixed and Growth Mindset ...
The College Classroom Wi16: Sample Peer Instruction Questions
The College Classroom Wi16 Meeting 6: Peer Instruction
CIRTL Spring 2016 The College Classroom Meeting 2 - Developing Expertise
The College Classroom Wi16 Meeting 5: Active Learning
CIRTL Spring 2016 The College Classroom Meeting 1 - How People Learn

Recently uploaded (20)

PDF
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PPTX
Computer Architecture Input Output Memory.pptx
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
Hazard Identification & Risk Assessment .pdf
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PDF
Empowerment Technology for Senior High School Guide
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PDF
Complications of Minimal Access-Surgery.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PPTX
History, Philosophy and sociology of education (1).pptx
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
AI-driven educational solutions for real-life interventions in the Philippine...
Computer Architecture Input Output Memory.pptx
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Hazard Identification & Risk Assessment .pdf
Environmental Education MCQ BD2EE - Share Source.pdf
Weekly quiz Compilation Jan -July 25.pdf
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Paper A Mock Exam 9_ Attempt review.pdf.
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
Empowerment Technology for Senior High School Guide
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
FORM 1 BIOLOGY MIND MAPS and their schemes
A powerpoint presentation on the Revised K-10 Science Shaping Paper
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
Complications of Minimal Access-Surgery.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
History, Philosophy and sociology of education (1).pptx

CTD Spring 2015 Weekly Workshop: Learning outcomes

  • 1. Learning Outcomes1 Flight Deck byWayanVolta on flickr CC Do you understand how to fly an airplane? Yes Okay, but let’s look at this checklist. [trust and verify] CTD Weekly Workshops: Learning Outcomes
  • 2. Peter Newbury, Ph.D. Center forTeaching Development, University of California, San Diego pnewbury@ucsd.edu @polarisdotca #ctducsd ctd.ucsd.edu CTD Weekly Workshops: Learning Outcomes Unless otherwise noted, content is licensed under a Creative CommonsAttribution-Non Commercial 3.0 License. resources: ctd.ucsd.edu/programs/weekly-workshops-spring-2015/ please sign in
  • 3. Scholarly approach to teaching: Learning Outcomes3 CarlWieman Science Education Initiative cwsei.ubc.ca What should students learn? learning outcomes (goals, objectives) assessment active learning, peer instruction What should students learn? What are students learning? What instructional approaches help students learn?
  • 5. Introductory “Astro 101” Traditional Course Syllabus Course with Learning Outcomes Learning Outcomes5 This course covers Chapters 1. Mercury 2. Venus … 8. Neptune 9. Asteroids and Comets 10. Formation of the Solar System  deduce from patterns in the properties of the planets, moons, asteroids and other bodies that the Solar System had single formation event.  provide notable examples of how comets influenced history, art and science
  • 6. Learning outcomes Learning Outcomes6  completes the sentence,“By this end of this lesson/unit/course, you will be able to…”  begins with an action verb (“deduce”) (more below)  tells the students what they must do to demonstrate they “understand” the concept
  • 7. Learning outcomes are valuable to… Learning Outcomes7  the instructor o crystallizes what the instructor cares about o helps the instructor select instructional strategies and activities, write the final exam
  • 8. “select instructional activities…” Learning Outcomes8 ClassAction http://astro.unl.edu/classaction/ Does this peer instruction question support the learning outcomes? don’t use it use it yesno
  • 9. “write the final exam…” Learning Outcomes9 (10 marks) List 3 patterns of the Solar System as a whole.Then, outline in some detail the current model for the formation of the Solar System. In particular, make sure you explain how the observed patterns and regularities are related to this theory of formation. teaching to the test? Yes!
  • 10. Learning outcomes are valuable to… Learning Outcomes10  the students o reveal what the instructor is looking for: no more guessing what “understand” means or what will be on the exam o big picture of the next part of the course o allow student to check that s/he has mastered the concept (especially when studying later)
  • 11. A course should have Course-level LOs Topic-level LOs Learning Outcomes  several LOs giving big picture, attitudes, behaviors  (likely) can’t be assessed with a single exam question  supported by many topic-level LOs  many LOs defining what it means to “understand” at this level (freshman,…)  can be (should be) repeatedly assessed on homework, exams  support one or more course-level LOs 11
  • 12. Topic-level LO Topic-level LO Topic- level LO Course-level LO #4 Learning Outcomes12 Course-level LO #2 Course-level LO #3Course-level learning outcome (LO) #1 Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LOTopic-level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic-level learning outcome
  • 13. Topic-level LO Topic-level LO Topic- level LO Course-level LO #4 Learning Outcomes13 Course-level LO #2 Course-level LO #3Course-level learning outcome (LO) #1 Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LOTopic-level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic-level LO Topic-level learning outcome
  • 14. Topic-level LO Topic-level LO Topic- level LO Course-level LO #4 Learning Outcomes14 Course-level LO #2 Course-level LO #3Course-level learning outcome (LO) #1 Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LOTopic-level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic-level LO Topic-level learning outcome
  • 15. Topic-level LO Topic-level LO Topic- level LO Course-level LO #4 Learning Outcomes15 Course-level LO #2 Course-level LO #3Course-level learning outcome (LO) #1 Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LO Topic-level LOTopic-level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic- level LO Topic-level LO Topic-level learning outcome sync your LOs see ASTR 310 handout
  • 16. Writing topic-level LOs Learning Outcomes16 Writing learning outcomes is hard because you have to  recognize  declare  (admit) what you want your students to be capable of doing. A good start is picking the verb describing the action the students will perform to demonstrate their mastery of the concept.
  • 17. Bloom’s Taxonomy [2,3] Learning Outcomes17 transform or combine ideas to create something new think critically about and defend a position break down concepts into parts apply comprehension to unfamiliar situations demonstrate understanding of ideas and concepts remember and recall factual information 6 Create 5 Evaluate 4 Analyze 3 Apply 2 Understand 1 Remember
  • 18. Bloom’s Taxonomy [2,3] Learning Outcomes18 higher order thinking lower order thinking 6 Create 5 Evaluate 4 Analyze 3 Apply 2 Understand 1 Remember
  • 19. Bloom’s Taxonomy Verbs Learning Outcomes19 develop, create, propose, formulate, design, invent judge, appraise, recommend, justify, defend, criticize, evaluate compare, contrast, categorize, distinguish, identify, infer apply, demonstrate, use, compute, solve, predict, construct, modify describe, explain, summarize, interpret, illustrate define, list, state, label, name, describe 6 Create 5 Evaluate 4 Analyze 3 Apply 2 Understand 1 Remember Adapted from CarlWieman (2007) www.cwsei.ubc.ca/resources/learn_goals.htm
  • 20. 1. Draft LOs from course outline Learning Outcomes20 Work through the list of topics. For each topic, decide  What do I want students to be able to do, to demonstrate they “get” this topic?  Don’t worry about drafting too many low-level LOs. When you revise, you’ll start grouping them into higher-level LOs.
  • 21. 2. “Back-engineer” LOs from exams Learning Outcomes21 Use last year’s (or several years’) final exam. For each good question, ask yourself  What is this question assessing?What is the learning outcome I want students to demonstrate to properly answer this question?  Is that the outcome I want? Is it too low? Too high? When you have a list of LOs,  Does it cover everything I want for this course?  Have I over- or under-represented any concepts?
  • 22. Driver’s Ed 101: How to Drive in California Learning Outcomes22 Task:Write a learning outcome that your group’s question assesses. (refer toWieman handout for Bloom’sTaxonomy verbs)
  • 23. Learning Outcomes23 Sample Class CWrittenTest 5 California Department of MotorVehicles http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
  • 24. Learning Outcomes24 Sample Class CWrittenTest 5 California Department of MotorVehicles http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
  • 25. Learning Outcomes25 Sample Class CWrittenTest 5 California Department of MotorVehicles http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
  • 26. Learning Outcomes26 Sample Class CWrittenTest 5 California Department of MotorVehicles http://www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
  • 27. Share your LOs with your students Learning Outcomes27  (good) Publish your LOs as part of your syllabus.  (better) Publish them in your syllabus AND include relevant learning goals in your lecture slides at the beginning of each topic, even each class.  Be wary of reading them aloud: your students may not yet have the knowledge (or jargon) to appreciate the LOs. The LOs will be there when they study.  Don’t worry about “spoon-feeding” them – help the students do exactly what you feel demonstrates understanding
  • 28. What is the Value of Course-Specific Learning Outcomes? Learning Outcomes28 Simon &Taylor [1] asked students to complete this sentence: For me,the use of learning goals in this course is… They received 597 responses from students in computer science and microbiology. Responses were put into categories that emerged from the responses.
  • 30. Scholarly approach to teaching: Learning Outcomes30 CarlWieman Science Education Initiative cwsei.ubc.ca What should students learn? learning outcomes (goals, objectives) assessment active learning, peer instruction What should students learn? What are students learning? What instructional approaches help students learn?
  • 31. References Learning Outcomes31 1. Simon, B., &Taylor, J. (2009).What is theValue of Course-Specific Learning Goals? Journal of College ScienceTeaching, 39, 2, 52-57. PDF available at www.cwsei.ubc.ca/SEI_research/files/LifeSci/Simon_Taylor_ValueOfCourseSpecificLG.pdf 2. Bloom B. S. (1956). Taxonomy of Educational Objectives,Handbook I:The Cognitive Domain. NewYork: David McKay Co Inc. Adapted from Anderson, L.W., & Krathwohl, D. R. (2001).ATaxonomy for Learning. Teaching, and assessing:A revision of bloom's taxonomy of educational objectives. Revised Bloom’sTaxonomy www.celt.iastate.edu/teaching/RevisedBlooms1.html 3. Excerpt fromWieman, C. (2007). Slides from theWieman Learning GoalsWorkshop. www.cwsei.ubc.ca/resources/learn_goals.htm 4. California DMV Sample Class CWrittenTest 5 www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
  • 32. 6 Create: transform and combine ideas to create something new develop,create,propose,formulate,design,invent 5 Evaluate: think critically about and defend a position judge,appraise,recommend,justify,defend,criticize,evaluate 4 Analyze:: break down concepts into parts compare,contrast,categorize,distinguish,identify,infer 3 Apply: apply comprehension to unfamiliar situations apply,demonstrate,use,compute,solve,predict,construct,modify 2 Understand: demonstrate understanding of ideas, concepts describe,explain,summarize,interpret,illustrate 1 Remember: remember and recall factual knowledge define,list,state,label,name,describe Bloom’s Taxonomy of the Cognitive Domain (Levels of Learning) Learning Outcomes Adapted from CarlWieman (2007) www.cwsei.ubc.ca/resources/learn_goals.htm 32