SlideShare a Scribd company logo
Comparing Feedback Mechanisms in
Sapling Learning & Mastering Chemistry.
Question:
Given a pressure and initial and final volumes, use w = -PΔV to
calculate the work done by/on a system. Convert units from
L.atm to J or kJ.
The calculation is simple, but students learning to work this
problem might make several mistakes:
1. A failure to identify and convert units
2. A mistake with the sign of the calculation.
3. A mistake in significant figures
How do the two homework systems compare in feedback and
format? Which is easier to use?
Avoid the straw man argument.
Any company can compare an excellent question from
their system with a weaker question from another.
Professors should consider working several comparable
problems for themselves, to really evaluate which
system is easier to use.
A Question in Sapling Learning
1. A screenshot of the question.
Sapling Learning
1. Student correctly calculates
PΔV in Lˑatm, but does not
convert to kJ. Feedback
appears within the window.
2. Let’s Try Again.
Sapling Learning
3. Student converts from Lˑatmto
Joules, but fails to convert to kJ.
Sapling Learning
4. Feedback prompts student to go
to kJ.
Sapling Learning
5. Student converts to kJ, but gets sign
backward. Again, feedback appears.
Sapling Learning
5. Student gets answer correct.
A similar question in
Mastering Chemistry
1. A screenshot of the question.
A screenshot of the question –
cropped for better visibility.
(Remainder of question:
“…from a volume of 0.130 liters to 0.500 liters.”)
Mastering Chemistry
2. The student first uses w = -PΔV,
and correctly reaches an answer in
units of L.atm . This information is
entered.
Mastering Chemistry
3. Student receives “Incorrect” Feedback,
and message about units. Which units are
needed?
Mastering Chemistry
1. Not sure which units to use, the
student looks under “Hints” tab.
Mastering Chemistry
4. “Hints” tab is a pop-up window.
5. Student clicks “Hint 1”
6. After clicking Hint 1, the
following feedback pops up. The
student just lost points, but still is
not sure what units to use.
Mastering Chemistry
7. The student closes the hints
window, and looks for more
information in the “my answers”
tab.
Mastering Chemistry
8. A new window appears, giving a
list of answers given so far.
Mastering Chemistry
9. The student closes the My
Answers window, and moves to the
help menu to see about recognized
units.
10. The help menu.
11. Oh, here is the list of units.
12. Lets see…I need units for
energy and work
13. After clicking “Energy and
work”, the selection expands.
Liters.atm is not listed. Which unit
should I use?
Mastering Chemistry
14. Let’s look at the question one
more time…
15. Oh, maybe they want the
answer in Joules.
16. The student correctly converts from L.atm
to Joules.
17. The student remembers to include a minus
sign, since it was an expansion.
18. Student puts in answer…
19. Bizarrely, the help-menu pops back up as soon as
the student hits submit.
20. After closing the help menu, the student sees that
the question is counted correct, and difference in
significant figures is noted.
Conclusions
While systems may offer similar
features, Sapling’s extensive in-window
feedback provides a much less stressful, easy-to-
follow feedback mechanism.
Ultimately, students learn by working problems.
The less time students spend navigating help
menus and searching for information, the more
time they can spend working problems.

More Related Content

DOCX
Literal Equations Marzano Specific Rubric
PPTX
Moodle calculated simple quiz question
PDF
Kagiso - Analysis final version
PDF
How to add answer tolerance for a numerical answer
PPTX
Digital Portfolio in Algebra-X
PPTX
February 27, 2015
PPTX
Moodle calculated multichoice quiz question
DOCX
Making math magical
Literal Equations Marzano Specific Rubric
Moodle calculated simple quiz question
Kagiso - Analysis final version
How to add answer tolerance for a numerical answer
Digital Portfolio in Algebra-X
February 27, 2015
Moodle calculated multichoice quiz question
Making math magical

What's hot (10)

DOCX
Fa1 ma1.x introduction-to_financial_and_management_accounting_grading_policy
DOCX
Scientific method
PDF
HOW TO USE MACHINE LEARNING EFFECTIVELY
PPTX
math grade 8Summative ppt
PPTX
Moodle true/false quiz question
PPT
St Ai Rdesignbrogers
PPTX
Moodle calculated quiz question
PDF
คำนำ คำชี้แจงPresent simpleแก้ไข ปรับปรุง พย56
PPTX
Focused communication tasks and second language acquisition
PDF
Wowin - neet online mock test 2017
Fa1 ma1.x introduction-to_financial_and_management_accounting_grading_policy
Scientific method
HOW TO USE MACHINE LEARNING EFFECTIVELY
math grade 8Summative ppt
Moodle true/false quiz question
St Ai Rdesignbrogers
Moodle calculated quiz question
คำนำ คำชี้แจงPresent simpleแก้ไข ปรับปรุง พย56
Focused communication tasks and second language acquisition
Wowin - neet online mock test 2017
Ad

Similar to Mc vs sl comparison (20)

PDF
Senior General Chemistry 1 _Q1_Module 9 for printing.pdf
PPTX
11EHS Term 3 Week 1 Unit 1 Review: Feedback and improvementpptx
PDF
Math 7_Week 3_AbsoluteValue,Operations on Integers_Calumpit NHS.pdf
PPTX
INSET G4Math
PDF
M11GM-Q1Module7.pdf
PDF
M11GM-Q1Module7.pdf
PPT
Merrill
PDF
M9L2 EOC Practice Student Handout
PPTX
Feb. 24, 2014
PDF
MATH 7_WEEK 2_Sets-Problem-and-Venn-Diagram_AGSNHS.pdf
DOCX
Acc phy sci trhs syllabus template
DOCX
NAMEMATH125 Unit 6 Submission Assignment Answer Form1. A.docx
PPTX
Topic 8b Item Analysis
DOCX
ID Unit Report 3
PDF
GenMath11_Q1_Mod2_KDoctolero.pdf
PDF
M11GM-Q1Module1.pdf
PDF
M11GM-Q1Module1.pdf
PDF
COOKERY 7 Module 5.pdf
DOCX
S aleh logic gates --
PDF
M11GM-Q1Module3.pdf
Senior General Chemistry 1 _Q1_Module 9 for printing.pdf
11EHS Term 3 Week 1 Unit 1 Review: Feedback and improvementpptx
Math 7_Week 3_AbsoluteValue,Operations on Integers_Calumpit NHS.pdf
INSET G4Math
M11GM-Q1Module7.pdf
M11GM-Q1Module7.pdf
Merrill
M9L2 EOC Practice Student Handout
Feb. 24, 2014
MATH 7_WEEK 2_Sets-Problem-and-Venn-Diagram_AGSNHS.pdf
Acc phy sci trhs syllabus template
NAMEMATH125 Unit 6 Submission Assignment Answer Form1. A.docx
Topic 8b Item Analysis
ID Unit Report 3
GenMath11_Q1_Mod2_KDoctolero.pdf
M11GM-Q1Module1.pdf
M11GM-Q1Module1.pdf
COOKERY 7 Module 5.pdf
S aleh logic gates --
M11GM-Q1Module3.pdf
Ad

Recently uploaded (20)

PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
MYSQL Presentation for SQL database connectivity
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Empathic Computing: Creating Shared Understanding
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
cuic standard and advanced reporting.pdf
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Spectroscopy.pptx food analysis technology
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPTX
A Presentation on Artificial Intelligence
PPTX
Programs and apps: productivity, graphics, security and other tools
Per capita expenditure prediction using model stacking based on satellite ima...
Chapter 3 Spatial Domain Image Processing.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
MYSQL Presentation for SQL database connectivity
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Reach Out and Touch Someone: Haptics and Empathic Computing
Empathic Computing: Creating Shared Understanding
Diabetes mellitus diagnosis method based random forest with bat algorithm
cuic standard and advanced reporting.pdf
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Spectral efficient network and resource selection model in 5G networks
Dropbox Q2 2025 Financial Results & Investor Presentation
Machine learning based COVID-19 study performance prediction
Spectroscopy.pptx food analysis technology
Encapsulation_ Review paper, used for researhc scholars
sap open course for s4hana steps from ECC to s4
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
A Presentation on Artificial Intelligence
Programs and apps: productivity, graphics, security and other tools

Mc vs sl comparison

  • 1. Comparing Feedback Mechanisms in Sapling Learning & Mastering Chemistry. Question: Given a pressure and initial and final volumes, use w = -PΔV to calculate the work done by/on a system. Convert units from L.atm to J or kJ. The calculation is simple, but students learning to work this problem might make several mistakes: 1. A failure to identify and convert units 2. A mistake with the sign of the calculation. 3. A mistake in significant figures How do the two homework systems compare in feedback and format? Which is easier to use?
  • 2. Avoid the straw man argument. Any company can compare an excellent question from their system with a weaker question from another. Professors should consider working several comparable problems for themselves, to really evaluate which system is easier to use.
  • 3. A Question in Sapling Learning 1. A screenshot of the question.
  • 4. Sapling Learning 1. Student correctly calculates PΔV in Lˑatm, but does not convert to kJ. Feedback appears within the window. 2. Let’s Try Again.
  • 5. Sapling Learning 3. Student converts from Lˑatmto Joules, but fails to convert to kJ.
  • 6. Sapling Learning 4. Feedback prompts student to go to kJ.
  • 7. Sapling Learning 5. Student converts to kJ, but gets sign backward. Again, feedback appears.
  • 8. Sapling Learning 5. Student gets answer correct.
  • 9. A similar question in Mastering Chemistry 1. A screenshot of the question.
  • 10. A screenshot of the question – cropped for better visibility. (Remainder of question: “…from a volume of 0.130 liters to 0.500 liters.”)
  • 11. Mastering Chemistry 2. The student first uses w = -PΔV, and correctly reaches an answer in units of L.atm . This information is entered.
  • 12. Mastering Chemistry 3. Student receives “Incorrect” Feedback, and message about units. Which units are needed?
  • 13. Mastering Chemistry 1. Not sure which units to use, the student looks under “Hints” tab.
  • 14. Mastering Chemistry 4. “Hints” tab is a pop-up window. 5. Student clicks “Hint 1”
  • 15. 6. After clicking Hint 1, the following feedback pops up. The student just lost points, but still is not sure what units to use.
  • 16. Mastering Chemistry 7. The student closes the hints window, and looks for more information in the “my answers” tab.
  • 17. Mastering Chemistry 8. A new window appears, giving a list of answers given so far.
  • 18. Mastering Chemistry 9. The student closes the My Answers window, and moves to the help menu to see about recognized units.
  • 19. 10. The help menu. 11. Oh, here is the list of units.
  • 20. 12. Lets see…I need units for energy and work
  • 21. 13. After clicking “Energy and work”, the selection expands. Liters.atm is not listed. Which unit should I use?
  • 22. Mastering Chemistry 14. Let’s look at the question one more time… 15. Oh, maybe they want the answer in Joules.
  • 23. 16. The student correctly converts from L.atm to Joules. 17. The student remembers to include a minus sign, since it was an expansion. 18. Student puts in answer…
  • 24. 19. Bizarrely, the help-menu pops back up as soon as the student hits submit. 20. After closing the help menu, the student sees that the question is counted correct, and difference in significant figures is noted.
  • 25. Conclusions While systems may offer similar features, Sapling’s extensive in-window feedback provides a much less stressful, easy-to- follow feedback mechanism. Ultimately, students learn by working problems. The less time students spend navigating help menus and searching for information, the more time they can spend working problems.