Eliminating Misinformation and Doubt in Learning And Creating the Process of Discovery To Achieve Mastery Tim Adams  Chief Learning Officer & Co-Founder Brian Webster VP Client Solutions
Training Disconnect People are being trained but their performance doesn’t always reflect it.
Disconnect  Food Manufacturer Implementing all the best practices and training Bringing uniform metrics to a $1B+ operation built through acquisitions Elated with business performance improvements - 70% efficiency! The cost of 30% inefficiency - $150M
Disconnect  Healthcare Organizations Number of preventable deaths 2003-2005 – 247,662 1 1% of patients are injured in the hospital and 25% of these injuries result in death 2 Medication errors harm 1.5M people each year 3 Malpractice payments in 2004: $4.2B 4 Preventable medication errors cost hospitals $3.5B per year 5 1  HealthGrades, 2007;  2  Harvard medical study, 2006;  3  Nat’l Academy of Science, 2006;  4  Public Citizen, 2005;  5  Institute of Medicine, 2006
Why the disconnect? Activity #1
The Impact of Guessing People given credit for knowledge they don’t have People given job responsibilities they are not prepared to handle Management has false sense of security Hidden liabilities in organization Management doesn’t know that on-the-job mistakes are a product of the training regimen
“ Invisible errors ” in the workplace resulting from guessing correctly on true/false and multiple choice tests are  “ common and potentially damaging .” Human Resource Guide   Department of Labor study
Why the disconnect? Activity #2
Format Makes a Difference Certain types of questions are prone to guesswork T/F, Yes/No – 50/50 chance of getting right, but not a measure of knowledge Content is not always aligned with outcomes Content and assessment are not always aligned with each other
Why the disconnect? Activity #3
The Value of a Second Dimension More accurate predictor of behavior Focuses on knowledge quality  Isolates knowledge states that can lead to mistakes Provides moments of discovery  Installs a new set of rules – focusing on knowledge outcomes and not test scores! Confidence is the missing element in the learning process
The Problem: Learning Effectiveness A score only tells you how many questions  someone answered correctly.  75% 100% 0%
The Problem: Learning Outcomes 100% 0% A score can’t detect guessing or doubt. This may be what they really know. 55% 75%
“ The 55/15 Rule ” The average level of confidence and correctness for employees across all industries is  55% 15%  of the knowledge employees have is actually  confidently-held misinformation
Knowledge Profile   A Better Indicator of Potential Performance Knowledge Learning Behavior Model tm Confidence Action No Action
What companies need is… MASTERY Confidently-held, correct knowledge  put into practice How do you get there?
Demonstration
Case Study Results Healthcare Organization Adverse outcomes Minimized with CBL   Positive outcomes Maximized with CBL   Misinformation extraordinarily high among seasoned employees
Seminar Results on   Fair Labor Standards Act  Example of risk of  not  knowing Question :  A worker in a science laboratory supervises and manages a department with 10 other full-time employees. She makes all the decisions about whether to hire, to fire or to promote employees within her department, but she is not senior enough to make big decisions about the direction of the company. What must the company consider when determining if the employees is an exempt executive? 100  attendees in a conference 65%  were misinformed Fine for not following this statute:  $10,000 Potential fines among attendees:  $650,000
Tracking the Path to Mastery …  to eliminate potential errors resulting  from misinformation CBL identifies knowledge  quality of individuals …
Reporting Analytics GROUP PERFORMANCE Item analysis by  question   allows an organization… … to identify liabilities  before  they impact business objectives.
Confidence-Based Measurement   Surgically isolates misinformation
Confidence-Based Learning Design Metadata –  Module Topic Rich media Question Answers Correct answer Incorrect answer 1 Incorrect answer 2 Explanation Further training links Intro Text: Link Text: Link URL: <Further Training Links> <Explanation> <Incorrect Answer 2> <Incorrect Answer 1> <Correct Answer> <Question Text> <Rich Media File> <Question Number> <Topic> <Module>up
Evaluation tools Test items, assessments, certifications questions, correct answers, incorrect answers Learning Objective Training Content Test Databank Mapping Existing Training Start with…
Supporting content Case studies Further info – websites, PDFs, video, flash, etc. Learning Objective Training Content Test Databank Supporting Docs Mapping Existing Training Start with…
Mapping Existing Training Supporting Docs Testing Training Content Learning Objective Supporting Docs Test Databank Training Content Learning Objective Training Content Convert to CBL… Intro Text: Link Text: Link URL: <Further Training Links> <Explanation> <Incorrect Answer 2> <Incorrect Answer 1> <Correct Answer> <Question Text> <Rich Media File> <Question Number> <Topic> <Module>
Importance of confidence in measuring knowledge It is a predictor of behavior Provides cognitive moments of discovery Provides accurate picture of knowledge quality Provides the ability to correct errors  before Aligns learning with business outcomes
ADVANTAGES Confidence Based Learning is the next Learning imperative that: Proves acquisition of essential knowledge through an  informal learning process Increases retention of essential knowledge Improves the quality of the learning experience and  engages the learner to achieve mastery Enables training to focus on knowledge application and skills development Moves focus of Learning from a score to achieving  MASTERY !
SUMMARY   Moves focus of Learning from a score to achieving  MASTERY ! Learning and assessment are both done in the same context – creating  Contextually Relevant Learning  and the opportunity for discovery! Discovery process  creates cognitive linkage and greater retention of material. Engages learners in new ways Shifts the paradigm!
Questions & Discussion
THANK YOU! Tim Adams, CLO [email_address] Brian Webster, Vice President [email_address] www.Knowledge Factor.com 720-214-4874

More Related Content

PPTX
Job satisfaction among_private_sector_banks
PPTX
Performance Management and EAP
PPTX
Community and Organization Mental Health
PPT
Dr Patient Comms
DOC
Amber's_Resume
PPS
Barbati si femei
PPT
Las leñas
PPT
DiscriminacióN
Job satisfaction among_private_sector_banks
Performance Management and EAP
Community and Organization Mental Health
Dr Patient Comms
Amber's_Resume
Barbati si femei
Las leñas
DiscriminacióN

Similar to Kfi Innovation In Learning Presentation Sept 2007 (20)

PDF
Misinformation_amplifire_0416
PDF
Learning Metrics: Building Your Training Scorecard
PPTX
Getting Started With Evidence-Based HR
PPTX
Presentation Teaching Evidence-Based Management NYU Wagner 2014
PDF
BOOST EMPLOYEE PERFORMANCE WITH MICROLEARNING AND MANAGER TRAINING
PPTX
Chpater 12
PDF
Balance HR: Starting with Evidence-based Learning • Virtual Coffee
PDF
E-LEARNING IN THE AGE OF DISTRACTION: ADAPTABILITY, PRODUCTIVITY & MEASUREMENT
PDF
Emerging Challenges in Learning: Proving the Business Value
PDF
Micro-Video + Manager Training = High-Performing Employees
PDF
Learn to work. work to learn
PDF
HOW TO SOLVE THE 5 BIGGEST PROBLEMS IN WORKPLACE LEARNING
PDF
Discussion week 1
PPTX
Evidence-Based Decision Making for Hospital Administrators
PDF
Micro-Video + Manager Training = High Performing Employees | Webinar 10.14.15
PDF
How to Apply the Concepts of Neuroscience to Create a Thriving Learning Culture
ODP
Scientific Employee Training Program
ODP
Employee Training Program
ODP
Employee training program
PDF
Organizational Behavior Improving Performance and Commitment in the Workplace...
Misinformation_amplifire_0416
Learning Metrics: Building Your Training Scorecard
Getting Started With Evidence-Based HR
Presentation Teaching Evidence-Based Management NYU Wagner 2014
BOOST EMPLOYEE PERFORMANCE WITH MICROLEARNING AND MANAGER TRAINING
Chpater 12
Balance HR: Starting with Evidence-based Learning • Virtual Coffee
E-LEARNING IN THE AGE OF DISTRACTION: ADAPTABILITY, PRODUCTIVITY & MEASUREMENT
Emerging Challenges in Learning: Proving the Business Value
Micro-Video + Manager Training = High-Performing Employees
Learn to work. work to learn
HOW TO SOLVE THE 5 BIGGEST PROBLEMS IN WORKPLACE LEARNING
Discussion week 1
Evidence-Based Decision Making for Hospital Administrators
Micro-Video + Manager Training = High Performing Employees | Webinar 10.14.15
How to Apply the Concepts of Neuroscience to Create a Thriving Learning Culture
Scientific Employee Training Program
Employee Training Program
Employee training program
Organizational Behavior Improving Performance and Commitment in the Workplace...
Ad

More from iil07 (6)

PPT
Learning Design For Behavior Change Bh Slides
PPT
How To Write A Thesis 070918
PPT
Innovations In Learning The Other 50%
PDF
Serious Games Presentation Web
PDF
Energizing Knowledge Into Performance Oct Without Video
PPT
Producing Captivating Podcasts
Learning Design For Behavior Change Bh Slides
How To Write A Thesis 070918
Innovations In Learning The Other 50%
Serious Games Presentation Web
Energizing Knowledge Into Performance Oct Without Video
Producing Captivating Podcasts
Ad

Recently uploaded (20)

PDF
533158074-Saudi-Arabia-Companies-List-Contact.pdf
PPTX
interschool scomp.pptxzdkjhdjvdjvdjdhjhieij
PDF
Comments on Clouds that Assimilate Parts I&II.pdf
PDF
Sustainable Digital Finance in Asia_FINAL_22.pdf
PDF
Satish NS: Fostering Innovation and Sustainability: Haier India’s Customer-Ce...
PPTX
2 - Self & Personality 587689213yiuedhwejbmansbeakjrk
PPTX
IMM marketing mix of four ps give fjcb jjb
PPTX
IITM - FINAL Option - 01 - 12.08.25.pptx
PDF
Immigration Law and Communication: Challenges and Solutions {www.kiu.ac.ug)
DOCX
Handbook of entrepreneurship- Chapter 7- Types of business organisations
PDF
income tax laws notes important pakistan
PPTX
Market and Demand Analysis.pptx for Management students
PDF
Middle East's Most Impactful Business Leaders to Follow in 2025
PDF
#1 Safe and Secure Verified Cash App Accounts for Purchase.pdf
PPTX
Transportation in Logistics management.pptx
PPTX
Portfolio Example- Market & Consumer Insights – Strategic Entry for BYD UK.pptx
PPTX
TRAINNING, DEVELOPMENT AND APPRAISAL.pptx
PDF
Stacey L Stevens - Canada's Most Influential Women Lawyers Revolutionizing Th...
PDF
Value-based IP Management at Siemens: A Cross-Divisional Analysis
DOCX
Handbook of Entrepreneurship- Chapter 5: Identifying business opportunity.docx
533158074-Saudi-Arabia-Companies-List-Contact.pdf
interschool scomp.pptxzdkjhdjvdjvdjdhjhieij
Comments on Clouds that Assimilate Parts I&II.pdf
Sustainable Digital Finance in Asia_FINAL_22.pdf
Satish NS: Fostering Innovation and Sustainability: Haier India’s Customer-Ce...
2 - Self & Personality 587689213yiuedhwejbmansbeakjrk
IMM marketing mix of four ps give fjcb jjb
IITM - FINAL Option - 01 - 12.08.25.pptx
Immigration Law and Communication: Challenges and Solutions {www.kiu.ac.ug)
Handbook of entrepreneurship- Chapter 7- Types of business organisations
income tax laws notes important pakistan
Market and Demand Analysis.pptx for Management students
Middle East's Most Impactful Business Leaders to Follow in 2025
#1 Safe and Secure Verified Cash App Accounts for Purchase.pdf
Transportation in Logistics management.pptx
Portfolio Example- Market & Consumer Insights – Strategic Entry for BYD UK.pptx
TRAINNING, DEVELOPMENT AND APPRAISAL.pptx
Stacey L Stevens - Canada's Most Influential Women Lawyers Revolutionizing Th...
Value-based IP Management at Siemens: A Cross-Divisional Analysis
Handbook of Entrepreneurship- Chapter 5: Identifying business opportunity.docx

Kfi Innovation In Learning Presentation Sept 2007

  • 1. Eliminating Misinformation and Doubt in Learning And Creating the Process of Discovery To Achieve Mastery Tim Adams Chief Learning Officer & Co-Founder Brian Webster VP Client Solutions
  • 2. Training Disconnect People are being trained but their performance doesn’t always reflect it.
  • 3. Disconnect Food Manufacturer Implementing all the best practices and training Bringing uniform metrics to a $1B+ operation built through acquisitions Elated with business performance improvements - 70% efficiency! The cost of 30% inefficiency - $150M
  • 4. Disconnect Healthcare Organizations Number of preventable deaths 2003-2005 – 247,662 1 1% of patients are injured in the hospital and 25% of these injuries result in death 2 Medication errors harm 1.5M people each year 3 Malpractice payments in 2004: $4.2B 4 Preventable medication errors cost hospitals $3.5B per year 5 1 HealthGrades, 2007; 2 Harvard medical study, 2006; 3 Nat’l Academy of Science, 2006; 4 Public Citizen, 2005; 5 Institute of Medicine, 2006
  • 5. Why the disconnect? Activity #1
  • 6. The Impact of Guessing People given credit for knowledge they don’t have People given job responsibilities they are not prepared to handle Management has false sense of security Hidden liabilities in organization Management doesn’t know that on-the-job mistakes are a product of the training regimen
  • 7. “ Invisible errors ” in the workplace resulting from guessing correctly on true/false and multiple choice tests are “ common and potentially damaging .” Human Resource Guide Department of Labor study
  • 8. Why the disconnect? Activity #2
  • 9. Format Makes a Difference Certain types of questions are prone to guesswork T/F, Yes/No – 50/50 chance of getting right, but not a measure of knowledge Content is not always aligned with outcomes Content and assessment are not always aligned with each other
  • 10. Why the disconnect? Activity #3
  • 11. The Value of a Second Dimension More accurate predictor of behavior Focuses on knowledge quality Isolates knowledge states that can lead to mistakes Provides moments of discovery Installs a new set of rules – focusing on knowledge outcomes and not test scores! Confidence is the missing element in the learning process
  • 12. The Problem: Learning Effectiveness A score only tells you how many questions someone answered correctly. 75% 100% 0%
  • 13. The Problem: Learning Outcomes 100% 0% A score can’t detect guessing or doubt. This may be what they really know. 55% 75%
  • 14. “ The 55/15 Rule ” The average level of confidence and correctness for employees across all industries is 55% 15% of the knowledge employees have is actually confidently-held misinformation
  • 15. Knowledge Profile A Better Indicator of Potential Performance Knowledge Learning Behavior Model tm Confidence Action No Action
  • 16. What companies need is… MASTERY Confidently-held, correct knowledge put into practice How do you get there?
  • 18. Case Study Results Healthcare Organization Adverse outcomes Minimized with CBL Positive outcomes Maximized with CBL Misinformation extraordinarily high among seasoned employees
  • 19. Seminar Results on Fair Labor Standards Act Example of risk of not knowing Question : A worker in a science laboratory supervises and manages a department with 10 other full-time employees. She makes all the decisions about whether to hire, to fire or to promote employees within her department, but she is not senior enough to make big decisions about the direction of the company. What must the company consider when determining if the employees is an exempt executive? 100 attendees in a conference 65% were misinformed Fine for not following this statute: $10,000 Potential fines among attendees: $650,000
  • 20. Tracking the Path to Mastery … to eliminate potential errors resulting from misinformation CBL identifies knowledge quality of individuals …
  • 21. Reporting Analytics GROUP PERFORMANCE Item analysis by question allows an organization… … to identify liabilities before they impact business objectives.
  • 22. Confidence-Based Measurement Surgically isolates misinformation
  • 23. Confidence-Based Learning Design Metadata – Module Topic Rich media Question Answers Correct answer Incorrect answer 1 Incorrect answer 2 Explanation Further training links Intro Text: Link Text: Link URL: <Further Training Links> <Explanation> <Incorrect Answer 2> <Incorrect Answer 1> <Correct Answer> <Question Text> <Rich Media File> <Question Number> <Topic> <Module>up
  • 24. Evaluation tools Test items, assessments, certifications questions, correct answers, incorrect answers Learning Objective Training Content Test Databank Mapping Existing Training Start with…
  • 25. Supporting content Case studies Further info – websites, PDFs, video, flash, etc. Learning Objective Training Content Test Databank Supporting Docs Mapping Existing Training Start with…
  • 26. Mapping Existing Training Supporting Docs Testing Training Content Learning Objective Supporting Docs Test Databank Training Content Learning Objective Training Content Convert to CBL… Intro Text: Link Text: Link URL: <Further Training Links> <Explanation> <Incorrect Answer 2> <Incorrect Answer 1> <Correct Answer> <Question Text> <Rich Media File> <Question Number> <Topic> <Module>
  • 27. Importance of confidence in measuring knowledge It is a predictor of behavior Provides cognitive moments of discovery Provides accurate picture of knowledge quality Provides the ability to correct errors before Aligns learning with business outcomes
  • 28. ADVANTAGES Confidence Based Learning is the next Learning imperative that: Proves acquisition of essential knowledge through an informal learning process Increases retention of essential knowledge Improves the quality of the learning experience and engages the learner to achieve mastery Enables training to focus on knowledge application and skills development Moves focus of Learning from a score to achieving MASTERY !
  • 29. SUMMARY Moves focus of Learning from a score to achieving MASTERY ! Learning and assessment are both done in the same context – creating Contextually Relevant Learning and the opportunity for discovery! Discovery process creates cognitive linkage and greater retention of material. Engages learners in new ways Shifts the paradigm!
  • 31. THANK YOU! Tim Adams, CLO [email_address] Brian Webster, Vice President [email_address] www.Knowledge Factor.com 720-214-4874