SlideShare a Scribd company logo
Using available tools
Assessment Practices and Metrics for the 21st
Century
Frankie Wilson
Head of Assessment & Secretariat
Overview
• Using the right tool for the job
• Quantitative data analysis
• Qualitative data analysis
• Tools
• Demonstration of tools
• Other common tools
Using the right tool for the job
• What type of data do you have?
• What do you want to know from the data?
What type of data do you have?
• Quantitative data - numbers
• Qualitative data – not numbers
• User Experience data – design iteration input
• Quantitative disguised as qualitative data
e.g.
Where do you get course books?_______
18-21 years 22-25 years 25-35 years Over 45 years
Types of quantitative data
Type of data Example Type of data analysis
Nominal
(category)
Library user
/ library
non-user
Frequency distribution
Cross-tabulation
Ordinal
(rank)
Order of
importance
of library
programmes
Frequency distribution
Cross-tabulation
Similarities/differences between groups
Similarities/differences between performance of
individuals under two conditions
Interval (actual
number with equal
distances)
Likert Scale
sliders
Measures of central tendency
Measures of dispersion
Ratio
(actual number
with true zero)
Number of
books
borrowed
Measures of central tendency
Measures of dispersion
Correlation
What do you want to know?
• Who… uses the library on Sundays?
• What… is the impact of the Therapy Dogs
programme?
• Why… don’t History students attend library
training?
• When… would be the best time to refresh the
website?
• How… do new Doctoral students learn
how to use A&I databases?
Quantitative data analysis
• Descriptive statistics
• Measures of central tendency (“averages”)
• Measures of dispersion
• Frequency distribution
• Cross-tabulation
• Statistical analysis
Frequency distribution
• Proportion (%) of responses to
each of the answer options
Cross-tabulation
• Links between variables
• Similarities/differences between groups
Measures of central tendency
• Mean - typical
• Mode - most frequent
• Median - mid-point
• Mean = 420/10 = 42
• Mode = 25
• Median = 40
A B C D E F G H I J
25 25 25 25 40 40 40 50 50 100
Measures of dispersion
• How data appears round average
• Range – difference between highest & lowest
• Variance – how each score varies from mean
• Standard Deviation – how each score varies from
mean
• Range = 100-25 = 75
• Variance = sum of (score-mean)2/total # scores = 466
• Standard Deviation = √466 = 21.59
Normal distribution
Skewed distribution
Multimodal distribution
Qualitative data analysis
• Frequency analysis
• Descriptive - thematic analysis
• Deeper analysis - abstraction
Tools
• Quantitative descriptive statistics
• Excel
• Survey tools (e.g. SurveyMonkey)
• Quantitative statistical analysis
• SPSS
• Qualitative data analysis
• Excel
• Word and post-it notes
• NVivo
Demonstration: Excel
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Demonstration: SurveyMonkey
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century
Qualitative data analysis using Excel
Qualitative data analysis using Excel
Qualitative data analysis using Word
Qualitative data analysis: abstraction
Qualitative data analysis using NVivo
Other useful tools
• Tableau
• Pentaho Kettle
Tableau
Pentaho Kettle
Questions?
• frankie.wilson@bodleian.ox.ac.uk
• @qualitydog

More Related Content

PDF
Kyrillidou Session One NISO Training Assessment Practices
PDF
Starr Hoffman - Data Collection & Research Design
PPTX
Lewellen - Formulating, Interpretation and Presentation of Data
PPTX
Turner Reporting and Developing Strategies Nov 30 Training
PDF
Developing New Metrics - A Pubrarian's Perspective - Watkinson
PDF
Felix "Transforming Libraries: How to Transform Library Spaces, Services, and...
PPT
Some Glaring Mistakes made by Researchers in Education in Statistical Analysis
PDF
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...
Kyrillidou Session One NISO Training Assessment Practices
Starr Hoffman - Data Collection & Research Design
Lewellen - Formulating, Interpretation and Presentation of Data
Turner Reporting and Developing Strategies Nov 30 Training
Developing New Metrics - A Pubrarian's Perspective - Watkinson
Felix "Transforming Libraries: How to Transform Library Spaces, Services, and...
Some Glaring Mistakes made by Researchers in Education in Statistical Analysis
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...

What's hot (20)

PDF
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
PPTX
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
PPTX
Research courses for the EdD
PPTX
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
PPT
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
PPT
Evaluating Libraries
PPT
The Informationist: Pushing the Boundaries
PPT
2008 regional educational laboratory board of directors (rel midwest)
PPTX
Responsible metrics: One size doesn't fit all
PPTX
Assess This!
PDF
Research output in Irish H.E. academic libraries 2000-2015
PDF
"Research output in Irish H.E.academic libraries 2000-2015" Terry O’Brien & K...
PDF
PPTX
Data, evidence and outcomes
PPTX
Beyond the Factor: Talking about Research Impact
DOCX
Research objectives (due 17 april) dr. johan
DOCX
The latest assigned task amendment based on the new working title.
PPTX
Designing Effective Research Assignments
DOCX
Research objectives (due 17 april) dr. johan
PPTX
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
Research courses for the EdD
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
Evaluating Libraries
The Informationist: Pushing the Boundaries
2008 regional educational laboratory board of directors (rel midwest)
Responsible metrics: One size doesn't fit all
Assess This!
Research output in Irish H.E. academic libraries 2000-2015
"Research output in Irish H.E.academic libraries 2000-2015" Terry O’Brien & K...
Data, evidence and outcomes
Beyond the Factor: Talking about Research Impact
Research objectives (due 17 april) dr. johan
The latest assigned task amendment based on the new working title.
Designing Effective Research Assignments
Research objectives (due 17 april) dr. johan
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
Ad

Similar to Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century (20)

PPTX
Ch5-quantitative-data analysis.pptx
PPT
havsHahsSfsAFSsfASFSFSFSfssfAFsfsfastasa
PPTX
Descriptive Analysis.pptx
PPTX
Psych Assessment Norms and Statistics for Testing.pptx
PPTX
Statistics-and-Computer-Tools-for-Analyzing-of-Assessment-Data.pptx
PPTX
Introduction to Data Analysis for Nurse Researchers
PPTX
Analysis and Interpretation of Data
PPT
Univariate, bivariate analysis, hypothesis testing, chi square
PPTX
2. chapter ii(analyz)
PPTX
Analyzing quantitative data
PPTX
Presentation1
PPT
Malimu descriptive statistics.
PPTX
Analysis, Interpretation, and Use of Test Lesson 8.pptx
PDF
4. six sigma descriptive statistics
PPTX
MIDTERM-2_PEC-8-ASSESSMENT-OF-LEARNING-1.pptx
PPT
BRM_Data Analysis, Interpretation and Reporting Part II.ppt
PPTX
stat report about statistics and probabi
PPTX
Spss presentation
PPTX
Education Assessment in Learnings 1.pptx
PPT
Refresher Course Psychological Statistics
Ch5-quantitative-data analysis.pptx
havsHahsSfsAFSsfASFSFSFSfssfAFsfsfastasa
Descriptive Analysis.pptx
Psych Assessment Norms and Statistics for Testing.pptx
Statistics-and-Computer-Tools-for-Analyzing-of-Assessment-Data.pptx
Introduction to Data Analysis for Nurse Researchers
Analysis and Interpretation of Data
Univariate, bivariate analysis, hypothesis testing, chi square
2. chapter ii(analyz)
Analyzing quantitative data
Presentation1
Malimu descriptive statistics.
Analysis, Interpretation, and Use of Test Lesson 8.pptx
4. six sigma descriptive statistics
MIDTERM-2_PEC-8-ASSESSMENT-OF-LEARNING-1.pptx
BRM_Data Analysis, Interpretation and Reporting Part II.ppt
stat report about statistics and probabi
Spss presentation
Education Assessment in Learnings 1.pptx
Refresher Course Psychological Statistics
Ad

More from National Information Standards Organization (NISO) (20)

PPTX
Larry Bennett_ ALA Annual Convention 2025AL2 slides.pptx
PPTX
Potash "Our Journey & Vision for Accessible Content"
PPTX
O'Leary "Progress Assessment - How Far Are We from Delivery"
PPTX
Carpenter and O'Leary "Accessibility Standards and the Future of Inclusive Pu...
PPTX
Davidian "Transfer Code of Practice Standing Committee Update"
PPTX
Patham "NISO Open Discovery Initiative (ODI) Update"
PPTX
Hichliffe "A Standard Terminology for Peer Review"
PPTX
Levin "KBART RP Update at ALA Annual 2025"
PPTX
Carpenter "Advancing Infrastructure for Sustainable Collections: CCLP Project...
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Carpenter "2025 NISO Annual Members Meeting"
PPTX
Allen "Social Marketing in Scholarly Communications"
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NIS...
PPTX
Gilstrap "Accessibility Essentials: A 2025 NISO Training Series, Session 7, M...
PPTX
Turner "Accessibility Essentials: A 2025 NISO Training Series, Session 7, Lan...
PPTX
Comeford "Accessibility Essentials: A 2025 NISO Training Series, Session 7, A...
PPTX
Laverick and Richard "Accessibility Essentials: A 2025 NISO Training Series, ...
Larry Bennett_ ALA Annual Convention 2025AL2 slides.pptx
Potash "Our Journey & Vision for Accessible Content"
O'Leary "Progress Assessment - How Far Are We from Delivery"
Carpenter and O'Leary "Accessibility Standards and the Future of Inclusive Pu...
Davidian "Transfer Code of Practice Standing Committee Update"
Patham "NISO Open Discovery Initiative (ODI) Update"
Hichliffe "A Standard Terminology for Peer Review"
Levin "KBART RP Update at ALA Annual 2025"
Carpenter "Advancing Infrastructure for Sustainable Collections: CCLP Project...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Carpenter "2025 NISO Annual Members Meeting"
Allen "Social Marketing in Scholarly Communications"
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NIS...
Gilstrap "Accessibility Essentials: A 2025 NISO Training Series, Session 7, M...
Turner "Accessibility Essentials: A 2025 NISO Training Series, Session 7, Lan...
Comeford "Accessibility Essentials: A 2025 NISO Training Series, Session 7, A...
Laverick and Richard "Accessibility Essentials: A 2025 NISO Training Series, ...

Recently uploaded (20)

PPTX
Cell Types and Its function , kingdom of life
PDF
Insiders guide to clinical Medicine.pdf
PPTX
Cell Structure & Organelles in detailed.
PDF
Complications of Minimal Access Surgery at WLH
PDF
Pre independence Education in Inndia.pdf
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PDF
TR - Agricultural Crops Production NC III.pdf
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PPTX
PPH.pptx obstetrics and gynecology in nursing
PPTX
GDM (1) (1).pptx small presentation for students
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PDF
Sports Quiz easy sports quiz sports quiz
PDF
RMMM.pdf make it easy to upload and study
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Cell Types and Its function , kingdom of life
Insiders guide to clinical Medicine.pdf
Cell Structure & Organelles in detailed.
Complications of Minimal Access Surgery at WLH
Pre independence Education in Inndia.pdf
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
O5-L3 Freight Transport Ops (International) V1.pdf
TR - Agricultural Crops Production NC III.pdf
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PPH.pptx obstetrics and gynecology in nursing
GDM (1) (1).pptx small presentation for students
Pharmacology of Heart Failure /Pharmacotherapy of CHF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Sports Quiz easy sports quiz sports quiz
RMMM.pdf make it easy to upload and study
Microbial disease of the cardiovascular and lymphatic systems
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape

Wilson - Using Available Tools: Assessment Practices and Metrics for the 21st Century