SlideShare a Scribd company logo
Evaluating Library & Research Services:
Meaningful Measures & Measuring Impact
Library & Research Services for Parliaments
Management Workshop
Paris, August 2014
Jane Dysart, Dysart & Jones Associates, Canada
Agenda
• Meaningful measures
• Why the struggle to define & capture measures?
• Successful measurers
• Types of measures
• Measure frameworks
• Communicating impact
• Resources
• Challenges/exercises
Why Is It a Struggle?
1. Libraries do not set targets for their measures.
2. Not enough  understanding  of  stakeholders’  value  
measures.
3. Measures not an integral element of services or
programs.
4. Value measures are not differentiated from
operating measures; outcomes are confused with
outputs, which confuses everyone.
5. No clear responsibility for managing measures.
• http://www.infotoday.com/cilmag/jun13/Hosseini-Ara_Jones--Overcoming-Our-Habits-and-Learning-to-
Measure-Impact.shtml
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Communicating Impact
• Language of stakeholders
• Data visualization
• Infographics
– http://ebookfriendly.com/libraries-matter-library-
infographics/?utm_content=bufferdba27&utm_medium=s
ocial&utm_source=twitter.com&utm_campaign=buffer
– European Parliament website has infographics at
http://www.europarl.europa.eu/news/en/news-
room/infographics
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Resources
• http://dysartjones.com/category/performance-
measurement/
• Overcoming our habits & learning to measure
impact, Rebecca Jones & Moe Hosseini-Ara
• Measuring what matters, Bonnie Gratch Lindauer
• Impact: A practical guide to evaluating
community information projects
• Joe Matthews : The Bottom Line: Determining &
Communicating the Value of the Special Library;
Score Cards for Results; Evaluation &
Measurement of Library Services
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Step 1:
Describe Your Project and Identify Your Target Audience
Step 2:
Identify  the  Evaluation’s  Purpose  and  Key  Questions
Step 3:
Design the Evaluation Using Effective Methods
Website Analytics
Social Media Analysis
Surveys
Interviews
Step 4:
Communicate & Report the Evaluation Findings
http://www.knightfoundation.org/media/uploads/publication_pdfs/Im
pact-a-guide-to-Evaluating_Community_Info_Projects.pdf
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures
Questions? Comments?
Other things to explore?
THANKS!
Slides at www.dysartjones.com
Jane Dysart, Dysart & Jones Associates
jane@dysartjones.com

More Related Content

PPSX
Framing the opportunities for powerful metrics in libraries with joe matthews
PDF
Books & Mortar: Getting attention for facility plans
PDF
Using the Logic Model for Impact & Success; #SLA2017
PDF
Project management: critical skills
PDF
Determing & Demonstrating Value with the Logic Model
PPTX
Meaningful Measures: Why size (and volume) doesn't matter
PDF
Technology is One Enabler
PPTX
Core Capabilities: Library Staff Know-How, Know-That & Know-Who
Framing the opportunities for powerful metrics in libraries with joe matthews
Books & Mortar: Getting attention for facility plans
Using the Logic Model for Impact & Success; #SLA2017
Project management: critical skills
Determing & Demonstrating Value with the Logic Model
Meaningful Measures: Why size (and volume) doesn't matter
Technology is One Enabler
Core Capabilities: Library Staff Know-How, Know-That & Know-Who

What's hot (20)

PDF
Framing & Defining Metrics for Libraries
PPT
Santa Cruz International Meet Up Mar 10
PPTX
Anne Kazimirski 2013 Future Focus Workshop: Benifits of Monitoring & Evaluation
PPTX
Data Placemats: A DataViz Technique to Improve Stakeholder Understanding of E...
PPTX
Moves Management
PDF
1215 daa industry lunch
PPTX
Using Process Mapping to Simplify a Complex Task
PPTX
Refreshing Evaluation in Support of the Social Movements Revival
DOC
Strategic Direction Setting For Libraries Nov. 2010
PDF
Togy Jose: Organizational Network Analytics - Revealing the Real Networks
PPTX
Data Placemats: Construction and Practical Design Tips
PDF
PDF
About RHBA
PPTX
Digital should transform your organisation - the role of trustees in leading ...
PPTX
How to identify your impact at 20 paces
PPTX
PDF
It wouldn’t be KMb without KB
PDF
Academic posters are like a store display
PDF
CORE Group: Civil Society Engagement Practical Country Platform Solutions to ...
PPT
Outcome-based evaluation of research networks supported by IDRC's Acacia prog...
Framing & Defining Metrics for Libraries
Santa Cruz International Meet Up Mar 10
Anne Kazimirski 2013 Future Focus Workshop: Benifits of Monitoring & Evaluation
Data Placemats: A DataViz Technique to Improve Stakeholder Understanding of E...
Moves Management
1215 daa industry lunch
Using Process Mapping to Simplify a Complex Task
Refreshing Evaluation in Support of the Social Movements Revival
Strategic Direction Setting For Libraries Nov. 2010
Togy Jose: Organizational Network Analytics - Revealing the Real Networks
Data Placemats: Construction and Practical Design Tips
About RHBA
Digital should transform your organisation - the role of trustees in leading ...
How to identify your impact at 20 paces
It wouldn’t be KMb without KB
Academic posters are like a store display
CORE Group: Civil Society Engagement Practical Country Platform Solutions to ...
Outcome-based evaluation of research networks supported by IDRC's Acacia prog...
Ad

Similar to Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures (20)

PPTX
From Reporting to Insight to Action
PDF
Library Connect Webinar Slides
PPTX
Ellen Wagner: Putting Data to Work
PDF
Designing Effective and Measurable Student Learning Outcomes
PPTX
Developing Student Learing Outcomes
PPTX
Demonstrating the library's impact through assessment and evaluation
PPTX
UKSG Conference 2017 Breakout - User Engagement Analytics: measuring and driv...
PDF
DDL Programme Meeting Oct12
PDF
YouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
PPT
The Informationist: Pushing the Boundaries
PPTX
Integrated Environmental Assessment_Lecture_Presentation.pptx
PPTX
Barbara dale jones presentation-frf event_17032015_final
PPTX
‘The Establishment and Development of UCD Library’s Research Services Unit:Su...
PPT
2010 bush foundation inputs, process indicators, and intermediate outcomes
PPTX
Student Success is more than Software
PPTX
Workshop presentation UL
PPTX
Volunteers and non profit communications strategy
PDF
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
PDF
Hiller, "Inputs, Outputs, Outcomes, Measures and Profiles: Assessing Library ...
From Reporting to Insight to Action
Library Connect Webinar Slides
Ellen Wagner: Putting Data to Work
Designing Effective and Measurable Student Learning Outcomes
Developing Student Learing Outcomes
Demonstrating the library's impact through assessment and evaluation
UKSG Conference 2017 Breakout - User Engagement Analytics: measuring and driv...
DDL Programme Meeting Oct12
YouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
The Informationist: Pushing the Boundaries
Integrated Environmental Assessment_Lecture_Presentation.pptx
Barbara dale jones presentation-frf event_17032015_final
‘The Establishment and Development of UCD Library’s Research Services Unit:Su...
2010 bush foundation inputs, process indicators, and intermediate outcomes
Student Success is more than Software
Workshop presentation UL
Volunteers and non profit communications strategy
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
Hiller, "Inputs, Outputs, Outcomes, Measures and Profiles: Assessing Library ...
Ad

More from Rebecca Jones (20)

PDF
Tampa Bay Library Consortia: To Next From Now
PDF
What Libraries Stop Doing
PDF
Business Models work for Libraries Too!
PDF
Leadership summit strategic thinking
PDF
Organization structure @ Building an Engaged Flat Army in the Library Symposi...
PDF
Orientation for Public Library Board
PPTX
Municipal Engagement: to Ontario Public Libraries Marketing ThinkTank
PPTX
Future-Focused & Staff-Directed Strategic Planning
PPTX
Coaching and Mentoring: Mandatory
PDF
Transitioning to leadership & management roles
PPTX
Cla 2012 Strategic Planning: Keep it From Failing
PDF
Imagine and dream big about your library
PDF
The Accidental Manager
PPTX
COLAL 2011 Top Ten Reasons Information Professionals Succeed
PDF
Thinking strategically & critically seeing possibilities
PDF
Jim Morgenstern Library Strategic Planning
PPT
Jim morgenstern strat planning presentation distribution copy
PPTX
Sla pharma thinking strategically & critically seeing possibilities for web
PPTX
CIL 2011 Thinking Strategically & Critically: Seeing possibilities
PPTX
CIL 2011 Performance Measures: Illustrating Value to Your Community for web
Tampa Bay Library Consortia: To Next From Now
What Libraries Stop Doing
Business Models work for Libraries Too!
Leadership summit strategic thinking
Organization structure @ Building an Engaged Flat Army in the Library Symposi...
Orientation for Public Library Board
Municipal Engagement: to Ontario Public Libraries Marketing ThinkTank
Future-Focused & Staff-Directed Strategic Planning
Coaching and Mentoring: Mandatory
Transitioning to leadership & management roles
Cla 2012 Strategic Planning: Keep it From Failing
Imagine and dream big about your library
The Accidental Manager
COLAL 2011 Top Ten Reasons Information Professionals Succeed
Thinking strategically & critically seeing possibilities
Jim Morgenstern Library Strategic Planning
Jim morgenstern strat planning presentation distribution copy
Sla pharma thinking strategically & critically seeing possibilities for web
CIL 2011 Thinking Strategically & Critically: Seeing possibilities
CIL 2011 Performance Measures: Illustrating Value to Your Community for web

Recently uploaded (20)

PDF
Optimize Freight, Fleet, and Fulfillment with Scalable Logistics Solutions.pdf
PPTX
Moving House Why Removals in Melbourne Make It Easy.pptx
DOC
SAS毕业证学历认证,利兹三一大学毕业证国外毕业证
PDF
Top 7 Cybersecurity Companies in Abu Dhabi
PPTX
Ealeba Youth Structure Five Core Programs & Projects Executives
PDF
Elliott Allan Hilsinger_ Creating Meaningful Volunteer Opportunities for Yout...
PDF
Musician Corporate Headshots Los Angeles
PDF
Future of Digital Marketing Trends & Insights.pdf
PDF
Robert Hume San Diego_ How Firefighting Tools and Technology Have Transformed...
PDF
catalogo de peças da Dominar-400 PEÇAS.pdf
PDF
Why Corporate Relocations Need Professional Packers and Movers.pdf
PDF
Digital marketing strategy slides .pdf
PDF
Green minimalist professional Business Proposal Presentation.pdf
PDF
5 Best Sites to Buy Snapchat Accounts (Aged & Pva).pdf
PPTX
Your Trusted SEO Company in San Antonio – Studio0413
PPTX
Why Outsourcing Debt Collection Saves Time and Money.pptx
PPTX
Telecom Expense Management & Optimization – The ITE Group.pptx
PPTX
Unlocking-Business-Potential-Power-BI-Development-Services.pptx
PPTX
Next-Generation Airline Network & Schedule Planning
PPTX
AI-Powered-Mobile-App-Development-The-Future-of-Intelligent-Applications.pptx
Optimize Freight, Fleet, and Fulfillment with Scalable Logistics Solutions.pdf
Moving House Why Removals in Melbourne Make It Easy.pptx
SAS毕业证学历认证,利兹三一大学毕业证国外毕业证
Top 7 Cybersecurity Companies in Abu Dhabi
Ealeba Youth Structure Five Core Programs & Projects Executives
Elliott Allan Hilsinger_ Creating Meaningful Volunteer Opportunities for Yout...
Musician Corporate Headshots Los Angeles
Future of Digital Marketing Trends & Insights.pdf
Robert Hume San Diego_ How Firefighting Tools and Technology Have Transformed...
catalogo de peças da Dominar-400 PEÇAS.pdf
Why Corporate Relocations Need Professional Packers and Movers.pdf
Digital marketing strategy slides .pdf
Green minimalist professional Business Proposal Presentation.pdf
5 Best Sites to Buy Snapchat Accounts (Aged & Pva).pdf
Your Trusted SEO Company in San Antonio – Studio0413
Why Outsourcing Debt Collection Saves Time and Money.pptx
Telecom Expense Management & Optimization – The ITE Group.pptx
Unlocking-Business-Potential-Power-BI-Development-Services.pptx
Next-Generation Airline Network & Schedule Planning
AI-Powered-Mobile-App-Development-The-Future-of-Intelligent-Applications.pptx

Jane Dysart @ IFLA2014 Evaluating Library & Research Services: Meaningful Measures

  • 1. Evaluating Library & Research Services: Meaningful Measures & Measuring Impact Library & Research Services for Parliaments Management Workshop Paris, August 2014 Jane Dysart, Dysart & Jones Associates, Canada
  • 2. Agenda • Meaningful measures • Why the struggle to define & capture measures? • Successful measurers • Types of measures • Measure frameworks • Communicating impact • Resources • Challenges/exercises
  • 3. Why Is It a Struggle? 1. Libraries do not set targets for their measures. 2. Not enough  understanding  of  stakeholders’  value   measures. 3. Measures not an integral element of services or programs. 4. Value measures are not differentiated from operating measures; outcomes are confused with outputs, which confuses everyone. 5. No clear responsibility for managing measures. • http://www.infotoday.com/cilmag/jun13/Hosseini-Ara_Jones--Overcoming-Our-Habits-and-Learning-to- Measure-Impact.shtml
  • 13. Communicating Impact • Language of stakeholders • Data visualization • Infographics – http://ebookfriendly.com/libraries-matter-library- infographics/?utm_content=bufferdba27&utm_medium=s ocial&utm_source=twitter.com&utm_campaign=buffer – European Parliament website has infographics at http://www.europarl.europa.eu/news/en/news- room/infographics
  • 16. Resources • http://dysartjones.com/category/performance- measurement/ • Overcoming our habits & learning to measure impact, Rebecca Jones & Moe Hosseini-Ara • Measuring what matters, Bonnie Gratch Lindauer • Impact: A practical guide to evaluating community information projects • Joe Matthews : The Bottom Line: Determining & Communicating the Value of the Special Library; Score Cards for Results; Evaluation & Measurement of Library Services
  • 19. Step 1: Describe Your Project and Identify Your Target Audience Step 2: Identify  the  Evaluation’s  Purpose  and  Key  Questions Step 3: Design the Evaluation Using Effective Methods Website Analytics Social Media Analysis Surveys Interviews Step 4: Communicate & Report the Evaluation Findings http://www.knightfoundation.org/media/uploads/publication_pdfs/Im pact-a-guide-to-Evaluating_Community_Info_Projects.pdf
  • 24. THANKS! Slides at www.dysartjones.com Jane Dysart, Dysart & Jones Associates jane@dysartjones.com