All Your Data Displayed in One Place: Scoping Research for a Library Assessment Dashboard & Toolkit
1 like37,365 views
The document outlines the scoping research for a library assessment dashboard and toolkit, conducted from January to June 2016. The project seeks to identify the need for a centralized system to enhance data-driven decision-making in libraries by providing a framework of key performance indicators and tools for data management. Key recommendations include the establishment of a membership consortium to support ongoing development and adoption of the toolkit.
All Your Data Displayed in One Place: Scoping Research for a Library Assessment Dashboard & Toolkit
- 1. All Your Data Displayed in One Place Scoping Research for a Library Assessment Dashboard & Toolkit Megan Hurst Athenaeum2l Consulting Association of Research Libraries Library Assessment Conference Arlington, Virginia USA November 2016
- 2. Contents 1. Scoping Research Project 2. Motivation 3. Context 4. Results 5. Next Steps 2
- 3. Library Assessment Dashboard & Toolkit Scoping Research January-June 2016, international, collaborative research project to: Assess the need for and interest in a library assessment dashboard and toolkit Survey library data sources and key library performance indicators Survey tools and technology available to support the creation of a dashboard Scope the work and resources required to build it
- 4. Motivations Solve it once, flexibly, for many Utilize and build upon important assessment efforts and standards Centralize and organize views into librariesâ diverse data sources Support strategic thinking and data-driven decisions within library organizations by providing a shared âbig pictureâ
- 5. âEverything weâre doing now is on a question/answer basis.â - Assessment librarian & project interviewee 5
- 6. Motivation: Setting Goals Is Easy⌠But Achieving Them Isn't 65% of organizations have an agreed-upon strategy. 14% of employees understand the organizationâs strategy. Less than 10% of all organizations successfully execute the strategy. (source Forbes.com)
- 7. Dashboards Provide a Shared Picture of Performance Sources: http://www.informationbuilders.com/products/intelligence https://www.johndaniel.com/index.php/solutions/industry-s egment/healthcare/ Example dashboards from other industries
- 8. âIf it were easy, it would be done already!â 8
- 9. Opportunity Common Needs Across Libraries: â Data gathering and cleaning â Tools and methods â Metrics and formulae Maturing: â Standards â Tools â Technologies Common needs, Maturing standards & tools 9
- 10. â...having the dashboard would enable us to spend less time getting answers to basic questions, and spend more time on the complex, deep questions.â - Assessment Librarian & project interviewee 10
- 11. Scoping Research Results & Next Steps The Toolkit should include: â A Framework of key library performance indicators and supporting data formulas â Library data inventory and dictionary â Data normalization tools library â Customizable, web browser-based dashboard with data visualization modules for key library performance indicators â Recommendations and case studies for data warehousing solutions A membership consortium and online community would support adoption and long-term sustainability
- 12. Service Area Strategic Dashboard KPI Examples Managerial Dashboard KPI Examples Operational Dashboard KPI Examples Users and Space B.2.2.2 Percentage of External Users; B.2.2.3 Percentage of the Total Library Lending to External Users B.1.3.3 Hours Open Compared to Demand; B.1.3.4 Percentage of Storage Space Which Has an Appropriate Environment Percentage of shelf space utilized Collections Percentage of Collection in digital format B.2.1.1 Collection Turnover; B.1.2.6 Percentage of Rare Materials Accessible via Web Catalogues; See âWork Rateâ Service Area Library Use B.2.1.2 Loans per Capita; B.2.1.3 Percentage of Stock Not Used B.3.1.3 Cost per Download B.2.3.1 User Places Occupancy Rate; B.2.1.4 Number of Content Units Downloaded per Capita; B.1.1.3 Percentage of Rejected Accesses; B.2.2.5 Number of User Attendances at Training Lessons per Capita Financial B.4.3.2 Percentage of Institutional Means allocated to the Library; B.3.3.1 User Services Staff as a Percentage of Total Staff; B.3.3.3 Ratio of Acquisition Expenditures to Staff Costs B.3.3.6 Staff Costs per Title Catalogued B.3.1.3 Cost per Download Work Rate See âFinancialâ Service Area B.3.3.5 Employee Productivity in Lending and Delivery Services; B.4.2.1 Percentage of Library Staff Providing Electronic Services; B.4.2.4 Percentage of Staff in Cooperative Partnerships and Projects B.1.2.1 Shelving Accuracy; B.1.2.2 Median Time of Document Retrieval from Closed Stacks; B.1.2.3 Speed of Interlibrary Lending Public Engagement Exhibition Attendance Alumni gifts No of visitors to websites (# website sessions) Average length of visit to webpage - dwell time Satisfaction B.2.4.2 User Satisfaction; B.2.4.3 Willingness to Return B.2.4.2 User Satisfaction; B.2.4.3 Willingness to Return B.2.4.2 User Satisfaction; B.2.4.3 Willingness to Return Proposed Dashboard Framework (Draft)
- 13. ISO 11620: Library Performance Indicators â Opening hours compared to demand â Availability of required titles â Percentage of rejected sessions â Ratio of requests received to requests sent out in interlibrary lending â Staff per capita â User satisfaction â Library visits per capita â Seat occupancy rate â Number content units downloaded per capita â Collection use (turnover) â Percentage of stock not used â Loans per capita â Percentage of loans to external users â Reference questions per capita â Ratio of acquisitions costs to staff costs â Acquisition speed â Lending speed â Interlibrary loan speed â Percentage of acquisitions expenditure spent on the electronic collection â And more.... https://www.iso.org/obp/ui/#iso:std:iso:11620:ed-3:v1:en
- 14. Next Steps 2016/2017 Elaborate data framework Monitor evolution of important efforts Establish partnerships & sponsorships Re-visit technology landscape Finalize project estimates Get ready, get set⌠GO!
- 15. Thank You to Project Research Interviewees at: â Charlotte-Mecklenberg Public Library, North Carolina (US) â Duke University (US) â Harvey Mudd College (US) â Jisc (UK) â Syracuse University (US) â University of California, Davis (US) â University of Pennsylvania (US) â Wollongong University (Australia) â Yale University (US)
- 16. Scoping Research Project Partners Project Team MacKenzie Smith (PI), UC Davis Bill Garrity (Co-PI), UC Davis Megan Hurst, Athenaeum21 Christine Madsen, Athenaeum21 Frankie Wilson, Bodleian Wolfram Horstmann, GĂśttingen Mustafa Dogan, GĂśttingen Christian Mahnke, GĂśttingen Peter Brantley, UC Davis