Information services performance/quality/value/impact/benefit: (a) concepts and implications; (b) projecting library performance/quality in “time”
- 1. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 1Kostagiolas , Lectures Dr. Petros A. Kostagiolas Assistant Professor of Information Services Management Department of Archives, Library Science and Museology School of Information Sciences and Informatics Ionian University, Email. pkostagiolas@ionio.gr ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April - Room 5.B.14 – Edinburgh Napier University Sighthill campus Information services performance/quality/value/impact/benefit: (a) concepts and implications; (b) projecting library performance/quality in “time” Ionian University
- 2. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 2Kostagiolas , Lectures Lecture Overview – Prepare for some technical material •Concepts & Implications •Research ideas
- 3. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 3Kostagiolas , Lectures Lecture Overview •Concepts & Implications •Research
- 4. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 4Kostagiolas , Lectures WG 2: International library statistics ISO 2789 International library statistics,4th edition WG 4: Performance indicators for libraries ISO 11620 Library performance indicators WG 7: Quality measures for national libraries ISO TR 28118 (2009) Performance indicators for national libraries ISO TC 46: Information and documentation Subcommittee 8: Quality, statistics and performance evaluation WG 8: Statistical data for library buildings ISO TR 11219 Qualitative conditions and basic statistics for library buildings ISO TR 14783 Statistics and quality issues for web archiving WG 9: Statistics and quality issues for web archiving WG 10: Methods and procedures for assessing the impact of libraries ISO 16439 Methods and procedures for assessing the impact of libraries
- 5. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 5Kostagiolas , Lectures The statistics and metrics “follow” the advances …and they reviewed faster than ever! ISO 2789 International Library Statistics ISO 11620 Library Performance Indicators
- 6. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 6Kostagiolas , Lectures Examples of Performance indicators
- 7. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 7Kostagiolas , Lectures Impact through ISO 16439
- 8. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 8Kostagiolas , Lectures The ISO 16439 approach
- 9. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 9Kostagiolas , Lectures Connecting the standards (Renard, 2007) Impact: ISO 16439
- 10. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 10Kostagiolas , Lectures What is performance/ quality /value /impact /benefit evaluation? …relate to the value created / underlying values… … relate to the impact created / stakeholder benefits …
- 11. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 11Kostagiolas , Lectures Some more related concepts …
- 12. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 12Kostagiolas , Lectures Library as system: Putting all concepts together (ISO 11620)
- 13. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 13Kostagiolas , Lectures REMEMBER … the socioeconomic environment and indeed the Global Economic Crisis put pressure to Libraries to prove their Worth!!! Three core constructs... PERFORMANCE = QUALITY & VALUE & IMPACT Summarizing the concepts (Orr, 1973; Town, 2009) How “good” is the library? How good it does? Chances it creates?
- 14. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 14Kostagiolas , Lectures We need to further demonstrate the impact of Library Services
- 15. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 15Kostagiolas , Lectures Beyond the Library Value Calculators Efforts focused on demonstrating economic value of library service activity (outcome)...include various “library value calculators” Need to assign economic value and to measure social capital oriented outcomes or aspects of a library activity http://www.ala.org/advocacy/advleg/adv ocacyuniversity/toolkit/makingthecase/li brary_calculator
- 16. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 16Kostagiolas , Lectures Information services value • Impact on Information Collaborations – The boundaries of information organizations are NOT SOLID • Impact on Information Transparency – Has to do with openness, communication and information… • Impact on Information Sharing – Intellectual Capital Management – Long tail industries… • Impact on peoples’ empowerment through Information
- 17. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 17Kostagiolas , Lectures Can we build an information time machine? http://www.ted.com/talks/frederic_kaplan_how_i_built_ an_information_time_machine Frederic Kaplan: How to build an information time machine
- 18. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 18Kostagiolas , Lectures The implications of performance /quality /value /impact of Information Services on the Worlds of Production
- 19. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 19Kostagiolas , Lectures 19 What is missing in our quest for Value and Impact?
- 20. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 20Kostagiolas , Lectures The persistence of memory (http://www.dalipaintings.net/persistence-of-memory.jsp)
- 21. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 21Kostagiolas , Lectures Lecture Overview • Concepts & Implications • Research
- 22. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 22Kostagiolas , Lectures The Concept of “Reliable Performance” Quality Service Dimensions: Interpersonal & Technical
- 23. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 23Kostagiolas , Lectures Why Reliability… “Quality”“Reliability” Although quality is a snapshot of library operation, reliability provides a representation of its day-by-day operation. Unreliable information services lower the performance, damage the library’s reputation and lead to quality inferiority, user displeasure, inconvenience and lasting user dissatisfaction.
- 24. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 24Kostagiolas , Lectures This presentation is based on a first previous attempt
- 25. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 25Kostagiolas , Lectures Theoretical background and problem definition The variable of interest is the lifetimes of successful operations or the unchanged state of an individual or the unchanged state of a performance characteristic, and an investigator wishes to estimate the reliability function either from the data (non-parametric methods) or through fitting distributional models (parametric methods).
- 26. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 26Kostagiolas , Lectures Basic distribution functions for reliability analysis The five probability functions are mathematically equivalent and if one of them is known all five can be derived.
- 27. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 27Kostagiolas , Lectures Notation Employed Assume that a multiply censored data set has been made available:
- 28. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 28Kostagiolas , Lectures Non-parametric Reliability Estimators Kaplan – Meier Reliability Estimator Cumulative Hazard Reliability Estimator
- 29. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 29Kostagiolas , Lectures Parametric methods: Library applications of Weibull Analysis Maximum Likelihood Estimation method of the Weibull Parameters
- 30. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 30Kostagiolas , Lectures Les us assume that a subscription based information service has been introduced by a library: Reliability analysis may be employed to study the duration of time that a user stay subscribed to this particular subscription service. The rate of the users remaining subscribed to the service on a long term basis is an important issue for the library’s management. Such a result however should be based on the prediction of the rate at which the users renew or cancel their subscriptions, i.e. the users’ subscription failure rate. An example…
- 31. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 31Kostagiolas , Lectures Non-parametric & Parametric Estimation
- 32. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 32Kostagiolas , Lectures Graphical GOF tests
- 33. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 33Kostagiolas , Lectures Extrapolation beyond the data Conditional Probability of the estimated Weibull distribution:
- 34. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 34Kostagiolas , Lectures Reliable Library and Information Services Performance • Reliability analysis should be integrated in the library management practices, indicatively for the following: • Modelling library user behaviour over time. • Modelling library services performance over time, i.e. loans or interlibrary loan activity. • Modelling digital library services, based on an analysis of the time marks of error data logs automatically produced. • Modelling of certain type of information technology software and equipment. Reliability analysis aim on modelling the performance over time of operations, systems and services
- 35. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 35Kostagiolas , Lectures An exercise … based on three questions CAN WE THINK TOGETHER OF OTHER Reliability Performance CCPs? which performance dimensions we would model in terms of reliability? which failure modes and indicators we would model for each reliability dimension? A. Collection B. Performing services as promised C. Library opens at exact time / information systems’ availability A. accuracy of bibliography / cataloguing / OPAC … B. Loans / interlibrary loans C. Opening hours / repositories etc
- 36. ESRC SCOTTISH DOCTORAL TRAINING CENTRE INFORMATION SCIENCE PATHWAY TRAINING 2016 12th-13th April 20156- SLIDE 36Kostagiolas , Lectures Thank you for your attention pkostagiolas@ionio.gr