SlideShare a Scribd company logo
Development and use of service delivery
indicators for monitoring rural water services
  in Ghana, Uganda, Burkina Faso, Colombia, Honduras,
                 Paraguay, El Salvador



                     Monitoring Sustainable WASH Service Delivery Symposium
                                                  Addis Ababa, 10 April 2013

                              By: Marieke Adank, Stef Smits, Valérie Bey,
                                   Jeske Verhoeven and Christelle Pezon
What are service delivery indicators?

• Set of indicators for assessing and monitoring
  rural water service delivery:
  – the level of water service provided
  – the performance of service providers
  – the performance of service authorities




   Monitoring Sustainable WASH service Delivery Symposium   April 2013
Service level
Criterion, measured through the following indicators:
• Reliability
• Accessibility
• Water quantity
• Water quality
• User satisfaction
• Affordability


   Monitoring Sustainable WASH service Delivery Symposium   April 2013
Example of service level indicator scores
                                                Akatsi district, Volta region, Ghana
                   Functionality
                    Reliability
                    Crowding
                     Service level
                     Quantity
                     Distance
                      Quality
                                               Number of point sources:     249

                                               Functional:          67%

                                               Reliable:             69%

                                               Distance:             83%

                                               Non-crowding:         72%

                                               Quality:              94%

                                                Quantity:            51%

                                               Service level
                                               Basic services:             34%

                                               Sub-standard services:      38%

                                                Not providing services:    29%
 Monitoring Sustainable WASH service Delivery Symposium         April 2013
Service provider indicators
Indicators related to the following criteria:
• Organisation and governance
• Administration and accountability of the
  service provider
• Financial management
• Technical and operational management


   Monitoring Sustainable WASH service Delivery Symposium   April 2013
Service authority indicators
Indicators related to the following
criteria:
• Capacity of service authority
• Strategic planning                                 Authority functions
• Coordination
• Pre-construction support
• Monitoring
                                                     Support functions
• Technical assistance to service
   provider




    Monitoring Sustainable WASH service Delivery Symposium      April 2013
Scoring of indicators
  • Use of narrative scoring tables, to convert data on
    parameters into quantitative indicator scores
  • Benchmark set at minimum normative level
                                          Score    Narrative description
Example:                                           There is a WSMT. Its composition is in line with the CWSA
                                          100      guidelines and its members have received refresher training
Indicator: A well qualified and                    on at least bi-annual basis
trained gender balanced WSMT is in        75
                                                   There is a WSMT. Its composition is in line with the CWSA
                                                   guidelines and its members have received refresher training
place                                              on an irregular basis
                                                   Benchmark: There is a WSMT. Its composition is in line with
Parameters:                               50
                                                   the CWSA guidelines (Gender Balance; separated cashiering
• Number of male and female                        function and caretaking function; Vendors are engaged at
                                                   each water point) and it has received initial training
    members                                        There is a WSMT, which has been composed in line with the
                                                   CWSA guidelines (Gender Balance , separated cashiering
• Separate cashier and caretaker          25       function and caretaking function, vendors engaged at each
                                                   water point), but the WATSAN has not received initial
    functions                                      training
• Number of vendors                                The composition of the WSMT is not in line with the CWSA
                                                   guidelines (Gender Balance and / or no separated cashiering
• Training of WSMT                        0
                                                   function and caretaking function and / or vendors are not
                                                   engaged at each water point)

      Monitoring Sustainable WASH service Delivery Symposium             April 2013
Aggregation of scoring
• Proportion of units (systems, service
  providers, service authorities) meeting the
  benchmark
• Sum of scores on indicators or criteria
• Averages of scores on indicators or criteria




   Monitoring Sustainable WASH service Delivery Symposium   April 2013
Example of aggregated scores per area (district)
                                100%
     % of WATSANs meeting the



                                 90%
                                 80%
                                 70%
                                 60%
            benchmark




                                 50%
                                 40%
                                 30%
                                 20%
                                 10%                                                                                                                                                                                                                                       Akatsi
                                  0%
                                                                                                                                                                                                                                                                           East Gonja




                                                                                                                                                        Periodic maintenance
                                                                                                                                          maintenance
                                                                             interference
                                                        Record keeping and




                                                                                                                                                                               Water quality testing




                                                                                                                                                                                                                             Financial management
                                                                                                                 Area mechanic services
                                                                                             Spare part supply
                                       Composition of




                                                                                                                                                                                                       expenditure balance




                                                                                                                                                                                                                                                    Tariff setting
                                                                              No political




                                                                                                                                           Corrective
                                                          accountability



                                                                                                                                                                                                                                                                           Sunyani West
                                         WATSAN




                                                                                                                                                                                                          Revenue and
                  100
                   90
                   80
Average score




                   70
                   60
                   50                                                                                                                                                                                                                                                      Akatsi
                   40
                   30                                                                                                                                                                                                                                                      East Gonja
                   20
                   10
                                                                                                                                                                                                                                                                           Sunyani West
                    -

                                Average governance indicators
                                                         Average of operationalAverage of financial management indicators
                                                                                indicators
                                    Monitoring Sustainable WASH service Delivery Symposium           April 2013
                                                                                                                                                                                                                                                                     Source: Adank et al, 2013
Use and data requirements
• To enforce regulation and inform asset                Regular overview of all service
  management and post construction                      level and service provider indicator
  activities at decentralised level                     scores on (ideally) all units


• To inform service regulation and macro                Annual overview of differences in
  level planning at national level                      scores on indicator sets between
                                                        areas

• To monitor progress against planned                   ‘Before’ and ‘after’ assessment in
  outcomes of interventions                             intervention area


• To inform policy dialogue and debate                  Analysis of correlations between
                                                        different indicators


    Monitoring Sustainable WASH service Delivery Symposium      April 2013
SDIs in national monitoring systems
• SDIs have been developed based on national norms
  and standards
• Development and testing has taken place in close
  collaboration with stakeholders, led by government
• Interest by national and local governments to scale
  up and institutionalize the use of SDIs




   Monitoring Sustainable WASH service Delivery Symposium   April 2013
Lessons learnt
• Service delivery indicators are essential for assessing and
  monitoring water service delivery
• Service delivery indicators need to follow government’s norms and
  standards.
• Developing and using indicators may spark further development of
  these norms and standards.
• More indicators means more data collection efforts and possibly
  resources needed.
    – However, resources related to monitoring mostly related to travel and
      transport
• Need to find a balance between the amount and accuracy of data
  required at different levels, and the efforts it takes to collect this
  data


    Monitoring Sustainable WASH service Delivery Symposium   April 2013
Thank you!
For further information, please visit:
• www.irc.nl
• www.washcost.info
• www.waterservicesthatlast.org




   Monitoring Sustainable WASH service Delivery Symposium   April 2013

More Related Content

PDF
Service delivery indicators and Monitoring to improve sustainability of rural...
 
PPT
Triple s ghana presentation @ MOLE XXIII conference 23rd august ,2012
 
PPT
IRC Ghana takes takes its sustainability message to government
 
PDF
Access to markets, technologies, and services (Carlo Azzarri, IFPRI)
PPT
Stephen Hall: National Sustainable Development & Wellbeing Indicators
PPTX
Rural development indicator A Presentation by Mr Allah Dad Khan Former DG Agr...
PPT
Trends of key agriculture and rural development indicators feb 6 2013
PDF
Adank monitoring rwsn ms wg_stockholm_aug 2012
 
Service delivery indicators and Monitoring to improve sustainability of rural...
 
Triple s ghana presentation @ MOLE XXIII conference 23rd august ,2012
 
IRC Ghana takes takes its sustainability message to government
 
Access to markets, technologies, and services (Carlo Azzarri, IFPRI)
Stephen Hall: National Sustainable Development & Wellbeing Indicators
Rural development indicator A Presentation by Mr Allah Dad Khan Former DG Agr...
Trends of key agriculture and rural development indicators feb 6 2013
Adank monitoring rwsn ms wg_stockholm_aug 2012
 

Similar to Development and use of service delivery indicators for monitoring rural water services in Ghana, Uganda, Burkina Faso, Colombia, Honduras, Paraguay, El Salvador (20)

PPT
Acting on water service monitoring and performance management data in Ghana: ...
 
PPTX
Water service delivery indicators
 
PPT
Costing sustainable services: the life-cycle cost approach
 
PPTX
Smits post construction support
 
PPT
Changing the narrative: from counting infrastructure to monitoring services
 
PPT
Research on profiling of CBMs service delivery model in Uganda
 
PPTX
Lcca for sussvcdelivery_rreddy
 
PPTX
National monitoring of water and sanitation in Uganda
 
PPTX
Post construction support colombia
 
PPTX
Data collection, data use and (sub-) systems building: the SMARTerWASH experi...
 
PPTX
Kumasi wedc 2014 monitoring_why_what_how_costs
 
PPT
Module 1 sustainability (presentation)
 
PPTX
Monitoring-fit for purpose?
 
PDF
Experiences with the Sustainability Monitoring Framework WASH Alliance Intern...
 
PPT
20120516 Triple-S Ghana legacies and scaling up
 
PPT
Sustainable services at scale
 
PPT
20100608 Wash Cost Dgis V4 1
 
PPT
Sustainable services at scale
 
PDF
Acting on water service monitoring and performance management data in Ghana: ...
 
Water service delivery indicators
 
Costing sustainable services: the life-cycle cost approach
 
Smits post construction support
 
Changing the narrative: from counting infrastructure to monitoring services
 
Research on profiling of CBMs service delivery model in Uganda
 
Lcca for sussvcdelivery_rreddy
 
National monitoring of water and sanitation in Uganda
 
Post construction support colombia
 
Data collection, data use and (sub-) systems building: the SMARTerWASH experi...
 
Kumasi wedc 2014 monitoring_why_what_how_costs
 
Module 1 sustainability (presentation)
 
Monitoring-fit for purpose?
 
Experiences with the Sustainability Monitoring Framework WASH Alliance Intern...
 
20120516 Triple-S Ghana legacies and scaling up
 
Sustainable services at scale
 
20100608 Wash Cost Dgis V4 1
 
Sustainable services at scale
 
Ad

More from IRC (20)

PPTX
Financing for WASH in Bangladesh: Macro to micro perspective
 
PDF
Session Building from WASH to IWRM - photo gallery
 
PPTX
Photostory from Norton Town, Zimbabwe.pptx
 
PDF
Climate Resilient Water Safety Plan Implementation
 
PDF
The concept of Climate Resilient WASH
 
PDF
Overview of enabling environment and implementation of climate resilient WASH
 
PPTX
Self-Supply made simple
 
PPTX
Self-Supply made simple
 
PDF
Giving Tuesday 2020 - Don't Give, Take - NL
 
PDF
Giving Tuesday 2020 - Don't Give, Take
 
PDF
Webinar : Adapting your advocacy to COVID-19 health crisis
 
PPTX
Novel partnership between NWSC and Kabarole District to provide safe water to...
 
PPTX
Conflict sensitivity support and tools
 
PPTX
Watershed Mali : strengthening civil society for sustainable WASH-IWRM in Mali
 
PPTX
WASH systems strengthening in the Central African Republic
 
PPTX
Finding the flow in fragile contexts : IWRM in Mali
 
PPTX
Sanitation and hygiene sector trends
 
PPTX
Social accountability : civil society and the human rights to water and sanit...
 
PPTX
Wash Debates: Looking at the role of civil society in achieving SDG 6 by 2030
 
PPTX
The end of the poldermodel? : the role of dissent in Dutch international wate...
 
Financing for WASH in Bangladesh: Macro to micro perspective
 
Session Building from WASH to IWRM - photo gallery
 
Photostory from Norton Town, Zimbabwe.pptx
 
Climate Resilient Water Safety Plan Implementation
 
The concept of Climate Resilient WASH
 
Overview of enabling environment and implementation of climate resilient WASH
 
Self-Supply made simple
 
Self-Supply made simple
 
Giving Tuesday 2020 - Don't Give, Take - NL
 
Giving Tuesday 2020 - Don't Give, Take
 
Webinar : Adapting your advocacy to COVID-19 health crisis
 
Novel partnership between NWSC and Kabarole District to provide safe water to...
 
Conflict sensitivity support and tools
 
Watershed Mali : strengthening civil society for sustainable WASH-IWRM in Mali
 
WASH systems strengthening in the Central African Republic
 
Finding the flow in fragile contexts : IWRM in Mali
 
Sanitation and hygiene sector trends
 
Social accountability : civil society and the human rights to water and sanit...
 
Wash Debates: Looking at the role of civil society in achieving SDG 6 by 2030
 
The end of the poldermodel? : the role of dissent in Dutch international wate...
 
Ad

Recently uploaded (20)

PDF
Charisse Litchman: A Maverick Making Neurological Care More Accessible
PDF
TyAnn Osborn: A Visionary Leader Shaping Corporate Workforce Dynamics
PPTX
Slide gioi thieu VietinBank Quy 2 - 2025
PDF
Tata consultancy services case study shri Sharda college, basrur
PDF
Module 3 - Functions of the Supervisor - Part 1 - Student Resource (1).pdf
PDF
Introduction to Generative Engine Optimization (GEO)
PPTX
Principles of Marketing, Industrial, Consumers,
PDF
Robin Fischer: A Visionary Leader Making a Difference in Healthcare, One Day ...
PPTX
CTG - Business Update 2Q2025 & 6M2025.pptx
DOCX
80 DE ÔN VÀO 10 NĂM 2023vhkkkjjhhhhjjjj
PDF
Susan Semmelmann: Enriching the Lives of others through her Talents and Bless...
PDF
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
PPTX
svnfcksanfskjcsnvvjknsnvsdscnsncxasxa saccacxsax
PPTX
Astra-Investor- business Presentation (1).pptx
PDF
How to Get Business Funding for Small Business Fast
PPTX
BUSINESS CYCLE_INFLATION AND UNEMPLOYMENT.pptx
PPTX
operations management : demand supply ch
PPTX
TRAINNING, DEVELOPMENT AND APPRAISAL.pptx
PDF
PMB 401-Identification-of-Potential-Biotechnological-Products.pdf
PDF
Digital Marketing & E-commerce Certificate Glossary.pdf.................
Charisse Litchman: A Maverick Making Neurological Care More Accessible
TyAnn Osborn: A Visionary Leader Shaping Corporate Workforce Dynamics
Slide gioi thieu VietinBank Quy 2 - 2025
Tata consultancy services case study shri Sharda college, basrur
Module 3 - Functions of the Supervisor - Part 1 - Student Resource (1).pdf
Introduction to Generative Engine Optimization (GEO)
Principles of Marketing, Industrial, Consumers,
Robin Fischer: A Visionary Leader Making a Difference in Healthcare, One Day ...
CTG - Business Update 2Q2025 & 6M2025.pptx
80 DE ÔN VÀO 10 NĂM 2023vhkkkjjhhhhjjjj
Susan Semmelmann: Enriching the Lives of others through her Talents and Bless...
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
svnfcksanfskjcsnvvjknsnvsdscnsncxasxa saccacxsax
Astra-Investor- business Presentation (1).pptx
How to Get Business Funding for Small Business Fast
BUSINESS CYCLE_INFLATION AND UNEMPLOYMENT.pptx
operations management : demand supply ch
TRAINNING, DEVELOPMENT AND APPRAISAL.pptx
PMB 401-Identification-of-Potential-Biotechnological-Products.pdf
Digital Marketing & E-commerce Certificate Glossary.pdf.................

Development and use of service delivery indicators for monitoring rural water services in Ghana, Uganda, Burkina Faso, Colombia, Honduras, Paraguay, El Salvador

  • 1. Development and use of service delivery indicators for monitoring rural water services in Ghana, Uganda, Burkina Faso, Colombia, Honduras, Paraguay, El Salvador Monitoring Sustainable WASH Service Delivery Symposium Addis Ababa, 10 April 2013 By: Marieke Adank, Stef Smits, Valérie Bey, Jeske Verhoeven and Christelle Pezon
  • 2. What are service delivery indicators? • Set of indicators for assessing and monitoring rural water service delivery: – the level of water service provided – the performance of service providers – the performance of service authorities Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 3. Service level Criterion, measured through the following indicators: • Reliability • Accessibility • Water quantity • Water quality • User satisfaction • Affordability Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 4. Example of service level indicator scores Akatsi district, Volta region, Ghana Functionality Reliability Crowding Service level Quantity Distance Quality Number of point sources: 249 Functional: 67% Reliable: 69% Distance: 83% Non-crowding: 72% Quality: 94% Quantity: 51% Service level Basic services: 34% Sub-standard services: 38% Not providing services: 29% Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 5. Service provider indicators Indicators related to the following criteria: • Organisation and governance • Administration and accountability of the service provider • Financial management • Technical and operational management Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 6. Service authority indicators Indicators related to the following criteria: • Capacity of service authority • Strategic planning Authority functions • Coordination • Pre-construction support • Monitoring Support functions • Technical assistance to service provider Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 7. Scoring of indicators • Use of narrative scoring tables, to convert data on parameters into quantitative indicator scores • Benchmark set at minimum normative level Score Narrative description Example: There is a WSMT. Its composition is in line with the CWSA 100 guidelines and its members have received refresher training Indicator: A well qualified and on at least bi-annual basis trained gender balanced WSMT is in 75 There is a WSMT. Its composition is in line with the CWSA guidelines and its members have received refresher training place on an irregular basis Benchmark: There is a WSMT. Its composition is in line with Parameters: 50 the CWSA guidelines (Gender Balance; separated cashiering • Number of male and female function and caretaking function; Vendors are engaged at each water point) and it has received initial training members There is a WSMT, which has been composed in line with the CWSA guidelines (Gender Balance , separated cashiering • Separate cashier and caretaker 25 function and caretaking function, vendors engaged at each water point), but the WATSAN has not received initial functions training • Number of vendors The composition of the WSMT is not in line with the CWSA guidelines (Gender Balance and / or no separated cashiering • Training of WSMT 0 function and caretaking function and / or vendors are not engaged at each water point) Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 8. Aggregation of scoring • Proportion of units (systems, service providers, service authorities) meeting the benchmark • Sum of scores on indicators or criteria • Averages of scores on indicators or criteria Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 9. Example of aggregated scores per area (district) 100% % of WATSANs meeting the 90% 80% 70% 60% benchmark 50% 40% 30% 20% 10% Akatsi 0% East Gonja Periodic maintenance maintenance interference Record keeping and Water quality testing Financial management Area mechanic services Spare part supply Composition of expenditure balance Tariff setting No political Corrective accountability Sunyani West WATSAN Revenue and 100 90 80 Average score 70 60 50 Akatsi 40 30 East Gonja 20 10 Sunyani West - Average governance indicators Average of operationalAverage of financial management indicators indicators Monitoring Sustainable WASH service Delivery Symposium April 2013 Source: Adank et al, 2013
  • 10. Use and data requirements • To enforce regulation and inform asset Regular overview of all service management and post construction level and service provider indicator activities at decentralised level scores on (ideally) all units • To inform service regulation and macro Annual overview of differences in level planning at national level scores on indicator sets between areas • To monitor progress against planned ‘Before’ and ‘after’ assessment in outcomes of interventions intervention area • To inform policy dialogue and debate Analysis of correlations between different indicators Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 11. SDIs in national monitoring systems • SDIs have been developed based on national norms and standards • Development and testing has taken place in close collaboration with stakeholders, led by government • Interest by national and local governments to scale up and institutionalize the use of SDIs Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 12. Lessons learnt • Service delivery indicators are essential for assessing and monitoring water service delivery • Service delivery indicators need to follow government’s norms and standards. • Developing and using indicators may spark further development of these norms and standards. • More indicators means more data collection efforts and possibly resources needed. – However, resources related to monitoring mostly related to travel and transport • Need to find a balance between the amount and accuracy of data required at different levels, and the efforts it takes to collect this data Monitoring Sustainable WASH service Delivery Symposium April 2013
  • 13. Thank you! For further information, please visit: • www.irc.nl • www.washcost.info • www.waterservicesthatlast.org Monitoring Sustainable WASH service Delivery Symposium April 2013

Editor's Notes

  • #2: Over the last years, IRC has been involved in the development and use of service delivery indicators in a range of countries. This includes ourinvolvement in (i) assessing service levels in relation to life-cycle costs in Ghana, Burkina Faso, Mozambique and India (WASHCost) (ii) monitoring water services in Ghana and Uganda (as part of the Triple-S initiative) and in Burkina Faso (under the WA-WASH / Triple-S initiative); (iii) monitoring the sustainability of service delivery in Latin America (Smits et al., 2013 forthcoming); and (v) studying the impact of post-construction support in Colombia (Smits et al., 2012). In this presentation, I will go into how service delivery indicators were generally conceptualized, defined and used in these countries.
  • #3: Let me start with giving you a better idea of what we are talking about, when we mentioned “service delivery indicators”. Service delivery indicators are a set…. It generally consists of 3 groups of indicators:…. We will
  • #4: Give examples of parameters. E.g. tine spend. Country specific. And
  • #10: At different levels there may be an interest in different ways of aggregation of indicator scores. Districts may be more interested in the details on each indicator, as that may inform corrective action they can undertake, while national gov may be ore interested in average scores per indicator group, to inform regulation and allocation of funds.
  • #11: So there are different uses of the service delivery indicators at different levels.
  • #12: Ghana: district taking initiative to do repeat data collection. CWSA committed to scale up use of SDIs and integrate them in national monitoring system