Performance Measurement Summit
Download as PPT, PDF0 likes409 views
The document discusses performance measurement in the U.S. Coast Guard. It outlines requirements from the Government Performance and Results Act (GPRA) and OMB for strategic plans, performance plans, and performance reports. It describes using a logic model to link activities, outputs, and outcomes. Examples are provided of logic models for Coast Guard programs. The importance of defining measurements, collecting data, reporting results, and using results to refine measurements and targets is discussed. Campaign planning requirements and components are also summarized.
Performance Measurement Summit
- 1. LCDR Bill Butler U.S. Coast Guard Headquarters Commandant (CG-512) Office Performance Management & Assessment Performance Measures OVERVIEW
- 2. Office of Boating Safety Performance Measurement Performance Measurement Improvements cannot be made without measures Today’s discussion… Why we’re doing performance Measurement The Logic Model CG-541 Waterways Management Reviewing Performance Data Campaign Plan Requirements
- 3. Public Law 103-62 1.1 Government Performance & Results Act (GPRA)
- 4. 1.2 OMB Guidance & Requirements – Circular A-11
- 5. 1.3 OMB’s Program Assessment Rating Tool (PART)
- 6. Strategic Plans (Submission Year + 5 years forward) Mission Statement Goals & Objectives Intent Key Factors Performance Plans ( Annual ) Verifiable Output, Service Level, & Outcome Measures Tangible, measurable performance targets Performance Reports ( Annual ) Actual performance, and remediation intentions 1.4 GPRA & OMB Requirements
- 7. 1.5 GAO Assessments of USCG
- 8. When we're finished, program managers will be able to use the information from the dashboard measures to assess performance and goals across program 1.6 Purpose and Vision Vision : Build program dashboard measures that will enable program managers to ensure the effective and efficient use of Coast Guard resources to achieve results.
- 9. Data Meets OMB, GAO & DHS Requirements Data Measurement Card for each Measurement Data Measurement Card captures… Measurement Name Measurement Description Measurement Algorithm Measurement Type (Outcome, Output, Activity) Frequency of Collection Data Source (Where the data is extracted from) Data Scope & Limitations 1.7 Data Specification Requirements
- 10. True or False? The Coast Guard will use Performance Measurement Data to change billets. FALSE! The information acquired by our office is used only for the development of your unit’s scorecards and dashboard measurements.
- 11. True or False? 2. Some of the activities we do you really can’t measure. FALSE! If we do then we measure it!
- 12. True or False? 3. You can’t measure this because we have no data collected on it. FALSE! When we do our data collection, we will look for where data may come from, even if it comes from a non-government source.
- 13. True or False? 4. Our office will be critiquing your performance information. FALSE! Our goal is to help facilitate the development of your program’s scorecard. Program managers will be the ones reviewing actual performance. We do request performance data for OPG, RAP, BBD, and Campaign Plans.
- 14. True or False? 5. Using performance measurement data makes better arguments for additional resources. True! How can you legitimately request more resources when you have nothing to back up your request?
- 15. True or False? 6. Performance measurement gives you the opportunity to make a compelling argument for what you do. True! A good performance measurement communicates worth!
- 16. Logic Model Purpose: To show how your day-to-day activities effect the organization Outcomes. 4. Performance Logic Model (skeletal) 2.1 The Logic Model Capabilities Activities Outputs Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures 1 2 3 4 5
- 17. Risk Management System 2.2 The Original Logic Model
- 18. Helps us explain to GAO, OMB and DHS the stem-to-stern logic of our world of work. It’s a process for getting to our measurements and measurement development. It gets people to see how their work affects missions and outcomes It shows the interdependency of all our missions. 2.3 Why the Logic Model?
- 19. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.4 Logic Model – Purpose The Public benefits we aim to influence. Capabilities Activities Outputs Outcomes Activity Measures Output Measures Outcome Measures 1 Mission Purpose & Goals Capability Measures
- 20. What does the public expect from us? What Strategic Goals are we aiming to achieve? Helps us explain to GAO, OMB and DHS the logic of our world of work. Conduct a situation analysis: Identifying your strengths and weaknesses identifying trends that might impact our business in the next 5-7 years Define key success factors and business fundamentals What success factors are or are NOT And, if I hear… “We facilitate commerce…” 2.4b Logic Model – Mission & Purpose?
- 21. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.5 Logic Model – Outcomes Benefits provided as a direct result of USCG products & services Capabilities Activities Outputs Outcomes What is the greater “societal” Outcome? Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures
- 22. What is the “greater good” to society? How are you going to measure this “greater good?” If you use “Economic Impact” or other monetary figures or numbers be prepared for some in-depth research. Many Outcome measurements presented to our office are NOT Outcome measurements. Give The Outcome Measurements Test to your measurement… Does the public care about this?” 2.5b Logic Model – Outcomes
- 23. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.6 The Logic Model – Outputs Products & services provided as a direct result of USCG work. Capabilities Activities Outputs What is the impact of this Output? Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures
- 24. The End Result of the goods & services we provide! COI CG License Cleared Channel BNTM A working ATON A successfully transited vessel Ask: What impact is our Outputs having on the desired Outcome? Assess: The effectiveness of this work. Do we need all deployed ATON in a specific channel? 2.6b Logic Model – Outputs
- 25. 4. Performance Logic Model (skeletal) 2.7 The Logic Model – Activities The work performed by USCG resources. Capabilities Activities Why do we do this Activity? Outputs Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures 1 2 3 4 5
- 26. Usually the easier to do Activities are the events that go into producing the Output. For example, to get a COI Inspect Life Saving Equipment Inspect Fire Fighting Equipment Inspect Navigation systems Inspect stability and subdivision Ask: What impact is our activities having on the desired Output? Assess: The effectiveness of this work. Do we really need to be inspecting lifejackets? 2.7b Logic Model – Activities
- 27. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.7 The Logic Model – Capabilities The state of Readiness and the Capabilities needed to perform USCG work. Capabilities Activities Outputs Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures
- 28. Our office does NOT facilitate “Capability” and Readiness Separate program in CGHQs does (CG-7) Owners of Mission Outcome (MS, MEP, WM, SAR, DR, MLE, PWCS) are responsible for conveying their needs. 2.7b The Logic Model – Capabilities
- 29. Make sure Data Measurement Card captures… Measurement Name Measurement Description & Definition Measurement Algorithm Measurement Type (Outcome, Output, Activity) Frequency of Collection Data Source (Where the data is extracted from) Data Scope & Limitations 2.8 Logic Model – Measurements
- 30. 3.1 Waterways Management Logic Model VTS
- 31. Organizational Outcomes 3.2 CG-541 Waterways Management Logic Model Maritime Safety Maritime Security Environmental Stewardship Primary Collateral Waterways Response & Restoration Efficient & Available Waterways Readiness Equipment Infrastructure Information People Training Mission Activities Traffic Control / Navigation Assistance Bridge Administration Aids To Navigation Marine Information Waterway Access & Usage Domestic Ice Breaking Mission Outputs Directed Navigation Management Bridge Actions & Permits Marked Channel Information for the Mariner Waterway Access Controls Cleared Channel Mission Outputs Directed Navigation Management Bridge Actions & Permits Marked Channel Information for the Mariner Waterway Access Controls Cleared Channel
- 32. 3.3 CG-541 Waterways Management Logic Model
- 33. Current Measurement: Number of days Waterways closed 3.3 Current Domestic Ice Measurements
- 34. Great Lake Pilotage They produce one regulation per year. Polar Ice Breaking They make one trip to the South Pole per year International Ice Patrol No Icebergs reported in shipping lanes. Vessel Traffic Service They moved the office out of Waterways and into CG-7 (Capabilities) Bridge Admin some permits take years to develop 3.4 Challenges to Waterways Measurements
- 35. Proper Representation during workshops Over-represented on Bridges Under-represented on Ice Developing the master WWs Logic Models required concurrent individual program development It was easy to test the viability of measures . Measurement definition caused lots of work What’s a “transit” What’s a “vessel” What’s a “delay” Merging of several cultures into one Directorate And, if I hear… “We facilitate commerce…” 3.5 Lessons Learn from Waterways Management
- 37. Requires that measurements are Reported Don’t be afraid of the results… Having bad results is better than no system of measurement at all Constantly Assess your Measurements Is the measurement giving me what I need to know? Are there other sources of data? Be prepared to explain your results Determine the Frequency of Reporting 4.1 Reviewing Performance Data
- 38. 4.2 Program Results – Reporting Outcomes
- 39. How many delays / district / period ? What waterways were affected? What were the results of these delays? 4.3 Program Results – “Drill Down”
- 40. 4.4 Program Results – Report “Causes” No. of channels cleared No. of Assists SAMPLE Report Comments: 6 5 4 3 2 1 Cause Time of delay Section Effected Date Name of Critical Waterway Comments: Hrs 07 06 05 04 03 This Year Last Four Ice Seasons
- 41. Where do we go from here? Continue refining & defining measures Develop Targets Develop Efficiency Measures Continue assessing Risk & Risk “buy down” Develop Sensitivity Analysis Develop costs and costing models We can’t do any of these unless we’re measuring! 4.4 The Way Ahead
- 42. Simplified Planning Process 5.1 Campaign Planning Process
- 43. Seven Program Missions Marine Safety Marine Environmental Protection Waterways Management Ports, Waterways, & Coastal Security Search and Rescue Maritime Law Enforcement Defense Readiness 5.2 Campaign Plans Required for…
- 44. PART 1: Program Mission Introduction Mission and Vision Guiding Principles Roles, Responsibilities, and Mission Business Case Linkage with Departmental and Executive directives 5.3 Components of a Campaign Plan
- 45. PART 2: Strategic Assessment Key Outcome Measurements Current Performance Targeting Objectives and Strategies Opportunities and Challenges Performance Gaps and Issues ACCCP Gaps and Issues 5.4 Components of a Campaign Plan
- 46. PART 3: Action Plans Initiative Synopsis of the Initiative A“1-minute Elevator summary Situation-Needs Assessment The “necessity” of the situation Proposed Course of Action Benefits, Costs and Risks Illustrations 5.5 Components of a Campaign Plan