Pm Toolbox Nlr Final
- 2. Performance Management Framework Pernilla Ulfvengren KTH Royal Institute of Technology pernilla.ulfvengren@indek.kth.se MASCA Page 2
- 3. MASCA change process Enablers for change •CMS toolbox Identification of GAP needs and goals •Capability •Competence Plan and prepare change Develop / implement: Execute – •Learning, Training, Mentoring GAP Implement plan and •Enabling technologies Monitor change •Organisational processes Review and GAP Reinforce Develop Enablers for Change Humans, Technology, Information Apply Enablers on IPER Page 3
- 4. Management control • The purpose is to have intentional impact on operations, executives and personnel • towards certain objectives. MASCA 4
- 5. Performance management • The essential components of PM is to measure and monitor. • Monitoring a process is to systematically measure it. • Process control basics (Single or Double loop) • Performance indicators: “Indicators are proxy measures for items identified as important in the underlying model(s) of safety. As such they are uncertain and often only distantly connected to idealised measures that are rarely available in practice”. – A word of caution by Wreathall (2009)
- 7. Indicators objectives measures of routine safety related activities measures of failures (deviations) detected during these activities measures of events (incidents) that occur during operations MASCA 7
- 8. Safety Management System • SMS (ICAO, 2009) • Performance-based vs Outcome-based • Integrated management system for safety 1. Safety policy Safety model, management commitment, appointments, documentation etc. 2. Safety risk management Hazard identification, Risk assessment and mitigation 3. Safety assurance Safety performance monitoring and measurement, management of change, continuous improvement of the SMS 4. Safety promotion and training Training, eduction, safety communication
- 9. Safety performance • From ”outcome based” to ”performance based” • Safety Performance Indicators, Targets and Requirements • Effectiveness of the SMS, how well it performs and manage to improve the system. • It’s change capability! MASCA 9
- 10. Purpose of SPI’s • Primarily: “Support of and control in the risk management process.” • But also: “Support the relation with over-sight authorities.” MASCA 10
- 11. Process and Performance • What influence the process risk and performance? • Where in process is it most likely safety is affected, risk emerge? • Where in process might consequences of this be manifested? • Classification of process influences using the SCOPE model: Organising Competence; Procedures; Leadership; Coordination; Feedback; Automation Supply Team Process Effect Information Material Context Person; Organisation; Environment
- 12. SCOPE – Process & Performance Analysis Organising Competence; Procedures; Leadership; Coordination; Automation; Feedback Supply Team Process Effect Information Material Context Personal; Organisational; Environmental Process Performance Indicators
- 13. Safety Performance Management Framework PROCEDURAL STRUCTURAL PM PM MASCA/CMS/New HUMAN FACTORS model
- 14. Procedural framework, 8-step process Safety data dissemination loop 1. A performance measure and monitoring framework with a model for key performance indicators. 3 2. Capability to aggregate data to appropriate level for decision makers. 2 4 3. A PM framework for strategic decision making and priority. 4. A PM framework to dis-aggregate the data triggering performance FSQB measure(s) and stakeholder(s). Safety data driven change loop 1 5 5. Develop appropriate enablers 6. Apply enablers to IPER process CMS 7. Coordinate and evaluate change with other ongoing change initiatives. Evaluation and improvement of 8 6 PM framework 8. Evaluating current KPIs/SPIs using measuring and monitoring and 7 operational performance data. MASCA 14
- 15. Structural framework • Enabling technologies • Organisational structure – Information support • Indicators list, logic and weights technologies – List of indicators and measures – Statistical tools – Definitions and logic descriptions – Data management – Weight and dependencies (gathering, storing, (antecedents, leading or lagging) retreiving) tool • Data model – SAS’s Vision Monitor – SPIs, KPIs, combined SPI’s/KPIs • Process models – Indicators linked to operational – Dependencies process and system functionality – Process analysis, indicator – Data mining model identification – Statistical analyses models – SCOPE model and tool
- 16. Safety - Efficiency Safety Measures (SPI’s) OF Normal operations (SPI/KPI) OF • Rejected takeoff high speed • Line check level 1 • Emergency • Line check level 2 • Takeoff warning • Line check level 3 • Runway/taxiway incursion • Cabin safety monitoring • Runway /taxiway excursion • Altitude penetration • Unstabilized approaches at 500 ft • Hard Landing • Unstabilized approaches at 1000 ft • GPWS mode 1-4 • FDM, 200 kts / 2 mins • Stick shaker • FDM, G • Tail strike • PC/OPC result (D • Birdstrike • Punctuality P3 events ( • Birdstrike damage • Punctuality P15 • TCAS • Wake turbulence • Planning precision • Significant weather • Fuel efficiency index • Airport facilities • Regularity • Cabin safety • Operational costs MASCA 16
- 17. Analysis methods • Data mining and analysis applications – Association analysis (Market basket) – Correlation – Regression – Trend analysis – Multi-attribute – Comparative analysis MASCA 17
- 18. Thank you for your attention … Page 18