Performance Management Framework
Performance Management FrameworkPernilla UlfvengrenKTH Royal Institute of Technologypernilla.firstname.lastname@example.orgPage 2MASCAMASCA change processPage 3Identification of needs and goalsPlan and prepare changeExecute Implement plan and Monitor changeGAPReview and ReinforceGAPEnablers for changeCMS toolboxCapability CompetenceGAPDevelop / implement:
Learning, Training, MentoringEnabling technologies Organisational processesDevelop Enablers for ChangeHumans, Technology, InformationApply Enablers on IPERManagement controlThe purpose is to have intentional impact on operations, executives and personnel towards certain objectives.
4MASCAPerformance managementThe essential components of PM is to measure and monitor.Monitoring a process is to systematically measure it.Process control basics (Single or Double loop)
Performance indicators:Indicators are proxy measures for items identified as important in the underlying model(s) of safety. As such they are uncertain and often only distantly connected to idealised measures that are rarely available in practice.A word of caution by Wreathall (2009)
Indicators objectives7MASCASafety Management SystemSMS (ICAO, 2009)Performance-based vs Outcome-basedIntegrated management system for safetySafety policy Safety model, management commitment, appointments, documentation etc.Safety risk management Hazard identification, Risk assessment and mitigationSafety assurance Safety performance monitoring and measurement, management of change, continuous improvement of the SMSSafety promotion and training Training, eduction, safety communicationSafety performanceFrom outcome based to performance based
Safety Performance Indicators, Targets and Requirements
Effectiveness of the SMS, how well it performs and manage to improve the system.
Its change capability!MASCA9Purpose of SPIsPrimarily:Support of and control in the risk management process.But also:Support the relation with over-sight authorities.MASCA1010Process and PerformanceWhat influence the process risk and performance?Where in process is it most likely safety is affected, risk emerge?Where in process might consequences of this be manifested?Classification of process influences using the SCOPE model:
EffectContextPersonal; Organisational; EnvironmentalProcessOrganisingCompetence; Procedures; Leadership; Coordination; Automation; FeedbackSupplyTeamInformationMaterialSCOPE Process & Performance AnalysisProcess Performance Indicators Safety Performance Management FrameworkPROCEDURALPM STRUCTURAL PMMASCA/CMS/New HUMAN FACTORS modelProcedural framework, 8-step processMASCA14Safety data dissemination loop1. A performance measure and monitoring framework with a model for key performance indicators.2. Capability to aggregate data to appropriate level for decision makers. 3. A PM framework for strategic decision making and priority.4. A PM framework to dis-aggregate the data triggering performance measure(s) and stakeholder(s).Safety data driven change loop5. Develop appropriate enablers 6. Apply enablers to IPER process7. Coordinate and evaluate change with other ongoing change initiatives.Evaluation and improvement of PM framework8. Evaluating current KPIs/SPIs using measuring and monitoring and operational performance data.FSQBCMSStructural frameworkEnabling technologiesInformation support technologiesStatistical toolsData management (gathering, storing, retreiving) toolSASs Vision Monitor Process modelsDependenciesProcess analysis, indicator identificationSCOPE model and toolOrganisational structureIndicators list, logic and weightsList of indicators and measuresDefinitions and logic descriptions Weight and dependencies (antecedents, leading or lagging)Data modelSPIs, KPIs, combined SPIs/KPIs Indicators linked to operational process and system functionalityData mining modelStatistical analyses models
Safety - EfficiencySafety Measures (SPIs) OFRejected takeoff high speedEmergencyTakeoff warningRunway/taxiway incursionRunway /taxiway excursionAltitude penetrationHard LandingGPWS mode 1-4Stick shakerTail strikeBirdstrikeBirdstrike damageTCASWake turbulenceSignificant weatherAirport facilitiesCabin safetyNormal operations (SPI/KPI) OFLine check level 1Line check level 2Line check level 3Cabin safety monitoringUnstabilized approaches at 500 ftUnstabilized approaches at 1000 ftFDM, 200 kts / 2 minsFDM, GPC/OPC result (DPunctuality P3 events (Punctuality P15Planning precisionFuel efficiency indexRegularityOperational costs
MASCA16Analysis methodsData mining and analysis applicationsAssociation analysis (Market basket)CorrelationRegressionTrend analysisMulti-attribute Comparative analysis
MASCA17Page 18Thank you for your attention