Module N° 5 – State ALoS

SSP – A structured approach

Module 2Basic safety management

concepts

Module 3 ICAO SARPs related

to safety management

Module 4 ICAO SSP framework

Module 5State ALoS

Module 6 Prescription /

Performance based environment

Module 8SSP familiarization plan

Module 1 Introduction to the SSP familiarization

course

Module 7 SSP training programme

Module 5State ALoS

At the end of this module, participants will be familiar with the

concepts and dimensions underlying the acceptable level of

safety (ALoS) related to an SSP

Objective

Introductory concepts

Acceptable level of safety (ALoS)

ALoS related to an SSP

Summary

Questions

Contents

The development and implementation of ALoS builds upon certain basic concepts of systems theory

There is a hierarchy underlying the progression of these basic concepts towards the development and implementation of ALoS

Understanding of the concepts and hierarchy is an essential foundation for the development and implementation of ALoS and the SSP

Introductory concepts

1. Safety – as defined by Doc 98592. Level of safety – degree of safety of a system, representing

the quality of the system, safety-wise, expressed through safety indicators

3. Safety indicators – parameters that characterize and/or typify the level of safety of the system

4. Safety targets – concrete objectives to be achieved5. Acceptable level of safety – minimum degree of safety that

must be assured by a system in actual practice6. Value of a safety indicator – quantification of a safety

indicator7. Value of a safety target – quantification of a safety target

Introductory concepts – The basic theory

The selection of appropriate safety indicators is an essential foundation for the development and implementation of ALoS

The selection of safety indicators is a function of the detail to which the level of safety of the system is to be represented

Meaningful safety indicators must be representative of the elements that characterise system safetyAccidents/accident ratesIncidents/incident ratesLevel of regulatory compliance…

Introductory concepts – Selection of safety indicators

Safety indicators Fatal airline accidents/serious incidentsRunway excursion events/ground collision eventsDevelopment/absence of primary aviation legislationDevelopment/absence of operating regulationsLevel of regulatory compliance…

Safety targetsReduction in fatal airline accident/serious incidentsReduction in runway excursion events/ground collision

eventsNumber of inspections completed quarterly…

Introductory concepts – The basic theory: examples

Introductory concepts – The basic theory: examples

Value of safety indicators

1. [Rate/number] Fatal airline accidents per [number] operations

2. [Rate/number] Runway excursion events per [number]

operations3. [Rate/number] Ground

collision events per [number] operations

4. [Number] inspections to operators completed [timeframe] ...

Value of safety targets

1. [Reduction by/maximum] fatal airline accidents per [number] operations

2. [Reduction by/maximum] runway excursion events per [number] operations

3. [Reduction by /maximum] ground collision events per [number] operations

4. [Minimum number] of inspections completed [timeframe]…

Safety measurement Generally associated to the SSPQuantification of outcomes of selected high-level or high-

consequence eventsAccident rates Serious incident rates

Quantification of selected high-level State functionsDevelopment/absence of primary aviation legislationDevelopment/absence of operating regulationsLevel of regulatory compliance

A measure of achievement of high-level safety objectives of safety interventions and/or mitigations strategies

Introductory concepts – A fundamental differentiation

Safety performance measurement Generally associated to an SMS Quantification of the outcomes of selected low-level, low-

consequence processesNumber of FOD events per number of ramp operationsNumber of ground vehicle events in taxiways per

number of airport operations…

A measure of the actual performance of safety interventions and/or mitigation strategies, beyond accident rates and regulatory compliance

Introductory concepts – A fundamental differentiation

Safety measurement

Not a continuous processA spot checkConducted following pre-specified timeframes

Safety performance measurement

Continuous processMonitoring and measurement of selected operational

activities necessary for the provision of services

Introductory concepts – A fundamental differentiation

The acceptable level of safety (ALoS) to be achieved shall be

established by the State

When establishing ALoS, consideration must be given to

The level of safety risk that applies

The safety risk tolerance

The cost/benefits of improvements to the aviation system

The public expectations in civil aviation system

Basic safety management SARPs

Values of safety indicators and values of safety targets

Initial ALoS – Quantitative action statements on selected high level/high consequence outcomes (safety measurement)

Mature ALoS – Quantitative action statements on selected high level/high consequence events (safety measurement) and low level/low consequence outcomes (safety performance measurement)

Expressing the ALoS

Examples of values of safety indicators and safety targets based on safety measurement

Values of safety indicators

1. [Number] CFIT and approach & landing accidents per [number] departures

2. [Number] runway excursions per [number] operations

3. [Number] ground collision accidents per year on a [x-year] rolling average

4. [Number] of high-severity events captured through the State MOR yearly

5. [Number] inspections to operators completed quarterly

6. [Number] AIS facilities with QMS implemented

7. Electronic filing of differences completed within [number] months/weeks

Values of safety targets1. [Reduce by/maximum] CFIT and approach

& landing accidents per [number] departures

2. [Reduce by/maximum] runway excursions per [number] operations

3. [Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average

4. [Minimum number] of high-severity events captured through the State MOR yearly

5. [Minimum number] inspections to operators completed quarterly

6. [Number] AIS facilities with QMS implemented by [time]

7. Electronic filing of differences completed within [revised number] months/weeks

Tools and means to deliver the safety targets of an SSP

Operational procedures

Technology

Systems

Training programmes

Delivering ALoS – Safety action plans

In the longer-term, once States develop safety data collection

and analysis capabilities under the Safety Assurance

component of the SSP, ALoS should reflect a combination of

safety measurement

safety performance measurement

ALoS – Mature SSP

Examples of values of safety indicators and targets based on safety performance measurement

Values of safety targets

1. [Reduce by/maximum] number of level busts per [number] operations by [date]

2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date]

3. [Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date]

4. [Reduce by/maximum] number of non-conforming approaches (NCA) at 5 international [State] airports by [date]

5. [Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date]

Values of safety indicators

1. [Number] level busts per [number] operations

2. [Number] Cat B and C runway incursions in 5 international [State] airports per

[number] operations

3. [Number] TCAS/airprox events per [number] operations

4. [Number] non-conforming approaches (NCA) at 5 international [State]

airports per [number] operations

5. [Number] apron FOD events at 5 international [State] airports per [number] operations

Establishing ALoS related to an SSP

does not replace legal, regulatory, or other already established requirements, but it must support compliance with them

leaves unaffected the obligations of States, and does not relieve States from compliance with SARPs

ALoS – Legal considerations

ALoS – Initial (Safety measurement)

Values of safety targets

1. [Reduce by/maximum] CFIT and approach and landing accidents per [number] departures

2. [Minimum number] inspections to operators completed quarterly 3. ...

Actionplans

1. CFIT training package distributed to industry and supported by training courses

2. Revision and if necessary update of hiring policy. Inspection manual updated

3. ...

Values of safety indicators

1. [Number] CFIT and approach and landing accidents per [number] departures

2. [Number] inspection to operators completed quarterly3. ...

State Will comply all applicable international standards.

ALoS – Mature (Safety performance measurement)

Values of safety targets

1. [Reduce by/maximum] non-conforming approaches (NCA) at 5 international airports per [number] arrivals by [date]

2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date]

3. …

Actionplans

1. Constant Descend Arrivals (CDA) procedures implemented – Arrival procedures charts designed for stabilized approaches

2. Installation of ASDE/X in 5 international [State] airports3. ….

Values of safety indicators

1. [Number] non-conforming approaches (NCA) at 5 international airports [State] per [number] operations

2. [Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations

3. …

State Will comply all applicable international standards.

Transition from initial to mature ALoS

Initial ALoS

(Safety measurement)

Quantification of outcomes of selected high-level/high-consequence events

Quantification of selected high-level State functions

State safety assurance

Safety oversight

Safety data collection, analysis and exchange

Safety data driven targeting of oversight on areas of greater concern or need

Mature ALoS(Safety measurement and

safety performance measurement)

Quantification of outcomes of selected high-level/high-consequence eventsQuantification of selected high-level State functionsQuantification of outcomes of selected low-level/low-consequence events

Timeline

Summary

ATS Service provider

Aerodrome operator AMOAircraft

operator N° 1

SSPSSP(ALoS)(ALoS)

ATS Service provider

Aerodrome operator AMO

Aircraft operator N° 2

Training organization

SMSSMS SMSSMS SMS

State accepts and oversees individual service providers’ SMS

Safety performance

State accepts and oversees individual service providers’ SMS

State agrees and supervises individual service provider’s SMS safety performance

Safety performance Safety performance Safety performance Safety performance

Safety performance Safety performance Safety performance Safety performance Safety performance

Trainingorganization

SMS SMS SMSSMS SMS

Questions?

State acceptable level of safety (ALoS)

Module N° 5 – State ALoS