Abstract

The purpose of this guidance is to describe the list of SESAR maturity criteria that will be applied to assess the maturity status of the SESAR Solutions in the context of SESAR2020. The maturity criteria address E-OCVM levels V1, V2 and V3 for SESAR ATM Solutions and TRL levels TRL2, TRL4 and TRL6 for SESAR Technological Solutions. The document includes a set of TRL7 related criteria for the scope under the responsibility of the Very Large Demonstrations (VLDs).

The SESAR Maturity Criteria also provides a set of maturity criteria that will be applied to topics under the scope of the Exploratory Research Projects (both fundamental and applied oriented ones) and for the three E-OCVM phases that are the scope of SESAR2020, V1, V2 and V3 phases.

Introduction to SESAR Maturity Criteria

Edition date: 05 October 2018 Edition: 01.01.03

EDITION 01.01.03

2

© – [2018] – SJU

Authoring & Approval

Author(s) of the document

Name Position/Title Date

Alfredo Gomez de Segura Head of Release Management and Validation

28/10/2016

Reviewed by

Name Position/Title Date

Benoit Fonck Chief Development & Delivery 28/10/2016

Approved by

Name Position/Title Date

Benoit Fonck Chief Development & Delivery 28/10/2016

Document History

Edition Date Status Author Justification

00.01.00 18/10/2016 Approved Alfredo Gomez de Segura

Ready for publication

00.01.01 31/01/2017 Approved Alfredo Gomez de Segura

Updated based on the review of maturity criteria by SESAR 2020 members

00.01.02 04/08/2017 Mark Watson Removed embedded Maturity Criteria Excel file, to ensure one Maturity Assessment Tool is the sole reference for Maturity Criteria

01.01.02 16/08/2017 Approved Alfredo Gomez de Segura

Ready for publication

01.01.03 05/10/2018 Mark Watson Maturity assessment tool only available on STELLAR. Updated reference to FAQ.

INTRODUCTION TO SESAR MATURITY CRITERIA

© – [2017] – SJU 3

EDITION 01.01.03

4

© – [2018] – SJU

Table of Contents

1 Introduction ............................................................................................................... 5

1.1 Purpose of the document............................................................................................... 5

1.2 Maturity assessment ..................................................................................................... 5

1.3 How to start? ................................................................................................................ 5

1.4 Glossary of terms ........................................................................................................... 6

1.5 Acronyms and Terminology ........................................................................................... 6

2 SESAR Maturity Criteria.............................................................................................. 8

2.1 List of SESAR Maturity Criteria ....................................................................................... 9

2.2 SESAR Maturity Criteria Threads .................................................................................... 9

2.3 Possible answers to each maturity criteria ................................................................... 10

3 References ............................................................................................................... 11

List of Figures

Figure 1: Gates and phases of the SESAR Solution Development Life Cycle ...................................... 8

List of Tables

Table 1: Possible answers to maturity criteria ................................................................................ 10

INTRODUCTION TO SESAR MATURITY CRITERIA

© – [2017] – SJU 5

1 Introduction

1.1 Purpose of the document

This document includes the list of SESAR maturity criteria that will be applicable to assess the maturity progress of the SESAR Solutions in the context of SESAR 2020, from an early stage of maturity e.g. exploratory research topic up to the transition towards industrialization e.g. scope of demonstration activities.

1.2 Maturity assessment

Maturity assessment analyses results from project activities i.e. concept validation activities to assess the progress of R&D work for a given SESAR Solution through the E-OCVM and TRL scales.

It relies on content and evidences captured in deliverables e.g. SESAR Solution data-pack produced by projects in the frame of SESAR 2020 and/or past R&D activities i.e. SESAR 1.

The maturity assessment consists of checking whether or not the set of SESAR maturity criteria for a given V / TRL maturity Phase are successfully achieved for a SESAR Solution under analysis and is supported by a maturity assessment tool (MAT) provided by the SJU. More than stating if a criterion is achieved or not, the key objective is to ensure that there are documented evidences that support that assessment.

The information related to individual SESAR Solution maturity assessments is collected, baselined and stored in an integrated database. A consolidated Maturity report is generated by the SJU on an annual basis. The maturity baseline is also an input to the Release Strategy report.

SESAR Solution(s) maturity will be assessed, using the SESAR Maturity criteria, at the Maturity Gates. Projects plan SESAR Solution Maturity Gates in accordance with the project progress and in line with the milestones identified in the Grant. When planning their activities, Solution projects have to consider the Programme milestone calendar e.g. delivering in due time the required data packs and scheduling in due time the V3 maturity Gate, the resulting SESAR Solutions are available for the related Release Close out.

However, the SESAR Maturity criteria should be taken into consideration at any time during the SESAR Solution lifecycle. At the beginning of a given V / TRL Phase, understanding the expectations at the end of V / TRL phase e.g. at VALR / TVALR, SPR-INTEROP/OSED level will help the project to produce the VALP / TVALP.

1.3 How to start?

1. What is the reference material I need to consult?

– Introduction to SESAR Maturity Criteria: it is this document that provides as well the SESAR Maturity Criteria;

2. What is the MAT Tool?

– MAT Tool: It is a tool that integrates the SESAR Maturity Criteria and allows performing a maturity assessment per SESAR Solution.

EDITION 01.01.03

6

© – [2018] – SJU

3. How to use the MAT Tool?

– FAQ “How to perform a maturity assessment on STELLAR”.

1.4 Glossary of terms

Term Definition Source of the definition

R&D Need R&D needs state major questions and open issues to be addressed during the development, verification and validation of a SESAR Solution. They justify the need to continue research on a given SESAR Solution, and the definition of validation exercises and validation objectives in following maturity phases.

E-OCVM

….

Table 1: Glossary of terms

1.5 Acronyms and Terminology

Term Definition

ADD Architecture Definition Document

AN Availability Note

ATM Air Traffic Management

ATM MP Air Traffic Management Master Plan

CBA Cost Benefit Analysis

EATMA European ATM Architecture

E-ATMS European Air Traffic Management System

E-OCVM European Operational Concept Validation Methodology

IBP Industrial Based Platform

IRS Interface Requirements Specification

INTEROP Interoperability Requirements

KPA Key Performance Area

KPI Key Performance Indicator

INTRODUCTION TO SESAR MATURITY CRITERIA

© – [2017] – SJU 7

MAT Maturity Assessment Tool

OSED Operational Service and Environment Definition

PIRM Programme Information Reference Model

SESAR Single European Sky ATM Research Programme

SJU SESAR Joint Undertaking (Agency of the European Commission)

SPR Safety and Performance Requirements

SUT System Under Test

SWIM System Wide Information Model

TRL Technology Readiness Level

TS Technical Specification

UC Use Case

VALP Validation Plan

VALR Validation Report

VALS Validation Strategy

V&VI Validation and Verification Infrastructure

Table 2: Acronyms and terminology

EDITION 01.01.03

8

© – [2018] – SJU

2 SESAR Maturity Criteria

The purpose of this guidance is to describe the list of SESAR maturity criteria that will be applied to assess the maturity status of the SESAR Solutions in the context of SESAR2020. The SESAR Maturity Assessment Criteria are based on material from E-OCVM version 3.0 and Technology Readiness Levels provided by Horizon 2020, adapted to the specificities of SESAR 2020 programme.

The maturity criteria address E-OCVM levels V1, V2 and V3 for SESAR ATM Solutions and TRL levels TRL2, TRL4 and TRL6 for SESAR Technological Solutions. The document includes a set of TRL7 related criteria for the scope under the responsibility of the Very Large Demonstrations (VLDs).

The SESAR Maturity Criteria also provides a set of maturity criteria that will be applied to topics under the scope of the Exploratory Research Projects (both fundamental and applied oriented ones) and for the three E-OCVM phases that are the scope of SESAR2020, V1, V2 and V3 phases.

They are intended to be used to measure the progress of:

Topics under the scope of exploratory research projects (both fundamental and applied oriented ones) towards initial maturity levels e.g. TRL1 / TRL2;

SESAR ATM Solutions through E-OCVM levels V1, V2 and V3;

SESAR Technological Solutions through TRL levels TRL2, TRL4 and TRL6;

SESAR solutions under the scope of Very Large Demonstrations (VLDs) projects towards TRL7.

Figure 1: Gates and phases of the SESAR Solution Development Life Cycle

In some cases, and in order to facilitate the understanding of some criteria, maturity criteria have been decomposed in sub-criteria that describe all aspects that need to be considered in order to successfully achieve a given criterion. The answers to sub-criteria are consolidated at criteria level. However, nothing prevent the Solution project to answer directly at criterion level.

Maturity Criteria are built progressively from one maturity level to the following one (links between maturity criteria across maturity levels are also available).

INTRODUCTION TO SESAR MATURITY CRITERIA

© – [2017] – SJU 9

2.1 List of SESAR Maturity Criteria

The SESAR Maturity Criteria applicable to SESAR 2020 projects are implemented in the MAT Tool.

2.2 SESAR Maturity Criteria Threads

The SESAR maturity criteria are organized in 7 threads:

5 threads cover different aspects of the maturity of a SESAR Solution: Operational, System, Performance, Standards & regulations and Transition:

o Operations: This thread relates to the description and detailing of the operational concept and procedural aspects related to a SESAR Solution. It refers to the definition and development of operational scenarios, use cases, operational procedures, roles and responsibilities and the identification of operational, safety and performance requirements;

o Systems: This relates to the description and refinement of the required technology/systems, functional blocks and system enablers to support the SESAR Solution. It refers to the development of interoperability requirements and technical specifications addressing the operational and performance requirements for the SESAR Solution;

o Performance: the thread covers to what extent the performance assessments performed follow the SESAR performance and transversal areas assessment reference material, and the qualitative / quantitative performance benefits and cost associated to the SESAR Solution;

o Standards & Regulations: This thread deals with the identification of standardization and regulatory needs as the SESAR Solution maturity evolves and the contribution to activities under standardization and regulatory bodies on the scope of a given SESAR Solution;

o Transition: This thread analyses, on the one hand, whether or not all aspects required to ensure a transition between maturity levels have been taken into consideration e.g. if recommendations for the next maturity level have been documented. On the other hand, it covers aspects that may have influence on industrialization/deployment decisions at a later stage but are not under the strict scope of the SESAR Solution e.g. need to re-design airspace organization to get benefits from advanced RNP capabilities;

Two additional threads cover aspects that, although not directly related to the maturity of the SESAR Solution, allow to improve the confidence on the evidences provided (Validation) and to ensure the alignment/consistency of the SESAR Solution with the SESAR Programme Framework (Programme).

o Programme: This thread measures to what extent the activities performed on a given SESAR solution fit in the overall SESAR programme;

o Validation: This thread analyses to what extent the validation approach and method taken is consistent with the current and target maturity level for the SESAR Solution

EDITION 01.01.03

10

© – [2018] – SJU

e.g. the Validation techniques selected is adequate to achieve the specific objectives of a given V phase.

2.3 Possible answers to each maturity criteria

There are five possible answers for each maturity criterion:

Possible answers to maturity criteria

Explanation

Not Applicable Related to non-applicable criteria

Note: Not all criteria are applicable to all the SESAR Solutions. For example, if a SESAR Solution is not impacting Human Performance or Security the corresponding criteria can be identified as “Not applicable” provided a justification is given

Not achieved The criterion has not been satisfied for the SESAR Solution under analysis

Partial– Blocking Partially achieved. There are issues that require further work. These remaining issues prevent progress of the SESAR Solution to the next maturity level until they have been addressed. This may include future exercises planned to complete the validation.

Partial– Non Blocking Partially achieved, but the remaining aspects do not prevent progress to the next maturity level. They can be address as part of the activities in the next maturity phase.

Achieved No issues are identified to solve after the exit of the V / TRL-phase – i.e. satisfactorily achieved that V / TRL-phase is completed

Table 3: Possible answers to maturity criteria

The document provides indications about what criteria are more critical per V / TRL phase.

INTRODUCTION TO SESAR MATURITY CRITERIA

© – [2017] – SJU 11

3 References

[1] European Operational Concept Validation Methodology (E-OCVM) - 3.0 [February 2010]

[2] SESAR2020 Project Handbook

[3] H2020 reference material