Conclusion of

Testability Diagnostic Prognostic

European Day

M.SCHIEBER

Context of the meeting the 28/04/2015

SPHEREA Marketing & Innovation Incubator “New

Maintenance Concept” Activities

Long terms partnership

DSI Intl. Orange California US

Model Based Testability and Safety Analysis tools

– since 1992 Reseller and Technologies/Technical Support.

SPHEREA Technology Ltd UK

Data interoperability between support Level

– IEEE SCC20 Std 1671 ATML (Automatic Test Mark-up Language)

– IEEE SCC20 Std 1232 AI-estate Artificial Intelligence Exchange and

Service Tie to All Test Environments)

– OSA-RTS

PREDICT 54 Vandoeuvre – France

Embedded and Fleet level analysis for the French Navy

– since 2009

– joint offers and developments

– shared research

– in house trained engineer

2

SPHEREA Marketing & Innovation Incubator

“New Maintenance Concept” Internal Activities

Internal Thesis & Development

1. A model-driven development of tests for avionics embedded

systems http://www.theses.fr/170970205(Onera - Laas)

STELAE _Operational demonstrator of TRL 7

2. Contribution to a Modeling Framework of Integrated Vehicle

Health Management: A Generic Health Management Module

Supporting the Integration of Diagnostics and Prognostics

Attached to internal demonstrators of TRL 4 (University Lorraine)

External Activities diag 21 (2009) French Association for the development of

Testability, improved diagnosis & prognostic of complex

systems

BNAE

BNAE : working group normalisation GT021 Architecture des BIT

dans un système distribué intégré.

SAE Aerospace & Automotive WG HM-1

SAE Standards Development

ARP6883 Guidelines for Writing IVHM Requirements

ARP6407 IVHM Design Guidelines

ARP6290 Guidelines for the Development of Architectures for IVHM

http://www.theses.fr/2014LORR0212

3

Participants / Interests

4

SOME TESTABILITY PROJECTS O

ptr

on

ics

Mis

sile

s

Syste

ms

• Helicopter

• Vehicles

• Communications

• Systems

MBDA

SAGEM

THALES

RATHEON …

SAGEM

THALES …

AIRBUS HELICOPTER

ECE/ZODIAC

NEXTER

MTU GE

RENK GE

SAGEM

ESW GE

SESM …

Page 5 5

6

The fault detection calculus methods are multiples and each new standards bring some new

ways to calculate (ex: IEEE 1522),

Their used is still base on a fuzzy definition of the faults catalog which is the base of the

proposed calculus.

No or not precise fault catalog based on function or Failure modes

The fault catalog is defined between the supplier and the client (No standards)

The notion of fault catalog for software is not existing or not proven

Many (or too many >20) norms standard industrial and military which concern testability.

Most of them are not applicable or obsolete

MIL HDBK 472 (1984)

IEEE 1522 (2004): remove 2010

Some results show that the calculated results of isolation and localization of faults are

different from the real found in field during return of experience. Even more the results

attached to the embedded fault isolation algorithms bring uncertainty of isolation even

during support and maintenance.

INTERNATIONAL STANDARDS ACTUAL STATE

• Some system acquisition contracts with very high metric

requirements:

• Detection Rate(TD) 95%

• Isolation Rate (TL) 90% [GA T1],

• Ambiguity GroupT1 à T3

• False Alarms (TFA) 0%, No Fault Found (NFF)<10%

Contract / Client / User Requirements

7

Testability analysis are defined to

predict

build

evaluate

justify

that the system respect the requirements and the industrial engagements.

Testability is an entry point for

the test

the diagnostic [Diagnosability]

the prognostic

8

Reliability

Detection Rate Isolation Rate

Fault Coverage

Availability

Fault Detection Test

Fault Isolation Test

To reduce

Repair Time/Cost

Reliability Requirements

To reduce the number of failures

Maintainability Requirements

To Reduce

Down Time

Testability

Diagnosability

Test Definition Diagnostic Development

Functional

Redundancy

The Test and Safety

Analysis

Process

Tests, BIT, BITE, Monitoring effectiveness

Severity

Criticality

Safety Analysis

Safety

Safety Requirements

To limit risk

The missing link

between activities

SAFETY

Maintainability

Maintenance

Preventive Corrective Predictive

9

Standard process No validation milestone.

Validation

Integrated

Diagnostic

System Definition

Design Development

Preliminary

FMECA

Critical

FMECA

Test Definition Diagnostic Development

System

FunctionalTest

Integration

Requirement Definition Concept

FD = 95%

FI= 90% T1

Requirement Allocation FD + FI prediction

Only one validation task

with the client, too late in

the project

Demonstration

Faults Injection

Maintenance Procedures

Definition too late

and often during

operational phase

Often by contract, only one

unique demonstration task at

the end of the project is

defined, which in some case

can add up large programs

delay.

EXCEL

Test

Strategy

Tests

Definition

10

Diagnostic Development

System Definition

Modeling Tests

Analysis BITE

Software

versus Hard.

Modeling with Test.

Critical

FMECA

Test Definitions

based on

Failure Modes

Validation

Integrated

Diagnostic

Design Development

Test Definitions

based on

Function

Preliminary

FMECA

Modeling with Test

Test Strategy (Iteration)

Maintenance Procedures

System Functional

Tests.

Integration

Requirement Allocations FD + FI prediction

Requirement Definition Concept

Concept

Architecture

Validation

Testability

Diagnosability

Functional

Modeling

Maintenance

Requirements

Towards testability

validation tasks

during all the

process

Demonstration

FD/FI

Demonstration

Fault Injection

Model driven Engineering process

11

Presentations of the Day

12

eXpress Diagnostic Modeling and Analysis

eXpress creates the models used by all tools

in the ISDD tool suite

Diagnostic FMECAs Module

provides a set of features that allow eXpress

to create and analyze reliability fault trees.

STAGE

Simulation based Analysis of failures,

diagnoses & Repairs

eXpress Maintenance Module

Facilitate the concurrent development of

embedded diagnostics and IETM

eXpress Run-Time Authoring tool (RTAT)

diagnostic procedures towards IETM

DSI Workbench

Run-Time Diagnostic Application

Allows diagnostics developed in eXpress to be

fielded in a maintenance or production

environment. DSI Workbench supports

integration with a test executive, as well as

guided troubleshooting and free-form test entry

DSI History & Feedback Module

Fully-Integrated Database – automatically

stores information

DSI

13

eZi Import Module from CAD to eXpress ATML Solutions

OSA-RTS

Open System Architecture –

Runtime System Overview

14

KASEM® is based on SOA (Services Oriented

Architecture), integrating workflow orchestration,

portal, web services, data processing and

algorithms, analytics, predictive technologies,

machine-learning, time series database,

datamining, business intelligence, big data and

knowledge-based system, providing asset

performances level application services and

process coordination.

KASEM® is a high distributed system enabling

flexibility and agility within multiple key

information systems and enterprise application.

KASEM® is compliant with MIMOSA, OSA-CBM,

OPEN O&M and OPC-UA international

standards.

Business and Technology

Partner

15

CASlP® is an online proactive and real-time

solution, mainly embedded on ship, system,

machine, truck... Thanks to its toolbox, CASlP®

implements:

online monitoring, predictive technics and early

detection of degradation,

isolation, localization, diagnosis and identification

of root causes,

trend and prediction to avoid failures,

health monitoring and KPIs assessment.

CASlP® detects, at an early stage, sudden

problems impacting performances and systems

efficiency.

Business and Technology

Partner

16

Backup

17

DSI Intl. Partnership

SPHEREA Internal Developments

1994 - SERGENT

First graphical model development tool for STAT

2001-2003 eXpress v5

Large Evolution of eXpress as an hybrid Testability

Analysis tool

Based on French clients requirement in phase with the US

market

2004 Locavar

Model based Diagnostic tool on a Test Bench

On specific client requirements

2006 CAD Importer

EADS APSYS – Tool SIMFIA

Option to export the models and the FMECA data’s

towards eXpress

(Microsoft) - Visio

2008 XTSR-VI

External Test Strategy Result – Visualization Interface

Today the Industrial Product Workbench

18

DSI Intl. Partnership

SPHEREA : Service activity

Model developments

On Site

In House

Testability Analysis

Safety Analysis

Advance diagnostic

Expertise

Systems Test Policy

19

DSI Intl. Partnership

SPHEREA : Service activity

Training

Internal or on site

Tools Suite Basic training (4 days)

eXpress

Stage

Workbench

Diagnostic expertise

Diagnosability

FMECA

20