1

Military Flight OperationsQuality Assurance (MFOQA)

Information Briefingby

Mr. Jody CreekmoreUS Army Aviation and Missile Command

September 2005

If you do not observe it, you cannot measure it.If you do not measure it, you do not understand it.If you do not understand it, you cannot manage it.

If you do not manage it, it will manage you!

2

What is MFOQA?What is MFOQA?

Military Flight Operations Quality Assurance (MFOQA) is nothing more

than the proactive and systematic collection and analysis of operational data

from aircraft for use in the continuous improvement of flight operations and readiness, specifically in the areas of

Operations, Training, Maintenance and Safety (OTMS).

3

Video

4

• Current Situation: Fragmented Army Aviation Information System

– Multiple “like” DEMOs/Programs– No Standard for Recording Devices– Proprietary Data Conversion and Analysis Programs– The Army is not fully using Available Aircraft Data

• Opportunity: Improve Army Aviation Information System

– Eliminate Duplication of Multiple “Like” Programs– Standardize Requirements for Recording Devices – Joint Service

Safety Chiefs (JSSC)-Developed Requirements– Develop Government-Owned Data Conversion and Analysis

Programs– Use Aircraft Data to Improve Operations, Training, Maintenance,

and Safety by Implementing an MFOQA Program

Current PerspectiveCurrent Perspective

5

Cost of Army AviationCost of Army Aviation

Repair Parts – Routine Maintenance

Lost Aircraft – Human Factors

Lost Aircraft –Material Failures

MFOQA

SystemSafety

CBM

Very Expensive!!!But, little to No New

Investment

Success Story:Rare Occurrence

Expensive.Potential

Opportunity forSavings.

$

$

$$

$

$$

$

$$$

$

$

$

$

$$

$

$

$

$

$

$

$

$

$$

$

$$

$$$

$

$

$

$

$

$ $

$$

$

$

$

$

$

$

$$

$

$$$

$$

$

$

$

$$

$

$$

$

$$$$

$

$$

$$ $$

$

$

$

$$

$$

$

$

$ $

$$

$

$$

$$

$

$$$

$

6

Why MFOQA?Why MFOQA?

Support Failure7%

Material Failure5%

Risk Management9%

Leader Failure12%

Other12%

Environment18%

Individual Failure30% Training Failure

7%

Current Aviation Accident Trends

7

“MFOQA can enable leaders to make wiser, more informed decisions because of the ability

to store, retrieve, analyze and translatedata

into understandableinformation

that will give them theknowledge

derived from virtually thousands of flight hours of experience.”

Why MFOQA?Why MFOQA?

8

• In 2000, the Joint Safety Chiefs (JSSC) signed a Memorandum of Agreement (MOA) stating full support for MFOQA and recommended immediate funding of MFOQA programs in all services.

• In 2002, the Secretary of Defense directed that initiatives be taken to reduce the military aircraft mishap rate by 50%.

• In 2004, the Under-Secretary of Defense for Readiness listed MFOQA as one of his four (4) key initiatives to achieve the SECDEF’s mishap reduction goal.

• In 2004, both the USAF and Army initiated DEMOs (DoD Redirection of Funding).

• In 2004, the US Navy initiated a DEMO (Funded within the US Navy).

• In 2006, the US Navy will begin an MFOQA Program (Navy Decision).

• In 2006, both the USAF and Army will begin MFOQA Programs (Program Budget Decision 705).

Why Now?Why Now?

9

• The US Department of Defense (DoD) has recently and enthusiastically embraced MFOQA, a program based on the Flight Data Monitoring (FDM) program conceived and birthed years ago in civil aviation.

• All the US military departments are actively pursuing MFOQA programs to impact the safe operation of their fleets of fixed-wing and rotary-wing aircraft and have begun forging relationships and cooperative ventures to share lessons learned and best business practices.

• Defense Safety Oversight Committee (DSOC) Safety Technology Working Group.

• JSSC Safety Technology Working Group (STWG).

• JSSC MFOQA Conference in Las Vegas – JUN 05. • JSSC DRAFT MOU – TBD.

Joint MFOQA Joint MFOQA CooperationCooperation

10

• The USAF has taken lead on developing MFOQA Program for Fixed-Wing Cargo aircraft.

• The USN has taken lead on developing MFOQA Program for Fixed-Wing Fighter aircraft and Crew Debrief Tool.

• The USA has taken lead on developing MFOQA Program for Rotary-Wing aircraft.

Joint MFOQA Joint MFOQA CooperationCooperation

11

• The US Department of Defense (DoD) is participating with several other national militaries, including the UK Ministry of Defense (MoD), in the cooperative sharing of information for the purpose of furthering military rotary-wing safety, including Flight Data Monitoring or MFOQA.

International MFOQA International MFOQA CooperationCooperation

12

• Services are waiting for release.

• Will define MFOQA.

• Will direct the services to incorporate “enabling technologies” where technically and fiscally feasible.

• Will serve as advance notice of MFOQA Directive – to be published.

DRAFT DoD MEMODRAFT DoD MEMO

MFOQA MEMO

13

• Services are waiting for release.

DRAFT DoD DirectiveDRAFT DoD Directive

14

DSC MFOQA

Recording Device

• Solid-Sate Crashworthy Flight Data and Voice Recorder• VMEP• HUMS

Unit Workstation

• Process Data• Unit Debrief Tool• Package Report• Package Data

Central Server

PMO USACRC

AED

Others

DSC is NOT MFOQADSC is Enabling Technology for MFOQA

MFOQA is Primarily Process and Software

Data Flow

HARDWARE• Recording Device• Downloading Device, or Transfer Media• Workstation to Process Data

SOFTWARE• In Recording Device• In Unit Workstation

HARDWARE• Unit Wokstation (shared with the DSC)• Central Server

SOFTWARE• In Unit Workstation• In Central Server

Relationship Between Relationship Between DSC and MFOQADSC and MFOQA

15

MFOQA ImperativesMFOQA Imperatives

• Must record Voice, and on the same media as Flight Data.

• Voice and Flight Data stored on a “walk away” media with no actions required other than “eject;” example is PCMCIA Card.

• Flight Data automatically synchronized with Voice.

• Automatic creation of Visualization File; i.e. Desktop Icon that is opened with a “double click.”

• Visualization File automatically overlayed on actual Terrain Data.

• Crew/Unit Safety Officer/Commander have access to file.

• Simple manipulation of mouse to get “Cockpit View” or “Outside View.”

• At unit – Store entire file (w/voice) only for short period.

• Higher Level – Except as required, provided Exception Data only (no voice).

16

MFOQA ROIMFOQA ROI

Time

Cos

t

HQ DA Opportunities

Higher-Level Opportunities

Unit Opportunities

Challenges:

Non-Bussed A/C, DSC-Joint Requirements,NRE, Infrastructure (People & Equipment),

Sustainment, Privacy Rights, Mindset (“Big Brother”)

17

MFOQA Opportunities MFOQA Opportunities ––

All LevelsAll Levels

Hig

he

r-L

ev

el

Un

it

• Monitor• Battalion OPS• Brigade OPS• Division OPS

• Mission Planning• After Action Report (AAR)• Monitor Operations• Mission Effectiveness• Battlefield Visualization

• Accident Reduction• Human Factors INFO• ASIST INFO• Trend Monitoring• Risk Management• Controls Effectiveness

• Accident Reduction• Risk Management• Share “Close Calls”• Safety Standowns

• A/C Status for PEO & PMs• Data for AMRDEC• ASIST INFO• Developing Problems• TBO Verification &Extension/Reduction

• Diagnostics• A/C Status• Exceedence Monitoring• HUMS• HIT Checks• IETMs

HQ

DA

• G3 OPS Monitoring• OPS Ready Rates• OPS Effectiveness• Army-wide STATS• Funding Priorities

• ASIST INFO• Risk Management• Developing Hazards• Controls Effectiveness• Proactive Safety Program

• G4 Monitoring• CBM• Funding Requirements• Funding Priorities• Readiness

• Readiness• Effectiveness• Funding Priorities

• Training Effectiveness• Army-wide Standardization• ATM Effectiveness• CMTC Rotations• Documented Standards• Crew Coordination TNG

• Mission Replay• Home Station TNG• Simulator Replay• Documented Standards• Aircrew Self Evaluation• Instructor Pilot Standardization

OperationsOperations SafetySafetyMaintenanceMaintenanceTrainingTraining

18

Operations (“O”)– Mission Debrief Tool

Training (“T”)– Web-Based Standardized ATM Maneuvers

• “Gold Standard” Maneuver Library• “Common Student Errors” Maneuver Library

– Aircrew Self-Performance Tool – Visualization– Aircrew Coordination Training and Evaluation Tool– Collective Training Tool – Visualization

Maintenance (“M”)– Aircraft System and Sub-System Performance Trending Tool– Near Exceedance Event Detector (“Close Calls”)– Exceedance Event Detector– Predictive Maintenance Tool

Safety (“S”)– “Composite Risk Management” Tool

MFOQA Opportunities MFOQA Opportunities ––

Near TermNear Term

19

USAAVNC CMD GROUPUSAAVNC CMD GROUP

MFOQA DEMOSteering Committee

MFOQA DEMOSteering Committee

USACRCUSACRC RDECOMRDECOM AMCOMAMCOM PEO-AVNPEO-AVN

WestarWestar

MFOQA Program Development Team

(DCD Lead)

MFOQA Program Development Team

(DCD Lead)

Demonstration

MFOQA DEMO –MFOQA DEMO –StructureStructure

20

MFOQA DEMO –MFOQA DEMO –StatusStatus

• Phase I.

• Period of Performance: JAN 05 – JAN 06.

• Objective: Develop Requirements.

• Contractor: Westar Aerospace.

• Contract Vehicle: Government Services Administration (GSA).

• Funding: Funded.

• Managed by: Steering Committee.

• Accomplishments: User Survey, Debrief Tool, Infrastructure Req. (25% Complete).

• Phase II.

• Period of Performance: JAN 06 – JUL 07.

• Objective: Demonstrate MFOQA in an Operational Unit.

• Contractor: Westar Aerospace.

• Contract Vehicle: GSA.

• Funding: Funded.

• Managed by: Steering Committee.

21

• AH-64D AQC Student, “I really get factual feedback on how I am performing. [I] can’t wait to get this in my unit.

• AH-64D AQC Student, “If this thing had multi-aircraft capability, it would be great for evaluating our unit collective training.

• AH-64D AQC Student, “[This is] much better than using the video from the aircraft because you can go directly to the part of the flight you need to review. I look forward every morning to review [my] previous day’s performance.”

MFOQA DEMO –MFOQA DEMO –Student CommentsStudent Comments

22

MFOQA Program MFOQA Program StatusStatus

• Funded by DoD Program Budget Decision.

• Program Manager: PM Aviation Systems (PEO AVN).

• Difficult Decisions Will be Made; i.e. Which DSC?, Which Platforms?, etc.

PBD 705

23

We seek warriors, persons willing to project themselves and their aircraft and their weapon

systems into a hostile environment with the purpose of engaging and destroying the

enemy. The people we seek are required to train and operate in a flight envelope that comes right up to the border of hazardous

flight. We are obligated to ensure our warriors know exactly where that border is located ...

MFOQA will help us find that border.

Value of MFOQAValue of MFOQA

24

Mr. Jody CreekmoreUS Army Aviation and Missile Command

(256) 842-8630, DSN 788-8630joseph.creekmore@redstone.army.mil

Point of ContactPoint of Contact

OH-58DPractice Autorotation with Turn

While conducting autorotation training in an OH-58D aircraft, the pilots observed an Engine NP Overspeed. The Multifunction

Display (MFD) confirmed the pilot’s observations. To confirm the data recorded on the aircraft’s engine history page, the OH-58D Training Fleet Manager requested the Safety Center download and analyze both the aircraft’s Digital Source Collector and the aircraft’s Digital Transfer Cartridge (DTC). The DTC failed in the download process and provided no information. Analysis of the

DSC data confirmed the pilot’s statements relative to the incident, specifically, that the aircraft had experienced an Engine

NP Overspeed. The DSC data permitted the maintainer to conclude that the Engine Module was still serviceable and that

the Engine Module did not require replacement.

MFOQA “Payback”MFOQA “Payback”

Engine History Page Does NotDisplay Engine Torque

At Time Of NP Overspeed

MFOQA “Payback”MFOQA “Payback”

Without Torque Information,

TM Says “Replace”

MFOQA “Payback”MFOQA “Payback”

Engine NP Overspeed (OH-58D, 90-00380)

0.000

10.000

20.000

30.000

40.000

50.000

60.000

70.000

80.000

90.000

100.000

110.000

120.000

System Time

EngNP_1 93.600

EngTRQ_1 5.039

DSC DataProvides Torque

At Time Of NP Overspeed

MFOQA “Payback”MFOQA “Payback”

With DSC Data,TM Says

Engine Module“OK”

MFOQA “Payback”MFOQA “Payback”

30ARMY AVIATION WARFIGHTING CENTER

Military Flight Operations Quality Assurance (MFOQA) Demonstration Update

9 Aug 2005

31

Contract:• Contract Awarded July 2004 (General Services Administration contract is 1 Year with 4 Option Years)• Westar is contractor approved via Source Selection Evaluation Board (SSEB)• Statement of work developed for Phase I expected to require 18 months• Funding Received for Option Year (June 2005).

Phase I Demonstration Objectives: • Identify Operations, Training, Maintenance, Safety (OTMS) user needs at Ft. Rucker, AL• Develop a prototype or “brassboard” MFOQA process• Begin the regular flow of information to the users• Quantify the results

Phase I Accomplishments:• Downloaded data from over 200 AH-64D flights• Animation of maneuvering flight using downloaded data • Developed ‘poor’ and ‘good’ crew coordination models • Developed analysis tools to check for tech manual exceedences• Developed near-exceedences filter for safety and standardization• Developed/animated ‘gold standard maneuvers’ as maintenance Instructor Pilot (IP) course training aid• Developed and instituted tools to assist and assess ‘mentor IP’ process for use in post mission debrief of new IPs

Background

32

• Demonstration will not be taken to an operational unit until MFOQA is readyDemonstration will not be taken to an operational unit until MFOQA is ready (MOVE EFFORT TO SYNTHETIC/EXPERIMENTAL ENVIRONMENT)(MOVE EFFORT TO SYNTHETIC/EXPERIMENTAL ENVIRONMENT)

• Year 2 effort should end NLT August 2006Year 2 effort should end NLT August 2006

• DCD will be the lead for the MFOQA demonstration and will manageDCD will be the lead for the MFOQA demonstration and will manage funding with input from the Steering Committeefunding with input from the Steering Committee

• The role of the Steering Committee is not to be diminished. LTC Knapp willThe role of the Steering Committee is not to be diminished. LTC Knapp will chairchair

• DCD will work with the Program Executive Office- Aviation (PEO-Aviation) DCD will work with the Program Executive Office- Aviation (PEO-Aviation) to increase their participation. Follow-on MFOQA initiatives, demonstrations,to increase their participation. Follow-on MFOQA initiatives, demonstrations, etc beyond the 2etc beyond the 2ndnd Year effort should transition to the PEO Year effort should transition to the PEO

Demonstration Strategy

Minimize Unit Disruption - Leverage Experimental EnvironmentMinimize Unit Disruption - Leverage Experimental Environment

33

• Ability of Unit Manpower to Execute Prototype MFOQA ProcessAbility of Unit Manpower to Execute Prototype MFOQA Process

• Day-to-Day MFOQA Operations (i.e., Tactics, Techniques, and Day-to-Day MFOQA Operations (i.e., Tactics, Techniques, and Procedures) from Aircraft to Higher EchelonProcedures) from Aircraft to Higher Echelon

• Perceived Value of MFOQA Process to Unit Personnel and Higher Perceived Value of MFOQA Process to Unit Personnel and Higher Echelon UsersEchelon Users

• Recommended Modifications to Unit or Higher Echelon Equipment Recommended Modifications to Unit or Higher Echelon Equipment to Implement the MFOQA Processto Implement the MFOQA Process

• Recommended Changes to the MFOQA Prototype Process to meetRecommended Changes to the MFOQA Prototype Process to meet operational unit requirementsoperational unit requirements

Minimize Unit Disruption - Leverage Experimental EnvironmentMinimize Unit Disruption - Leverage Experimental Environment

Key Areas for Investigation