The DoD T&E/S&T ProgramGeoff Wilson

Deputy Program Manager

Test Resource Management CenterTest & Evaluation / Science & Technology Program

(TRMC, T&E/S&T)

ITEA 35th Annual InternationalT&E Symposium

The STEWARD of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB): The “Critical Core”

23 Sites: Army-8; Navy-6; Air Force-7; Defense Agency-2

Legend:Army, Navy, AF, Defense Agency

NUWC Keyport (Nanoose& Dabob ranges)

NAWC-WD China Lake

30th Space Wing

NAWC-WD Point Mugu

412th Test Wing

Yuma Test Center

Nevada Test and Training Range

Utah Test and Training Range

West Desert Test Center

White Sands Test Center

Electronic Proving Ground

PMRF

U.S. Army Kwajalein AtollReagan Test Site

DISA,JITC 96th Test Wing (Includes 96th Test Group)

Atlantic Undersea Test and Evaluation Center

45th Space Wing

Arnold Engineering Development Complex

Aberdeen Test Center

DISA

Cold Regions Test Center

Tropic Regions Test Center,

various locations

NAWC-AD Patuxent River

2

(BA6 Funding)

Risk mitigation needsTechnology shortfalls

The TRMC “Blueprint”

Capabilities

Service Modernization and Improvement

Programs

Acquisition Programs and Advanced Concept

Technology Demonstrations

T&E Multi-Service/Agency

Capabilities

DoD Enterprise Distributed Test

Capability

TRMC Joint

Investment Programs

Transition

Requirements

Annual T&E Budget Certification

(BA3 Funding) (BA6 Funding)

MRTFB Oversight

Defense Strategic Guidance(National Defense Strategy)

Service T&E Needs and Solutions Process

Acquisition Process

Capabilities

Requirements

T&E Range Oversight

Strategic Plan for DoD T&E Resources

Risk mitigation solutions Test Technologies

(BA6 Funding)

S&T Investments(COI)

TRMC Investments Aligned to the National Defense Strategy

4

DoD S&T RelianceCommunities of Interest

Mission FocusCapabilities enabled by advanced technologies and systems

Systems / Capability FocusMultiple technologies are integrated into complex systems to achieve mission impact

Technology FocusTechnology goals with multiple applications

Counter-IED Counter-WMD Biomedical(ASBREM)

Command, Control, Comms, Computers, and Intelligence (C4I)

Human Systems Cyber

AutonomyEngineered

Resilient Systems

Electronic Warfare Sensors

Air Platforms Ground & Sea PlatformsWeapons

Technologies Space

Advanced Electronics

Energy & Power Technology

Materials & Manufacturing

Processes

TRMC Engagement

S&T Investments are Best Leading Indicator of Future DoD T&E Needs

5

USD(R&E) Technology Priorities

Building Joint Lethality• Hypersonics – Offense and Defense• Directed Energy• Fully Networked Command, Control & Communications• Space Offense and Defense• Cybersecurity – Offense and Defense• Machine Learning (Artificial Intelligence)• Autonomy• Quantum Science (Including Encryption and Computing)• Microelectronics

6

Established in FY02 Joint DDR&E / DOT&E Initiative Transitioned to TRMC in FY05

RDT&E Budget Activity 3 funds Purpose

High Risk / High Payoff R&D for Testing Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments

Broad Agency Announcements (BAAs) Academia Industry Government Laboratories

Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition

Central Management – Distributed Execution

Test & Evaluation / Science & Technology (T&E/S&T) Program

Shaping Technology into Tomorrow’s T&E Capabilities

High SpeedSystems

Eight Test Technology Areas

Directed Energy Cyberspace C4I & SoftwareIntensive SystemsElectronic Warfare

Autonomy and Artificial

Intelligence Advanced

InstrumentationSpectrum Efficiency

Mission: Develop Technologies Required to Test Future Warfighting Capabilities

FY 2018 FY 2019 FY 2020 FY 2021 FY 2022 FY 2023 FY 2024$111.6M $96.4M $97.6M $99.5M $101.5M $105.9M $107.5M

Sheet1

FY 2006FY 2008FY 2009FY 2012FY 2015FY 2018FY 2019FY 2020FY 2021FY 2022FY 2023FY 2024

22.59861.3$92.6M$96.6M$81.0M$111.6M$96.4M$97.6M$99.5M$101.5M$105.9M$107.5M

7

T&E/S&T ProgramOverview

• Develop technologies required to test future warfighting capabilities

• Designed to support DoD advances in warfighting technology

o Align to National Defense Strategy and USD(R&E) technology prioritieso Respond to S&T Drivers (Emerging technologies in DARPA & Service S&T)o Reduce Test Capability Development Risk (for CTEIP and Service I&M)o Leverage S&T Developments for Testing

• Core T&E/S&T Tenetso Must address T&E Needo Must advance/mature technology (TRL-3 through TRL-6)o High risk / high payoff investmentso Transition strategy to relevant stakeholders

T&E/S&T Test Technology Area Executing Agent Organizations

Spectrum EfficiencyEdwards AFB

High Speed Systems TestArnold Engineering

Development Complex

Electronic Warfare Test PEO for Simulation, Training

and Instrumentation

Program OfficeTRMC HQ

Advanced Instrumentation SystemsNaval Undersea Warfare Center

C4I & Software Intensive Systems Test

Naval Air Systems Command

TRMC HQ

Air Force

Army

Navy

Central Management – Distributed Execution

Autonomy and Artificial

Intelligence Naval Air Systems

Command

Directed Energy Test PEO for Simulation, Training

and Instrumentation

Cyberspace TestEglin AFB

8

Test Technology InvestmentPrioritization Drivers

• Warfighter Capabilities• Improve Lethality

• Hypersonics• Cyber / Electronic Warfare• Directed Energy• Autonomous Systems

• Improve Resilience• Cyber / Electronic Warfare

• Improve Interoperability• System of Systems• Mission-Level Effectiveness

• Acquisition Programs• Reduce the Cost of Testing• Improve the Quality of Testing

• T&E Needs• Optimize Spectrum Usage• Mitigate Range Encroachment• Improve the T&E Workforce

High SpeedSystems Test

Directed EnergyTest

Cyberspace Test

C4I & SoftwareIntensive

Systems Test

Electronic WarfareTest

Autonomy andArtificial

Intelligence Test

AdvancedInstrumentationSys Technology

Spectrum Efficiency

Technology

Test Technology Areas

High Speed Systems Test Domains

Improving Propulsion Ground Test Methods, Expanding Test Envelopes,

Improving Accuracy & Fidelity, Reducing Uncertainty, Combined Aero

Effects on Sensor/Seeker

Improved Aeroheating & Ablation Test Capabilities, Improved Flow Quality, High

Speed / Hypersonic Systems (HS/H) Munitions Dispensing Testing

Innovative New Sensors, Improving Accuracy, Increasing

Measurement Ranges

Ground Test Instrumentation

Advancing Modeling & Simulation (M&S) Capabilities for Hypersonic

T&E

Improving Mission Assurance and Launch Flexibility, Developing In-Flight Measurements, Increasing

Data Capture per Flight

Flight Test

Turbine Engines

Weapon Systems

Boost Glide Vehicles

Interceptors

Computational Tools

ScramjetVehicles

Re-entryVehicles

Railguns

0

20

40

60

80

100

Time

Altit

ude,

kFt

Terminal Dive• Guidance & navigation • Validate Stability and

Control predictions • Lethality• Lift and drag testing• Aerothermal structural

response

Hypersonic Cruise MissileT&E Shortfalls

Air Launch• Store separation testing• Combined system

aerodynamic testing• Stability, control

effectiveness

Captive Carry• Booster testing• Wind tunnel testing of

assembled stack

Boost Phase• Ignition Testing• Transonic/Supersonic

testing of system• Booster separation

wind tunnel testing

Scramjet Ignition• Inlet performance and

operability testing• Propulsion system• Ignition testing• Fuel schedule for start

Scramjet Powered Flight• Isolator/Combustor development• Isolator margin• Propulsion system • Combustion stability• Performance and operability• Accurate flight conditions• Fuel schedule optimization (max range)• Heat exchanger performance

Sensor Characterization• Calibrate sensor and fly the

mission with hardware in the loop testing

Notional Mission

Altit

ude

Pullout

Terminal Dive

Ballistic

Evasive, Energy Management & Cross Range Maneuvers

End-Game• Vehicle condition during

final dive and impact• Vehicle signature• Weather effects• Aerothermal structural

response• Lethality

Weapon Deployment• Weapons separation

from vehicle• Sub-munitions impact

Launch

Boost-Glide VehiclesT&E Shortfalls

Surface Launch• Verify propulsion system

performance, operability, and durability at flight conditions

Booster Aero Stability• Validate Stability and

Control (S&C) predictions for Booster Aero Stability for booster during assent

Stage Separation• Verify clean vehicle

separation, characterize staging effect on vehicle stability

Leading Edge ThermoStructural Performance• Verify leading edge and

Thermal Protection System (TPS) survival without damage or significant shape change

Vehicle Aero Stability• Validate Stability and

Control (S&C) predictions for flight vehicle maneuver and control

Sensor Characterization• Calibrate sensor and fly the

mission with hardware in the loop testing

Notional Mission

13

Directed Energy Weapons, organized in HEL or HPM domains, use the electromagnetic spectrum (light & radio energy) to attack targets at the speed of light

High Power Microwave (HPM)Produce wide beams in bursts of high frequency radio energy that disable or damage electronics

C-IED HPM Systems Threat Sources

High Energy Laser (HEL)Produce coherent, powerful, monochromatic, focused light

beams that heat the target body

Joint High PowerSolid-State Laser

(JHPSSL)

Laser Area Defense Systems

(SSL-TM/HEL MD)

Directed Energy TestDomains

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://tech.sina.com.cn/d/2014-10-05/10119667994.shtml&ei=pTi0VJ7kFtLSoASZyoHADA&bvm=bv.83339334,d.cGU&psig=AFQjCNG0R4W4vLywZeC7qCCeeeiKXLexPg&ust=1421183518182635

14

HEL Mission ScenariosPropagation Medium Target Platform Target Effects

Self-Defense Area Defense

Air Superiority

Aircraft Vulnerability

Electronic Warfare Test (EWT), organized into EO and RF domains, operates across the electromagnetic spectrum to improve Electronic Attack (EA), Electronic Protection (EP), and Electronic Support (ES)

test technologies and capabilities

Infrared Countermeasures JammersMultimode Seekers Synthetic Aperture Radar

Electro-Optical (EO)- Missile Warning Sensor (MWS)- Infrared Countermeasure (IRCM)- Precision-Guided Munitions (PGM)

EO/IR/UV seekers- EO/IR Intelligence, Surveillance, and

Reconnaissance (ISR) sensors on airborne platforms

Radio Frequency (RF)- Radars and communications- Radar Warning Receivers (RWRs)- Electromagnetic sensors- Jamming systems- RF seekers on PGMs and RF ISR

sensors on airborne platforms- Integrated air defense system (IADS)

Electronic Warfare TestDomains

Develop advanced technologies and methodologies to test and evaluate DoD capabilities and information networks to defend and conduct full-spectrum military operations across cyberspace

Three Domains of CTT1. Cyber-Physical Systems: Kinetic systems, cyber-

physical networks, embedded systems - computer systems with a dedicated function within a larger mechanical or electrical system, often with real-time computing constraints

2. Tactical Edge Networks: Information systems & connectivity supporting tactical edge communications and distributed operations – includes line-of-sight and beyond-line-of-sight data links, and other networked systems in the battlespace

3. Enterprise Information Systems: Broad scope of unified communications and integration of telecommunications, computers, necessary enterprise software, middleware, storage, and audio-visual systems which enable users to access, store, transmit, and manipulate information

Cyberspace Test TechnologyDomains

Current Asset/Facility Expanding Capacity to Meet Demand

Integrated Tool Suite & Automation Maximizes Utilization of Range Resources

SME Available for Planning, Design, Execution, OPFOR and Analysis

Hi-fidelity Virtualized Representations of Networks, Platforms, C2, etc.

Cyber Range Vision

Autonomy & Artificial Intelligence TestOverview of Use Cases

Bio Monitoring

Persistent Stare

BDA

Autonomous Refueling

Wingman

Convoy

Route Clearance

Casualty Evacuation

IED Interrogation

PerimeterSurveillance

Cordon & Search

Autonomous Lift

DynamicNetworks

Swarming Recon

Targeting

Anti-Sub Warfare

Mine Neutralization

Blockade Enforcement

Collaborative Autonomy

Port Protection

Coastal ISR

Better Testing of Autonomous Systems leads to greater Warfighter Trust in their mission performance

C4I & Software Intensive Systems TestDomains

Innovate T&E: Early, Often, and Agile

Complex Warfare Environments

Battle increasingly sophisticated adversaries in increasingly complex environments*

Innovative approaches to how we fight, posture our force, and leverage our asymmetric strengths and technological advantages*

Distributed Testing (DT)• Reduce Distributed T&E Effects• Improve Security Posture of Systems• Advance Mission Context Data Collection• Analysis & Visualization

Modeling & Simulation (M&S)

Test Automation (TA)

• Advance Big Data Collection, Analysis & Visualization

• Improve Test Execution thru Automation/Cloud Computing

• Advance Testing for Next Generation of Handhelds

• Improve Automated Control of Targets

* 2014 Quadrennial Defense Review

• Required Fidelity in Live andSimulated Environments

• V&V Techniques• Aggregation Techniques• Run-time Performance for RT

Applications• Systems, Communications,

Environmental Representations

BIG DATA & CLOUD COMPUTING

Revolutionize the RF test range environment by leveraging network & cellular based technologies to support real-time wireless data communications

Spectrum Efficient Technology Domains

SEAMLESS RANGE

COMMUNICATION

SPECTRUMMANAGEMENT

Red: OpticalGreen: RF

IMPROVEDWIRELESS

TECHNOLOGIESNETWORK

TELEMETRY

http://www.google.com/url?url=http://www.motorship.com/news101/shiprepair-and-conversion/cruise-and-naval-ships-in-the-news-in-germany&rct=j&frm=1&q=&esrc=s&sa=U&ei=aLeQVIJ-hJQ2yquCuAw&ved=0CDoQ9QEwEjgo&usg=AFQjCNFlDz1UlUxzBWcER7m4dRl2j-_UCghttp://www.google.com/url?url=http://defence.pk/threads/italy-signs-g550-aew-deal-with-israel.197054/&rct=j&frm=1&q=&esrc=s&sa=U&ei=w8KQVLvYLsejNtGSg4gF&ved=0CDYQ9QEwEDgU&usg=AFQjCNGSGsX3I3g7rBPZMSFq13ad6rBDvQhttp://www.google.com/url?url=http://www.f35.nl/&rct=j&frm=1&q=&esrc=s&sa=U&ei=e8GQVLrUBIHsgwSAkYSYCA&ved=0CCYQ9QEwCA&usg=AFQjCNGW3mXWk_oVv_Qpu9GchnF-x76DmQ

Encroachment to DoD TestingSpectrum Availability

0

100

200

300

400

500

600

700

800

900

1960 1965 1970 1975 1980 1985 1990 1995 2000 2005 2010 2015 2020 2025

Syst

em D

ata

Rate

s (Kb

ps)

Spec

trum

Ava

ilabi

lity

(MHz

)

Years

From F-15 to F-22 (25 years): ~7000% Increase in Data Rate

F-22 (1997): 10,000 Kbps

SDB (2010): 23,000 Kbps

• DoD Requirement of 865 MHz by 2025

• 465 MHz Currently Available• Shortfall of 400 MHz

AWS-3 Reallocation

• Increased complexity of weapon systems coupled with decreased availability of telemetry spectrum limits testing at national ranges (complexity of tests, data downlinks)

o Available spectrum will be further reduced by potential loss of 1780-1850 MHz and sharing spectrum with commercial users

• Large amounts of data collected onboard system and analyzed post-test

• Continued investment in advanced RF and network technologies can partially mitigate the loss of spectrum

o Advanced modulation schemes o Networked telemetryo Non-traditional portions of the RF

spectrum (e.g. C-band, Ka/Ku-Band)

Increased Weapon System Complexity and Reductions in Available RF Spectrum Limit the Amount and Types of T&E Missions a Range can support

F-15 (1972): 128 Kbps

F-16 (1985): 640 Kbps

BAMS (2013): 10,000 Kbps

1780-1850 MHz

Usable C-Band AssignmentLegacy Spectrum Assignment

Anticipated Future LossNear Term Loss (AWS-3)

Adv. Instrumentation Sys. TechnologyDomains

T&E/S&T ProgramSummary

• T&E/S&T Program initiated to address critical T&E needs tied to S&T drivers– Advancing the state of the art in T&E technologies

• The only DoD S&T program dedicated to T&E

• Aligned and balanced to address the highest prioritytest technology needs in support of the National Defense Strategy

Looking Ahead, Relevant, Agile, and Efficient23

Questions?

Mr. Geoffrey Wilson Major Initiatives & Technical Analyses

Deputy T&E/S&T Program Managergeoffrey.w.wilson2.civ@mail.mil

(571) 372-2679

Test Resource Management Center4800 Mark Center Drive, Suite 07J22

Alexandria, VA 22350-3700

http://www.acq.osd.mil/dte-trmc/

24

Mr. James FaistDirector of Defense

Research and Engineering for Advanced Capabilities

Director, TRMC james.a.faist.civ@mail.mil

Mr. George RumfordDeputy Director,

Major Initiatives & Technical AnalysesT&E/S&T Program Managergeorge.j.rumford.civ@mail.mil

(571) 372-2711

Slide Number 1The STEWARD of the DoD Test Infrastructure �Major Range and Test Facility Base (MRTFB): The “Critical Core” �23 Sites: Army-8; Navy-6; Air Force-7; Defense Agency-2The TRMC “Blueprint”DoD S&T Reliance�Communities of InterestUSD(R&E) Technology PrioritiesSlide Number 6Slide Number 7Slide Number 8Test Technology Investment�Prioritization DriversHigh Speed Systems Test �DomainsHypersonic Cruise Missile�T&E ShortfallsBoost-Glide Vehicles�T&E ShortfallsSlide Number 13Slide Number 14Electronic Warfare Test�DomainsCyberspace Test Technology�DomainsCyber Range VisionAutonomy & Artificial Intelligence Test�Overview of Use CasesC4I & Software Intensive Systems Test�DomainsSlide Number 20Encroachment to DoD Testing�Spectrum AvailabilitySlide Number 22T&E/S&T Program�SummaryQuestions?