Systems Engineering

Synopsis of Current SE Efforts within NDIABob Rassa

Chair, NDIA Systems Engineering Division

National Defense Industrial Association

STRENGTH THROUGH INDUSTRY & TECHNOLOGY

National Defense Industrial Association

SYSTEMS ENGINEERING DIVISION

CHAIR

Bob RassaRaytheon

(IEEE)VICE-CHAIR

Hal WilsonNorthrop Grumman

2nd Vice-Chair

Geoff DraperHarris Corp

CHAIR

Bob RassaRaytheon

(IEEE)VICE-CHAIR

Hal WilsonNorthrop Grumman

2nd Vice-Chair

Geoff DraperHarris Corp

Gov’t Steering CommitteeKristen Baldwin - OSD (Chair)(open) – MDA George Mooney - USAFJesse McCurdy - NAVAIRRebecca Davies - DCMA(open) - FAASteve Kapurch - NASAJack Zavin - OSD(NII)Doug Wiltsie – ArmyCarl Siel – USNavy-ASN/RDATerry Jaggers – SAF/AQRopen – OSD/MRMP

Gov’t Steering CommitteeKristen Baldwin - OSD (Chair)(open) – MDA George Mooney - USAFJesse McCurdy - NAVAIRRebecca Davies - DCMA(open) - FAASteve Kapurch - NASAJack Zavin - OSD(NII)Doug Wiltsie – ArmyCarl Siel – USNavy-ASN/RDATerry Jaggers – SAF/AQRopen – OSD/MRMP

Steering CommitteeDiv Chairs plus:Pete Larkin - GD, Electric BoatJim Clamons - Harris CorpTed Kuriata – BAE SystemsNick Fritz - Burdeshaw AssociatesJeff Dutton – Jacobs TechnologyJim Sturges - Lockheed MartinMark Schaeffer- ManTech Int’lPaula Nowak - SAICDev Banerjee - BoeingGregg Beardsley - L3 COMWendy Irion Talbot – CSCAffiliations & Liaisons“Rusty” Rentsch - AIAKen Ptack - INCOSEJerrell Stracener - SMUSteve Kuehl - AIAAPaul Croll - IEEE Computer SocietyMike Cardinale - IEEE AESSRene Smith - SOLELes Orlidge - IEEE SCC20Elliot Axelband - RAND CorpGreg DiBenedetto - GEIAJohn Kreger - MitreKen Nidiffer - SEI

Steering CommitteeDiv Chairs plus:Pete Larkin - GD, Electric BoatJim Clamons - Harris CorpTed Kuriata – BAE SystemsNick Fritz - Burdeshaw AssociatesJeff Dutton – Jacobs TechnologyJim Sturges - Lockheed MartinMark Schaeffer- ManTech Int’lPaula Nowak - SAICDev Banerjee - BoeingGregg Beardsley - L3 COMWendy Irion Talbot – CSCAffiliations & Liaisons“Rusty” Rentsch - AIAKen Ptack - INCOSEJerrell Stracener - SMUSteve Kuehl - AIAAPaul Croll - IEEE Computer SocietyMike Cardinale - IEEE AESSRene Smith - SOLELes Orlidge - IEEE SCC20Elliot Axelband - RAND CorpGreg DiBenedetto - GEIAJohn Kreger - MitreKen Nidiffer - SEI

Systems EngineeringEffectiveness

CommitteeAlan Brown

BoeingTom Wickstrom,

IBM Mike Ucchino

USAF/CSEMike Persson

U S Navy(open)

U S Army

Education & TrainingCommittee

Don GeloshOSD (AT&L)SSE/ED

John SnoderlyDefense Acquisition

University

Software Experts Panel

Paul Croll, CSC

SoftwareCommitteePaul Croll

CSCKristen BaldwinOSD(A&T)SSE

Modeling & SimulationCommittee

Jim HollenbachSimulation Strategies

Gary BelieLockheed Martin

Life Cycle SupportCommittee

Joel MoorvitchRaytheon

(Open)OSD/MRMP

NDIACOMMITTEE EXECUTIVE

Sam Campagna

SystemsAssuranceCommittee Paul Croll

CSCKristen Baldwin

OUSD(AT&L)Mitch Komaroff

ASD(NII)

QualityAssuranceCommittee

Cyndi ReichardtDCMA - HQ

Paul ThornberryNSWC - Corona

(open)Raytheon

Randy BakerBoeing

Enterprise Health ManagementCommittee

Howard SavageSCI

Dennis HechtBoeing (St Louis)

CMMI ProjectBob Rassa, Raytheon

07/20/08

Automatic TestCommittee

Les Orlidge, AAI CorpSteve Karlovic, EADS-NA

InteroperabilityCommittee

Jack Zavin, OASD(NII)

Rich Eilers, IBM

Tom Croak, CSC

Development Test & Evaluation Committee

John Lohse, Raytheon Tom Wissink, Lockheed Martin Darlene Mosser-Kerner, OSD

System Safety CommitteeSherman Forbes, USAF

Paige Ripani, BAH

CMMI Working GroupGeoff Draper, Harris Corp

Executive Advisory Group

Engrg In Mfg CommitteeTom Christian, USAF

TBD, TBD

SE Division Affiliates/Partners

IEEE AES Society IEEE Computer Society IEEE Systems Council INCOSE SAE International GEIA AIA AIAA Software Engineering Institute, Carnegie Mellon Southern Methodist University RAND Corp MITRE Corp

SE Division Charter: Objectives

•To serve as the NDIA focal point for the identification, study, and resolution of issues associated with performance and cost-benefits derived from commercial-off-the-shelf (COTS) procurements for government and industry.•To provide Government with collective industry viewpoints, recommendations and advice on Military & Government Systems Engineering, support and interoperability concepts, policies, plans, programs, requirements, technologies, problems, implementation or impact of pending legislation, regulations and procedures. Special studies will be conducted to this end as may be required.•To foster mutual understanding and effective working relationships between Government and industry for the purpose of ensuring effective and reliable systems engineering, support and interoperability concepts, and systems that meet Government requirements at reasonable costs.

Mission Statement

To promote the widespread use of Systems Engineering in the DoD Acquisition Process in order to achieve affordable and supportable systems that meet the needs of the military and government users, and to provide a forum for the open exchange between government and industry to trade ideas and concepts, and develop a new understanding of a streamlined acquisition process.

OSD Interactions on SE

NDIA SE Div works hand in hand, literally on a daily basis, with OUSD(AT&L) Systems and Software Engineering on SE strategy issues. Policy, key messages Conduct Workshops & Summits on SE issues Guides & Directives CMMI

Top 5 Systems Engineering Issues

Lack of awareness of the importance, value, timing, accountability, and organizational structure of SE on programs

Adequate, qualified SE resources are generally not available within Government and industry for allocation on major programs

Insufficient SE tools and environments exist to effectively execute SE on programs

Requirements definition, development and management is not applied consistently and effectively

Poor initial program formulation

NDIA SE Division Formal Report submitted to OSD, April 2003

Top 5 SE Issues-2006 update

Key systems engineering practices known to be effective are not consistently applied across all phases of the program life cycle.

Insufficient systems engineering is applied early in the program life cycle, compromising the foundation for initial requirements and architecture development.

Requirements are not always well-managed, including the effective translation from capabilities statements into executable requirements to achieve successful acquisition programs.

The quantity and quality of systems engineering expertise is insufficient to meet the demands of the government and the defense industry.

Collaborative environments, including SE tools, are inadequate to effectively execute SE at the joint capability, system of systems (SoS), and system levels.

Report submitted to OSD, August 2006

Top SW Issues

• The impact of requirements upon software is not consistently quantified and managed in development or sustainment.

• Fundamental system engineering decisions are made without full participation of software engineering.

• Software life-cycle planning and management by acquirers and suppliers is ineffective.

• The quantity and quality of domain-knowledgeable software engineering expertise is insufficient to meet the demands of government and the defense industry.

• Traditional software verification techniques are costly and ineffective for dealing with the scale and complexity of modern systems.

• There is a failure to assure correct, predictable, safe, secure execution of complex software in distributed environments.

• Inadequate attention is given to total lifecycle issues for COTS/NDI impacts on lifecycle cost and risk.

Report submitted to OSD, Sept 2006

Major Prior Activity

Conduct Workshops on comprehensive attributes of SE, especially the ancillary aspects such as Test & Evaluation, Education, Program Performance, Quality, etc. – all of which are ingredients or have relevance to good SE

Education Summit, October 2003 Program Performance Summit, June 2004 BIT/Prognostics Workshop June 2004 Test & Evaluation in SE Summit, August 2004 Quality Summit, November 3&4, 2004 Systems Engineering Conference (every October) Net Centric Operations Conference (every Spring) CMMI Technology Conference (every November)

Major 2006 Activity

Update of Top 5 SE Issues Top 5 (7) SW Issues Review OSD Risk Mgmt Guide (Mar 06) Review Contracting for SE Guide (May 06) Software (Systems Assurance) Workshop, Sept 05 CMMI Issues Summit, Sept 05 ONR Integrated Topside Workshop, Sept 06 OSD “SE Town Hall” May 05 SE Effectiveness Study – ongoing Navy NCEP Guide Review, Sept 05 BIT/Prognostics Workshops, 2005-2006 OSD/NDIA Top 5 Programs

Major 2007 Activity

Navy Topside Workshops SE Effectiveness Study Systemic Root Cause Analysis Systems Assurance Guidebook CMMI V2.0/Beyond v1.2 Workshops USAF SE Effectiveness Study

(National Academy of Sciences) SEP Preparation Guide Review Navy SW Development Techniques Review DoD Software Acquisition Workshop

Major 2008 Activity

Chartered SW Industry Experts Panel Chartered Architecture Framework Working Group Formed Engineering in Manufacturing Committee Serve as “Technical Arm” of the NDIA ICPM

Industrial Committee on Program Management Formed CMMI Working Group Finalized Systemic Root Cause Analysis Study

Report in final preparation Completed Systems Assurance Guidebook Review of USAF Systems Assessment Model Participate in DoD SPRDE Expert Panel

SPRDE = Systems Planning, Research, Development and Engineering Career Field

Task on Chemical Risk Management Task on Health Management Systems

i.e. Prognostics/Diagnostics

Top 5 Programs Awards

Given to Top 5 Programs based on performance driven by SE

Dual Awards to government and industry Formerly Top 5 SW Programs, awarded at STC 2007 winners:

Advanced Field Artillery Tactical Data System (AFATDS)/Army PM Battle Command/Raytheon Ft Wayne

DDG 1000 MK57 Vertical Launching System (VLS) /Raytheon Integrated Defense Systems/BAE Systems

A-10 Precision Engagement /USAF Aeronautical Systems Center/Lockheed-Martin Systems Integration

Advanced Extremely High Frequency AEHF) Mission Control Segment (MCS)/USAF Military Satellite Communications Wing/Lockheed Martin Space Systems

Portable Excalibur Fire Control System (PEFCS) /Army EPIAFS PM/Army ARDEC Fire Control Systems Picatinny

CMMI®

Capability Maturity Model Integration®

Developed to cause Integration of software engineering, systems engineering, general hardware/design engineering, and program management

NDIA SE Div is overall Industry sponsor, and serves as CMMI Steering Group Chair

OSD Systems & Software Engineering is DoD sponsor Software Engineering Institute is designated custodian Released Dec 2001 Update v1.2 (CMMI-DEV) released Aug 25, 06

Incorporated many “integrity” changes Includes new “Constellation” architecture, with CMMI-DEV,

CMMI-ACQ, and CMMI-SVC CMMI-ACQ released mid-2007 – CMMI for Acquirers! CMMI-SVC in development – CMMI for providers of service

®CMMI is registered by the U S Patent & Trademark Office by Carnegie Mellon University, Software Engineering Institute

For more info on CMMI go to http://www.sei.cmu.edu/cmmi

IEEE SE Council IEEE Systems Council formed

IEEE Societies are almost 100% focused on Research and Technology

Systems Council focuses on Application SE Council plans to bring tremendous leverage to our

industry community (65% of all IEEE members are industry)

IEEE Systems Conference: April 2007, Honolulu April 2008, Montreal QUE April 2009, Vancouver BC

IEEE Systems Journal, 1st issue 2Q2007 IEEE SE Accreditation effort starting now

Will be followed shortly by SE Certification to include domain experience

Implications for Academia

OSD and Services have recognized need for better SE on programs

Services have allowed their SE capability to atrophy, presuming that all SE content will come from Industry

Both Industry and Services are in need of more experienced SE talent All major defense contractors have partnered with academia

on SE master’s programs Per Stevens Institute data, there are only 30 SE Master’s

programs in US Universities, and 70+ total SE programs Many companies have additional in-house programs for

senior SE capability development

Questions?Comments?

Questions or comments?