21
Sustainment Capability and Capacity and Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael Phillips D. Michael Phillips David Zubrow, Ph.D. © 2013 Carnegie Mellon University

Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Sustainment Capability and Capacityand Capacity

Sarah A. Sheard, Ph.D.Robert FergusonAndrew P. Moore, Ph.D.D Michael PhillipsD. Michael PhillipsDavid Zubrow, Ph.D.

© 2013 Carnegie Mellon University

Page 2: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

SEI Objectives

The SEI works to:•Identify, research, evaluate, and advise on software y, , ,engineering technologies, trends, and practices •Collaborate with and leverage work found in industrial research, academia, and government laboratories•Mature promising software engineering technologies to enable standards, transition, and adoption•Enable government & industry organizations to make measured improvements in their software engineeringmeasured improvements in their software engineering practices

2© 2013 Carnegie Mellon University

Page 3: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Two SEI sustainment presentationsSustainment Capability System Dynamics ofSustainment Capability and Capacity This presentation

System Dynamics of Sustainment Bob Ferguson (4:05 p.m.)

Value of SustainmentSustainment Cycles

Research QuestionsNeed for Sustainment WorkSustainment Cycles

Why Invest?Sustainment Capability

Need for Sustainment WorkGaps as Sustainment ForcesSystem Dynamics ModelSustainment Capability

Sustainment CapacitySustainment Processes

System Dynamics Model ScenariosOutcomes

System Dynamics ModelFuture Work

Plans

3© 2013 Carnegie Mellon University

Page 4: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Value of Sustainment

Make equipment ready for operational theaterPrevent obsolescence in older equipment (technology refresh)q p ( gy )Reduce need for costly new-start programsFill gaps before new-start programs are ready

4© 2013 Carnegie Mellon University

Page 5: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Sustainment Cycles Engineering & D li

AdaptivePerfective

Operational

Fix & InstallAcquire

New

& Delivery= Relative

cycle times

Operational System Materiel

Build / Fix Infrastructure

Operational Performance

CorrectiveInfrastructure

=Capability & Capacity

DevelopmentPerformance

FundingOperational N d A l iNeeds Analysis

Threats

5© 2013 Carnegie Mellon University

Page 6: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Sustainment Investment NeedsUnderstand new hardware (staff must learn how new

hardware works)Upgrade software of existing equipment to correctly

command, and manage data, from new equipment Purchase or develop tools; finance learning curveRewrite processes for new equipment, knowledge, and toolsRewrite processes for new equipment, knowledge, and toolsPurchase or create training courses; send people to courses

New O ti l

New O ti l

New Technology

Operational Equipment

Operational Software

Training in New Operational Equipment,

New Sustainment Tools

New Sustainment Processes

q p ,Tools and Processes

6© 2013 Carnegie Mellon University

Processes

Page 7: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Why Invest in Sustainment Infrastructure?

Capable, stable workforce (lower turnover, refreshed skills)Reduced sustainment time (skilled employees ready now)Reduced sustainment time (skilled employees ready now)Reduced cost (skilled employees work faster)Higher quality software (tools with error detection)g q y ( )Reduced maintenance errorsInnovation easier (new tools and techniques)

7© 2013 Carnegie Mellon University

Page 8: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Definition: Sustainment Capability, Capacity

Capability

Hiring

Training, Tools

8© 2013 Carnegie Mellon University

Page 9: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Increasing Sustainment Capacity

Hiring: Costs, delay, difficulty (government salaries instability);

Hiring / Contracting (Count & Capability)

Fresh skills(government salaries, instability); two years to understand job Contractors: Domain experience?Organic/Contractor law+’s

Long-term retention, long-

Organic/Contractor law+ sTraining (Capability)

term domain expertise, better performance

Takes time, takes people away from sustainment -’s

T li (C bilit )Faster development,

possibly fewer defectsLearning curve

Tooling (Capability)

9© 2013 Carnegie Mellon University

Page 10: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Sustainment Cycles Engineering & D li

Operational

Fix & InstallAcquire

New

& Delivery

Operational System Materiel

Build / Fix Infrastructure

Operational Performance

Infrastructure=Capability& Capacity

DevelopmentPerformance

BudgetingOperational N d A l iNeeds Analysis

Threats

10© 2013 Carnegie Mellon University

Page 11: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Measuring Sustainment ProcessesInput Output Throughput Cycle TimeInput Output Throughput Cycle Time

Operational Performance

Missions measured by capabilities used and mission-capable availability

Action reports measured by %success and availability gap

Missions performed Days to months

O ti l N d A l iOperational Needs Analysis

Mission performance measuresNew potential threats, technologies, uses, and mission capabilities

New capability definition Prioritized operational needs

Weeks to months

E i i & D liEngineering & Delivery

Sustainment demand (accepted and not-accepted requests)Sustainment capability required (skills, tools, f iliti )

Delivered products by count of deployments and costsSustainment gap (i.e.,

t t t d)

Sustainment capacity

Hours to months

facilities) requests not accepted)Capability & Capacity Development

Changes to training, tooling, facility, and processesHi i f l h d i i

Capacity available (%request)Capability availability date or d l

Capability changes, capacity i

Months to years

Hiring, furloughs, and attrition delay improvementBudgeting for Improvement

Funding requested for capability and capacity development

Time required to fund, amount funded

Funding requests satisfied

Multiple years

11© 2013 Carnegie Mellon University

Page 12: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

System Dynamics Model

Budgeting

12© 2013 Carnegie Mellon University

Page 13: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Future WorkP tf li f j t

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Hire The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Project A Customer

Portfolios of projects Colors of moneyCapability: Specific skills

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Organizational Staff Pool

Allocate

TrainTrain

Fund

Contribute

Organic vs. contractor considerations

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Project A Staff

SustainThe image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Capabilities

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Project Knowledge

TrainThe image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

Project A Sustainment Activities

Systems/Software sustainment integration issues

Early life-cycle sustainment considerations: • What sustainment costs depend on system design?

Wh t d i t ill d t i t t ?• What design aspects will reduce sustainment costs?• How to estimate sustainment costs early

13© 2013 Carnegie Mellon University

Page 14: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Distinctive Competencies

The SEI’s distinctive competencies include

• Software Engineering and Research

• Cybersecurity

• Emerging Software Technologies

• Acquisition Solutions

14© 2013 Carnegie Mellon University

Page 15: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Contact Information

Sarah SheardSenior Engineer

U.S. MailSoftware Engineering Institute

Software Solutions DivisionTelephone: +1 412-268-7612Email: sheard@sei cmu edu

Customer Relations4500 Fifth AvenuePittsburgh PA 15213-2612Email: [email protected] Pittsburgh, PA 15213 2612USA

Web Customer RelationsWebwww.sei.cmu.eduwww.sei.cmu.edu/contact.cfm

Customer RelationsEmail: [email protected]: +1 412-268-5800SEI Phone: +1 412-268-5800SEI Fax: +1 412-268-6257

15© 2013 Carnegie Mellon University

Page 16: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

BACKUP SLIDES

16© 2013 Carnegie Mellon University

Page 17: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Sustainment vs. Maintenance

SustainmentA phaseS ft d h d

MaintenanceActivitiesS t k l b fSoftware and hardware

upgraded togetherIncludes maintenance

Some take place before sustainment phaseHardware maintenanceIncludes maintenance

activitiesIncludes infrastructure i t d i t t

Hardware maintenance “return to original function”Software maintenance “ h t i i l f ti ”improvement and investment

People, processes, tools, …“change to original function”

17© 2013 Carnegie Mellon University

Page 18: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Kinds of Software Sustainment

Corrective: Correct discovered problems (bug fixes)Perfective: Add features for performance and value (new algorithm for

improved resolution) Adaptive: Addressing external changes (other system, data standard)Preventive: Correct latent flaws, system assurance (information, safety), y ( , y)

Sustainment cyclesFastest (<3 months) Immediate bug fixesFastest (<3 months) Immediate bug fixesFast (112 months) Obtain tools and equipment, obtain suppliesSlower (12 24 months) Preventive, Adaptive, and PerfectiveSlowest (2 5 years) POM cycle major upgrade, modernization

18© 2013 Carnegie Mellon University

Page 19: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Motivation: Software SustainmentHow Is Software Sustainment Different?

Problem > Project > Promise

Hardware Maintenance: Updating and replacing partsModernization is separate

Software Sustainment: Fixing problems, designing for new technology, adding features

Cost is huge, undefined (70% of life-cycle cost)Software grows through >20 years of technology changes

Problems

Software grows through 20 years of technology changesTechnology changes require updates to people, skills, tooling, processes

Failure to invest in infrastructure produces“tipping point” – fleet requires modernization

Working assumption

pp g p qor new program.

Project goal: Develop an investment model of software sustainment costs to improve decisions and prevent tipping points

19© 2013 Carnegie Mellon University

to improve decisions and prevent tipping points.

Page 20: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Customer and Sustainment Space

20© 2013 Carnegie Mellon University

Page 21: Sustainment Capability and Capacityand Capacity...Sustainment Capability and Capacityand Capacity Sarah A. Sheard, Ph.D. Robert Ferguson Andrew P. Moore, Ph.D. D Michael PhillipsD

Copyright 2013 Carnegie Mellon University

This material is based upon work funded and supported by the Department of Defense under Contract No FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software EngineeringNo. FA8721 05 C 0003 with Carnegie Mellon University for the operation of the Software Engineering Institute, a federally funded research and development center.

Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the United States Department of Defense.

NO WARRANTY. THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHEDON AN “AS-IS” BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY EXCLUSIVITY OR RESULTS OBTAINED FROM USE OF THE MATERIALMERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT.

This material has been approved for public release and unlimited distribution.

This material may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at [email protected].

DM-0000675

21© 2013 Carnegie Mellon University