28
Newport News Shipbuilding Takes the Pain out of Compliance & Testing September 21, 2016, SAP TechEd Conference Deborah Rogers QA & Automated Test Lead

Newport News Shipbuilding Takes the Pain out of Compliance & Testing

Embed Size (px)

Citation preview

Page 1: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

Newport News Shipbuilding Takes the Pain out of Compliance & TestingSeptember 21, 2016, SAP TechEd Conference

Deborah RogersQA & Automated Test Lead

Page 2: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

22

Agenda

• Intro to NNS

• NNS Applications

• Takeaways Summary

• Business Needs & Drivers for Functional Test Automation

• Automation Goals

• Approach

• Project Benefits

• Results

• Best Practices

• Future Plans & Expansion

Page 3: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

3

Who We Are – Our Business

• Over a century designing, building, overhauling and repairing ships for the U.S. Navy, the U.S. Coast Guard and world navies

• The nation's sole industrial designer, builder and refueler of nuclear-powered aircraft carriers

• One of only two companies capable of designing and building nuclear-powered submarines

• One of the nation’s leading providers of major surface combatants (destroyers, cruisers, high endurance cutters, and amphibious assault ships) for the U.S. and international navies

• Have built over 40 percent of the U.S. Navy’s current surface combatant fleet

• After-market services – maintenance, repair, and overhaul –

support a wide array of naval and commercial vessels

• A wide variety of products and services to the commercial energy industry and other government customers, including the Department of Energy

Page 4: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

4

Core Competencies

Leveraging our world-class facilities, highly skilled workforce and culture of safety, ethics and compliance

Nuclear Operations

Heavy Manufacturing Engineering &Program Management

Page 5: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

5

Huntington Ingalls Facts

• Annual revenues of approximately $7 billion and current backlog of $21.3 billion

• Employees: approximately 35,000; largest industrial employer in Virginia, largest private employer in Mississippi

• Key Locations: – NEWPORT NEWS SHIPBUILDING

• Newport News, VA (Nuclear Aircraft Carriers, Submarines, Overhaul)• Virginia Beach, VA (AMSEC, Fleet Support)• San Diego, CA (Continental Maritime of San Diego, Fleet Repair & Support)

• Broomfield, CO (SN3, Nuclear Facility Management and Environmental Remediation)

• Panama City, FL (Undersea Solutions Group, Manned and Unmanned Undersea Vehicles)

• Houston, TX (UniversalPegasus International, Engineering and Project Management Services to Domestic and International Energy Markets)

– INGALLS SHIPBUILDING• Pascagoula, MS (Surface Combatants, Amphibs, CG large cutters)

The Nation’s Leading Military Shipbuilder

Page 6: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

6

Newport News Shipbuilding• Sole supplier of U.S. Navy Aircraft Carriers

• One of two builders constructing Virginia- Class nuclear submarines

• Exclusive provider of refueling services for nuclear-powered aircraft carriers

• Largest non-governmental provider of fleet maintenance services to the Navy

• Largest industrial employer in Virginia – about 20,000 employees

• Home of one of the Western Hemisphere’s largest dry docks and cranes

Page 7: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

77

What You Will Learn Today

• How Newport News Shipbuilding uses automation for stress-free SOX compliance

• How functional test automation enables over 80% time savings with every regression testing cycle

• How automated business process testing keeps customers happy with reliable quality across EHS, Payroll, and Materials Management processes  

 

Page 8: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

88

Key Takeaways

• Learn how you can support compliance with business process documentation, easy-to-capture screenshots and compliance data that make your life and your auditor’s lives easier

• See how to accelerate regression testing cycles so that your team can spend more time on value-added activities and less on manual tasks

• Discover how to avoid testing in silos, quickly uncover defects, improve quality, and achieve high test coverage even in the face of continuous system changes 

Page 9: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

99

NNS Applications

• SAP®

– including modules for HR, Payroll, Finance, Planning, Scheduling, Materials, EH&S

• .NET

• Mainframe

• C#

• Teamcenter®

Page 10: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1010

Business Needs & Drivers for Functional Test Automation

• NNS required a solution to regression test SAP Support Packs

• Needed end-to-end testing to ensure processes flowed across the enterprise landscape

• Required a tool that could not only support SAP, but also Teamcenter and Windows®

• Desired a solution with no coding involved; Wanted functional team members to be comfortable without the need to learn dedicated programming skills

Page 11: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1111

Automation Goals

• Validate critical business processes to avoid business disruption

• Reduce production defects; Improve the quality of testing

• Quickly build and maintain complex end-to-end tests

• Maintain the integrity of existing systems

• Reduce testing cycles

• Save time and money

• Replicate tests the same way every time for greater confidence

Page 12: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1212

Approach

• Organization & Executive Support: Established support from CIO, Systems Engineering, and Software Development

• Project Start Up & Training: Initially gathered the end-to-end workflow processes with the input of 20 team members.

– Today only one person manages the “cradle to grave” tests.

• Building the Automation Portfolio: Developed a centralized, robust library of mission critical repeatable tests, sorted by business process

Page 13: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1313

Audit Documentation for SOX Compliance

Screen shots obtained from a demonstration Worksoft system

Page 14: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1414

Audit Documentation for SOX Compliance

Screen shots obtained from a demonstration Worksoft system

Page 15: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1515

Goods Receipt with Execution Log

Screen shots obtained from a demonstration Worksoft system

Page 16: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1616

Time Entry with Execution Log

Screen shots obtained from a demonstration Worksoft system

Page 17: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1717

Planning Run with Execution Log

Screen shots obtained from a demonstration Worksoft system

Page 18: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1818

MRP List with Execution Log

Screen shots obtained from a demonstration Worksoft system

Page 19: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

1919

Approach

• Moving to Automated Document Generation: Used Worksoft Certify Business Process Procedure™ (BPP) to create automated documentation for auditors to ensure SOX compliance

– BPP is very customizable; Ability to include use filters; Include an expansive level of detail

– Screen shots are saved with testing steps– System used to capture before and after screen shots (which are

timely to produce manually)– Automated system set up to collect critical data– Technical level of detail is critical for auditors

Page 20: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2020

Certify Business Process Procedure

Screen shots obtained from a demonstration WorkSoft system

Page 21: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2121

Certify BPP Template List

Screen shots obtained from a demonstration WorkSoft system

Page 22: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2222

Audit Documentation for SOX Compliance

Page 23: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2323

Results

Business Process Coverage• NNS is using Worksoft Certify® to automate the functional testing of processes that

support key areas in Planning, Scheduling, Materials Management, Group Pegging and Distribution, Inventory management, Payroll, Radiological controls

• 90% of tests to support highly critical business processes have been completed• 47 business process scenarios (workstreams) covered

Greater Frequency in Quality Assurance & Defect Identification• 200 regression tests run 6 times a year, every other month. • Previously 16 team members ran tests manually – spending 177 hours.• Staff has their time back. Now, automated run time is less than 40 hours. This

includes time spent on “fixes” and repairs. • Testing prior to releases uncovers defects headed for production. Team able to catch

and fix before production.

Page 24: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2424

Project Benefits

• Reduced Test Cycles: Regression testing time is reduced from 4 weeks to 1 week

• Time Savings: 80% time savings

• More Defects Uncovered: defects detected before entering production (greater defect removal efficiency)

• Getting Time Back: Systems engineers and software development analysts were both needed for testing previously. Now systems engineers are dedicated to other higher value-added projects

• Improved Quality: More comprehensive, reliable test coverage for EHS, Payroll, and Materials Management business processes 

• Capturing “Tribal” Knowledge: Knowledge has been centralized & documented

Page 25: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2525

Best Practices & Learnings

• Training is Key: NNS arranged for 20-30 team members to be available part-time over a 6 week time frame to get mission-critical tests up and running; Create a central resource for knowledge.

• Map Out Business Processes: Take the time to do this. Key learnings take place during the process!

• Utilize Experts: NNS subject matter experts and a Worksoft consultant worked closely to map the connections of each system across the enterprise landscape. This core understanding was critical for fast start up.

Page 26: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2626

Future Plans & Expansion Beyond SAP

Increase Customization of SOX Compliance Documentation• Want to continue to impress auditors with comprehensive data

Expansion in Testing Beyond SAP• Plans for C#, .net, mainframe applications testing• Teamcenter (Siemens PLM)

Page 27: Newport News Shipbuilding Takes the Pain out of Compliance & Testing

2727

Citations

• SAP® is the registered trademark of SAP SE in Germany and in several other countries.All SAP screen shots used with permission from SAP SE.

• Worksoft® Worksoft Certify® and Worksoft Certify Business Process Procedure® are registered trademarks of Worksoft, Inc.

All Worksoft screen shots used with permission from Worksoft, Inc.

• Teamcenter® is a registered trademark of Siemens Product Lifecycle Management Software Inc.

• Windows® is a registered trademark of Microsoft.

• Individual elements of this presentation may not be copied or distributed without the express written consent of Huntington Ingalls Industries.

Page 28: Newport News Shipbuilding Takes the Pain out of Compliance & Testing