1

Everything You Need to Build a Risk-Based Testing Strategy for SAPChris Kraus

Sr. Director Product Management

Email: ckraus@worksoft.com,

Twitter: @ChrisKraus3

4/12/2017 © 2017 Worksoft, Inc.

2

• Perspective – Change is a Constant

• Building a Risk Based Testing Strategy for SAP

• Introduction to Worksoft Certify

• Demo

• Q and A

4/12/2017 © 2017 Worksoft, Inc.

Agenda

3

“By 2020, 60% of digital businesses will experience a major service failure because of IT teams’ inability to “manage digital risk in new technology and use cases.”

Gartner Projection

The Pace of Change Drives Digital Risk

4

“This is probably good news for incumbents, since many of them

are carefully watching tech start-ups to identify the winning plays

and then imitating them at their own bigger scale. That approach,

to be sure, demands cutting-edge agility to excel on all the

operational and organizational aspects of digital maturity.”

4/12/2017Source http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/the-case-for-digital-reinvention

Agility Has Never Been More Important!

5

SAP… Change Is a Constant

• When a new process becomes available, how quickly can I integrate the process into my business and begin realizing its benefits?

• How can I decrease the time required to implement system changes and events?

• How do I improve implementation performance, mitigate risks, leverage accelerators, and measure adoption?

EFFO

RT

ONGOING CHANGEEVENTS

DISCRETECHANGEEVENTS

…establish a quality platform to minimize time/cost of change event efforts

Consolid.

New Implementation

Upgrades

New Processes

TIME

CustomDev.

CustomDev.

Custom Dev.

Hot Packs

Support Pack Support Pack

CHANGE EVENTSBusiness drivers Changed business processes, M&A

re-organizations & new products, vendors…

Compliance drivers Governance, risk management &

compliance

Technology drivers New functionality & Upgrades

Transforming software change control into business change control –company-wide, across SAP and non-SAP landscapes

6

“Quality & Testing” Biggest Pain Point Of Upgrades

0

10

20

30

40

50

60

70

80

90

83%

17%

% Members

IN THE PROCESS OF UPGRADING

NOT UPGRADING

Major Cost and Time Factors during Upgrade or Implementation, % Customers

QA & Testing

Change Mgmt.

Planning

Training & Doc.

Resource Mgmt.

Complexity

Project schedule

n=52

75%

30%

16%

12%

7%

5%

0%

Source: ASUG Test influence council member survey 2013

Testing and coverage is the #1 stated pain point for all customers

Over 86% of customers are concerned about risks due to lack of comprehensive testing

Complexity and project schedule are rated much lower compared to the rest

7

The SAP systems are extremely complex and getting more so at an alarming pace!

• Many touch points withother internal and external systems increase risk-prone breakage areas

• Multi-component development efforts greatly increase wait/downtime

• Complexity of systems renders duplication for Dev/QA extremely costly if not altogether impossible

Top SAP Testing Pain Points

Number of interfaces (counting point-to-point connections):

Source: Results of the global Survey 2016 for SAP Process Integration (Part 1 of 2)

% of users

8

Unclear poorly defined

Requirement Risks

Complexity

Technical Risks

Failure to address priority conflicts

Schedule Risks

What Are the Risks?

“Risk Based Testing is a method for prioritizing the tests based on the risk of their failure because testers cannot test everything with available resources, usually it

starts early in the project cycle.”

Source: International Journal of Computer Applications (0975 – 8887), Volume 65– No.1, March 2013. Risk-based Testing Techniques: A Perspective Study. Md. Mottahir Alam and Asif Irshad Khan.

9

• Prioritize tests based on ability to discover

defects – Find the Really Bad Stuff First

• Allocate testing resources based on potential

business impact and increase testing

efficiency

• Ability to optimize compressed test windows

without increasing critical defect risks

• Better Manage Change and GO FASTER!

4/12/2017 © 2017 Worksoft, Inc.

Benefits of Risk Based Testing

10www.worksoft.com

Quick Intro to WorksoftAutomation for End to End Business Process Testing

Global Organization

Offices in Dallas TX, London UK & Munich Germany

Diverse Global 5000 customers across N. America, Europe & Asia

Worldwide support and services

Innovative Technology

First-to-market with business process testing. First with process mining for SAP.

Focus on Enterprise Apps: SAP, Salesforce.com, Workday, Oracle and many others

5 patents awarded, 2 in progress

Ranked #1 by Gartner in Test Automation for Packaged Enterprise Applications

Diverse Community

SAP Partner

Global partnerships with the leading system integrators

Thriving practitioner community with peer learning, blogs & customer-generated content

Worksoft University and certification programs

114/12/2017 © 2017 Worksoft, Inc.

How Do You Manage the Change?Common Approaches for Risk Based Testing in SAP Transports

Option 1 - Use Solution Manager, Run TBOMs & BPCA

Challenge: Updated Business Blueprints are required.

Challenge: Transactions need to be run with the TBOMs running to get dynamic code analysis.

BPCA (Business

Process Change Analyzer)

1

3

2

12

Advantages:

• Speed - Tests can then be immediately run in Worksoft Execution Manager or HP QC

• Insights - Data can be imported into Worksoft Analyze and graphically visualized

4/12/2017

How Do You Manage the Change?You Don’t Have to Test Everything. You Just Need to Test the Right Things.

Option 2 - Use Worksoft Certify and Impact

What Do We Have?

What Are the Risks?

What’s Changing?

See the SAP transactions, programs and objects that are effected

Learn the risks by seeing what is not covered and what the STO3 associated risks are.

Overlay your existing Certify processes that test those Tcodes.

1

3

2

13www.worksoft.com

Worksoft Solutions & TechnologyFrom Continuous Delivery to Continuous Transformation

Discovery & visualization

Process Mining for SAP

Interactive & Passive Capture

Advanced analytics

Business process testing

Certify Impact

Visual authoring

Out-of-the-box optimizations for select enterprise apps

Continuous execution

Lights-Out testing

Multi-tenant cloud services

Massive, elastic VM support

Worksoft Analyze® Worksoft Certify® Operations Suite

14

Worksoft Certify Impact: Risk Based Testing for SAPDeveloped for change management teams and non-technical users

Certify Impact Key Features:

• Automated change impact analysis for SAP

• Automated identification of changes made by transports in SAP

• Identification of appropriate tests to run in Worksoft Certify test portfolio

• Integrates with SAP’s BPCA for a more detailed change analysis

• Works in real-time

Only execute the tests needed to verify the change, not the entire

regression library!

Certify Impact minimizes the time required to test

changes as they are brought into the SAP landscape

WHAT IMPACT IS NOT GOOD FOR:

Conquering the Complexity of SAP Changes!

• Comparisons between two SAP systems• Code analysis• Reporting of object level changes.

BPCA can be used for this level of detail. We help with BPPs and TBOMs.

15

3. Execute Identified Business Process Tests to Validate Changes in SAP System

2. Locate impacted objects in Worksoft Certify Business Process Tests

Provides an SAP-specific solution for ABAP-stack applications

Performs a deep and thorough analysis of selected SAP transports

Certify Impact – Approach

Certify Impact

SAP® Applications

ERP

SAP Applications Certify Database

TransportsWorksoft Certify®

Business

Process Tests1. Inspect Transport for Impacted Transactions and Programs

Impacted Objects

16

Example Of Certify Impact Object Analysis

Domain

Data Element

Fields

Tables

Structures

Function Module

Include Program

Calling Program

Transaction

IDOC_INPUT_ORDERS

D_AUART

RV45A

AUART

VBAK

VBAK-AUART

MV45AOAT

VA01

SAPMV45A

17

• Analyze change for

• Identify major and minor projects

• Run and sustain

• Integrate with the testing platform

• Automatically identify test cases that match the

changes being made by the transports

• Automatically execute the test cases from the tool

• Identify testing gaps

• Verify where the gaps exist between current test

library and the changes being made

Impact in Action

18

DEMO

19

• Minimizes the time and resources required to test changes in SAP

• Focus resources specifically on what’s new and different

• Identify, recommend, and execute end-to-end business process tests based

on a set of proposed SAP application changes and their relationships to

critical business processes

• Increases quality in business process execution

• Provides a safeguard for identifying and testing changes before committing to

production

Certify Impact – Business Benefits

20

IDC Validates the Value of Worksoft CertifyThe Business Value of Worksoft Automated Business Process Validation Solutions

Source: The Business Value of Worksoft Automated Business Process Validation Solutions a commissioned August 2014 study conducted by IDC on behalf of Worksoft. Method: IDC assessed the cost, benefits, and value associated with the use of Worksoft Certify by the 12 organizations interviewed for this white paper over a five-year period.

Worksoft Extends Automation and Drives Business Agility

ROI

273%NPV

$11.46MPAYBACK

11.9 mos.

INCREASED AUTOMATIONAutomated business process tests increased from 12% to 44%.

IMPROVED PRODUCTIVITYStaff hours spent doing regression testing reduced by 48%.

LOSSES FROM DEFECTS CUTProductivity losses from defects entering products cut by 44%.

"We were looking for more seamless automation and fewer starts and stops for our regression testing. Worksoft filled that gap. We went from having about 50% to 80% of our regression

processes automated."

21

Questions?

22

Join Worksoft at SAP SAPPHIRE 2017!

May 16-18, 2017Orlando, FLBooth #738

23

• White Paper: Risk-Based Test Automation from a Business

Process Perspective

• Analyst Report: The ROI of Worksoft Solutions: IDC Report

• Data Sheet: Certify Impact

4/12/2017 © 2017 Worksoft, Inc.

Resources: