OOW15 - Testing Oracle E-Business Suite Best Practices

Oracle Confidential – Internal/Restricted/Highly RestrictedCopyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Testing Oracle E-Business Suite Best Practices

Prasanti MadireddiSenior DirectorOracle, E-Business Suite Quality Assurance

Jake WestphalSenior IT ManagerFirst American, Enterprise ApplicationsOctober 26, 2015

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 3

Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Program Agenda

Industry 4.0 & EBS

Testing Challenges

Recommendations & Tools

First American Customer Story

1

2

3

4

4


Industry 4.0

1.0 Power

Generation

2.0 Mass

Production

3.0Electronic

Automation

4.0 Smart

Automation

1782 1913 1954 2015


Business Transformation


Industry Drivers

Business Transformation

Mobile

Analytics

CloudSocial

IOT


EBS Investment Priorities


Program Agenda

Industry 4.0 & EBS

Testing Challenges



1

2

3

4

9


Testing Challenges• Fast growing businesses require quick go-live turnaround• Faster adoption rate of new technologies • Upgrades are rich with new features and new technology• Increasing complexity with different platforms/technologies/UI• Testing to match consumer’s usage pattern


Testing Challenges – Smartphone Applications

Functional

User Interface

Performance

Security

Translation

Installation

Accessibility

Usability

Operating Systems

OS Versions

Devices

Device Models

Networks


Testing Challenges – In Memory Applications

Functional

User Interface

Performance

Translation

Security

Accessibility

Usability

Data Setup

ETL (EBS & Standalone)

Configurations

User Interface


Testing Challenges – Information Discovery

Functional

User Interface

Performance

ETL

Translation

Security

Accessibility

Usability

Multi-layer validations

Synchronization

Data Intensive

Data Integrity

High Level of Precision


Testing ChallengesDelivering Quality Product

Quality

Impacted Area

Upgrades

14


Program Agenda

Industry 4.0 & EBS

Testing Challenges



1

2

3

4

15



Analyze

Design

BuildTest

Release

Quality Focus in SDLC

Prioritize and freeze requirements

Incorporate feedback from previous release

Analyze

Design

BuildTest

Release

Analyze

Design

BuildTest

Release

Analyze

Design

BuildTest

Release

Analyze

Design

BuildTest

Release

Document deliverable review

Approval by all stakeholders

Code review and inspection

Unit testing by developers

Manual testing

Automated testing

Perform internal audits

Post mortem analysis of release


Analyze

Design

BuildTest

Release

Recommendations & ToolsQuality Focus in SDLC

Prioritize and freeze requirements

Incorporate PMA feedback from previous release

Document deliverable review

Approval by all stakeholders

Code review and inspection

Unit testing by developers

Manual testing

Automated testing

Perform internal audits

Post mortem analysis of release


Recommendations & ToolsOrganization Alignment



Formulate test scenarios

Prioritize based on usage patterns

Optimize test scenarios

Create test data volume and

variety

Testing workshops for group and role based testing







variety


Release Content

Document

Functional Impact

Assessment Document







variety








variety


Factors and Levels All Possible Combinations Pair Wise Combinations5 factors at 3 levels each 243 11

6 factors at 4 levels each 4096 23

7 factors at 6 levels each 279,936 56

10 factors at 7 levels each 282,475,249 89







variety


API/OI/WS







variety



Recommendations & ToolsAutomation

Who

• Everyone!• Functional engineers

can assemble the flows

• Automation engineers can stabilize and add validation points

What

• Critical sanity flows • High priority flows• Most repeatable

functional feature flows

When

• Should be on the high priority list

• Product features should be stable

• Like a vacation, anytime is good time for automation


Application Quality ManagementSolutions to Manage Quality

26


• Load and Performance Style Testing• Web and Oracle Application Testing Accelerators• Smart Integration with EM Diagnostics

• Test Planning, Requirements and Test Cases• Defects Tracking• Reporting

• Functional and Regression Testing• Web and Oracle Application Testing Accelerators• Oracle Flow Builder and Starter Pack

Oracle Application Testing SuiteOverview

Oracle Functional Testing Suite for Oracle Applications

Oracle Load Testing Suite for Oracle Applications

Oracle Test Manager

27


Oracle Functional Testing Suite for Oracle ApplicationsOracle Flow Builder and EBS Pre-built Test Content

• Use Flow Builder to Generate Test Scripts

• Start with EBS Pre-Built Test Content

• Create and Maintain Your Test Scripts– Add Your Flows & Data– Extend with More Components– Support Customizations– Non technical resources

Record Manually

Generate

Test Automation

Scripts

OpenScript Record & Playback

+ Advanced Scripting

Flow BuilderFramework to combine

flows and data to generate test scripts

EBS Pre-Built Test Content

Your Data

Your Flows

Ora

cle

Func

tiona

l Tes

ting

Suite

fo

r Ora

cle

Appl

icati

ons

EBS Quality Assurance Team Reduced Automation Time by 60%

28


Oracle Flow Builder: EBS Pre-Built Test ContentStarter Pack

• Commonly used base functionality

• For creating high level certification flows

• Broad coverage to jump start the testing

For Both 12.1.3 and 12.2 Click icon to add picture

2000+ Components and 200+ Flows across EBS

ProcurementFinancials

ManufacturingLogistics ServiceMaster Data Management

Order Management

29

Asset Lifecycle

Management

Projects HCM

3600+ components and 230+ flows across EBS

Logistics Manufacturing Financials

ProjectsProcurement

Product Information Management Service

Human CapitalManagement

Order Management

Asset Lifecycle

Management


Oracle Flow Builder: EBS Pre-Built Test ContentAdvanced Pack

• Niche products which stand alone and deep functionality

• For creating detailed and complex test flows

• Significant number of components above Starter Pack (95% coverage)

For Both 12.1.3 and 12.2 Click icon to add picture

30

10 product families / products across EBS

Incentive Compensation

Discrete Manufacturing

Channel Revenue

Management

Project ManagementProcurement

Process Manufacturing

Property Manager Service

Lease /Finance Management

Asset Lifecycle

Management

PROCESS • ANALYTICS • TECHNOLOGY 31© 2014 Copyright Genpact. All Rights Reserved.

“ Overall, Oracle EBS team is simply awesome to work with. Incredibly flexible, easy to communicate with, prompt responsive and goes beyond the boundaries to recommend best solution. It was phenomenal partnership in sales and implementation….” – Genpact Leadership

Oracle Flow Builder has been instrumental in building long term regression test suite for our customers.

It very well supports the Standard Oracle Forms and Web pages. It is also scalable to customizations which is incredible.

The standard Components and Flows that come along with the basic package have a very good coverage in terms of types

of transactions performed in E-Business Suite. Easily Scalable.

Very High Reusability as it offers simple Java based coding for developing new custom components or modify pre-built component for specific business flows.

Open Script and Flow Builder supports iterative runs and helps perform complex and time consuming setups, reduces time

during cutover……..Less System Downtime.

Oracle Flow Builder and ORACLE EBS Team ---- Testimonial


Program Agenda

Industry 4.0 & EBS

Testing Challenges


First AmericanCustomer Story

1

2

3

4

32

First American Title Insurance Company makes no express or implied warranty respecting the information presented and assumes no responsibility for errors or omissions. First American, the eagle logo, and First American Title are registered trademarks or trademarks of First American Financial Corporation and/or its affiliates.

The following presentation is for informational purposes only and is not and may not be construed as legal advice. First American Title Insurance Company is not a law firm and does not offer legal services of any kind. No third party entity may rely upon anything contained herein when making legal and/or other determinations regarding title practices. You should consult with an attorney prior to embarking upon any specific course of action.

©2015 First American Financial Corporation and/or its affiliates. All rights reserved. q NYSE: FAF

First American Customer StoryJake Westphal


Enterprise Application Services (EAS)

EAS is a part of the Corporate IT organization and specializes in managing Enterprise Applications.

ProductsOracle R12 Financials (EBS) InsbridgeOracle Fusion Master Data Management (MDM) Oracle Application Testing Suite (OATS)

Oracle Fusion Procurement User Productivity Kit (UPK)

Oracle EPM (HFM/HPM) Oracle Identity Management

Oracle BI/Reporting solutions/OBIEE Oracle Identity Analytics


Testing Challenges

Analyze

Design

Build

Test

Release

- Manual testing vs Automation- Transforming the team- Automation Impact/Benefit

- Who is involved in test plan review- Who approves the scope - How soon to start building test plan

- How to maintain the automation scripts- How to find ways to grow/mature scripts- Incorporate Framework/best practices

- How much do we test - Have we tested this before- Do I need full regression testing

- What’s the right team size- What's the skill diversity - What's the right shift/location


Common Test Management Challenges• No centralized repository for test cases - difficult to track/manage/update the test cases

• Lack of maintenance and accessibility of artifacts such as test cases & test results• Loss of testing artifacts over time due to changes in test cases, process & employee turnover • Difficulty in tracking the progress of test cases/scenarios during testing cycles• Gaps in test plans, test some, test all• No traceability between requirements to test cases to scenarios to defects• Inconsistency in structure of defect reporting by various testers• Testers assigning improper severity/priority to defects-duplicate defects opened• Lack of adequate test result reporting, PMO dashboards,..


R12/OATS Timeline

February 2015 June 2015 August 2015August 2014

Vendor supported OATS Implementation

Performance Test Cycles

R12 Project Test Cycle Kickoff

Leveraging Automation for Testing

Build Full Automation Regression Set

Designed Test Management Process

Determine automation scope

R12 Go Live

December 2015

Future application Automation consideration

May 2014

Designed/Implemented test script mgmt process

Implemented Monthly Regression Suite Testing/Maintenance

Continued Maintenance of Automation Scripts

January 2016


Lessons Learned• Identify types of tests to be performed/requirement traceability• Gather details about testing priorities, focus, scope, impact analysis,….• Building/documenting/applying QA process to support the testing approach/framework• Testing tool - Automation and Manual • Identify regression test cases early for automation and performance testing• Management of different testing cycles (Integration, User Acceptance, Performance…)• Audit value in traceability of requirements, Test scripts, Test Scenarios & Defects• Managing the testing activities

(time spent in test design, test execution, whether we are on schedule or on budget)


QA Test Automation Values

• Automation eliminated the need for module specific testers

• Full regression execution time is reduced 40% with Oracle Application Testing Suite

• Robust automation scripts = less script maintenance

• Auto creation of test scenarios from Flow Builder saved time & brought consistency

• Load testing simulated 500 concurrent users /eliminated need for human intervention

• Established Automation framework


Oracle Test ManagerBrings structure, repeatability and visibility to the testing efforts• 5 integrated modules for total

test process management• Test execution scheduling• Common repository for all assets• Web-based interface• Manual and automated tests• User-defined roles and fields• Increased visibility of test readiness


Oracle Test Manager Key Values• Tool is re-usable from a test management perspective• Central repository of test material/artifacts can be ported for new projects/ test cycles• Tool is scalable for rollout across multiple user groups & products• Ease of user administration functionality• Custom fields provide flexibility to capture additional data - customizable to specific project• Very easy to user/tester friendly • Import feature for loading data helps fast track data entry• Supports both Oracle and non-Oracle web based applications• Tool is configurable to track requirements, test cases, test scripts & defect management• Facilitates integration with 3rd party test tools • Tool has multiple modules to store and maintain respective testing artifacts


Related Sessions

Strategy & Roadmap

MondayOct 26

4:00 p.m.CON6413 - Oracle E-Business Suite Technology: Latest Features and RoadmapLisa Parekh, Vice President, Oracle

Moscone West—3002

TuesdayOct 27

11:00 a.m.GEN6409 - General Session: Oracle E-Business Suite Update, Strategy, and RoadmapClifford Godwin, Senior Vice President, Oracle

Moscone West—2008

TuesdayOct 27

5:15 p.m.CON6410 - Oracle E-Business Suite: Mobile Update, Strategy, and RoadmapJeanne Lowell, Vice President, EBS Product Strategy, Oracle

Moscone West—3022

ThursdayOct 29

12:00 p.m.CON8136 - Oracle E-Business Suite Technology Certification Primer and RoadmapSteven Chan, Senior Director, Oracle

Moscone West—3022

42


Visit Us• Demo Pod – WCL-002 - Automated Oracle E-Business Suite Tests Using

Oracle Flow Builder• Moscone West – Exhibition Hall

Mon, Oct 26: 10:15 a.m. – 6:00 p.m. Tue, Oct 27: 10:15 a.m. – 6:00 p.m.Wed, Oct 28: 10:15 a.m. – 4:15 p.m.


Questions• Prasanti Madireddi – [email protected]• Jake Westphal – [email protected]