Copyright © 2014 HCL Technologies Limited | September 18, 2014 Business Assurance – Oracle Testing Capabilities

Copyright © 2014 HCL Technologies Limited | www.hcltech.com

September 18, 2014

Business Assurance – Oracle Testing Capabilities

Copyright © 2014 HCL Technologies Limited | www.hcltech.com2

Agenda

1

2

3

Business Assurance & Testing Services Overview

Our Oracle Testing Proposition & Methodology

Success Stories


HCL BATS – Snapshot

200+Clients served

worldwide

10000+Professional

testers worldwide

$400+ Mn revenues earned

40+Million dollar

clients

20Testing Global

Delivery centers

Partner Synergies

Global Strategic Service Provider

Partner World For Software

Global System Integrator

Microsoft Gold Certified Partner

Strategic Service Providers

CA-LISA partnership

Global Framework Agreement

Analyst Speak

2014 Leader in Magic Quadrant for testing services globally and a Tier – 1 testing service provider

‘HCL's strong focus and experience in testing services exhibited by its Testing Center of Excellence (TCoE) and Enterprise application testing services (EATS) which bring together industry's best practices and frameworks.’

2013 Leader in Global Discrete and Embedded Product Engineering Testing & Enterprise Application Testing Services

2014 Major Contender as per Everest Group’s PEAK (Performance | Experience | Ability | Knowledge) Matrix for Independent Testing Services - 2014

What Makes Us Different

Proactive Quality over Reactive Testing

Outcome-based Managed Quality Services

Relationship Beyond the Contract

Tool partner


Business Assurance – The Impetus for Change

The Market

- Testing is viewed as a non-value adding necessity- Necessity based on the need to identify errors created earlier- Vendors are seen as equal with commoditized offerings- Cost pressure depressing what the market is willing to pay. Price is a key.- The key value proposition behind an MQS model is outcome-based pricing with guaranteed annual cost reductions- A true MQS model provides the breadth of quality services on a predictable, declining cost basis

The Competition

- Currently ranked 8th in market share among our key competitors- HCL viewed internally and externally as weak in testing- ‘Independent Verification and Validation’ is firmly aimed at the legacy approach to testing- Competitors moving toward a ‘Business Outcomes’ model as opposed to a ‘Testing Process’ model- None has created a coherent market message, value proposition or solution- HLC has very powerful raw assets that would become the building blocks of a real Total Quality solution

The Strategy

- Re-Brand IV & VS as Business Assurance and Testing Services under the tagline ‘Assuring Business Runs As Intended’- Create a Business Assurance Framework as flagship philosophy and solution set offering the Total Quality Umbrella spanning the SDLC.- Align full arsenal of our capabilities behind this framework. Although we will continue to sell ‘point solutions’, our primary wedge will be the Framework.- Redefine ‘TCoE’ as ‘Managed Quality Service’ (MQS) built on the Business Assurance Framework

A bold transformation of HCL Testing will allow us to leapfrog the competition, first in terms of market perception and later in terms of market share.


Financial Challenge for FY15

Revenue ($mn) Target YoY Growth

FY 14 ACHIEVED 128.64 16.50%

FY 15 TARGET 147.85 16.60%

Global Revenue Target

Global Revenue Target by Vertical Global Revenue Target by Geo


Agenda

1

2

3



Success Stories


Oracle Testing - Snapshot

Key Facts

120+ Oracle Testing Professionals

Global Oracle Services Partner

In-house test lab on automation and performance testing

Integrated pool of testing, domain and functional consultants

Support of HCL Oracle EBS consultants , supporting Oracle users around the globe

Global Platinum Partner (the highest level of partnership) One of world’s largest Oracle partners including Product Dev Test Script Repository for Oracle, Within Function and Across Functions Testing,

Functional and Integration Test Scripts Across the Process areas – Financials, HRMS, CRM, SCM, Projects etc.

Key Oracle Testing Customers

Automation Testing

HP Quick Test Professional | HP Service Test | Use Mango Framework | Selenium open source

Performance Testing

HP Load Runner | HP Performance Centre| Rational Performance Tester |Borland Silk Performer | OpenSTA | Compuware QA Load

Defect/ Test Management Tools

Quality Center | ALM | Rational Quality Manager | Testlink |

Bugzilla |

Oracle Capabilities

Test Tools Expertise


Enterprise Application Testing Service Offerings

E-To-E Implementation Test Solutions

Global Rollouts Test Solutions

Upgrades Test Solutions

Product Re-Engineering Test Solutions

Maintenance & Support Test Solutions

Project Streams

ProductLines

SAP

Oracle

CRM( Siebel CRM,

Salesforce.com, MS CRM Dynamics)

DW/BI

EATSService

Offerings

Consulting

•Due Diligence•Assessments•Test Processes definition & implementation

•Metric definition & Implementation

Test Automation•Automation Frame work•Regression Pack Preparation

•Pre-Packed Reusable Automation Components

Non-Functional Testing

•Performance Testing•Security Testing•Conversions Testing•Cutover Testing•Backup and DR Testing•Compatibility Testing•Operational Readiness Testing

Functional Testing

• Requirement Management•Baseline Configuration Testing•Customization Testing•Interface Testing•Integration Testing•Batch Testing•Regression Testing• Support UAT

Core Services

Master data management, Release management & Test environment management Setup


Oracle Testing Expertise

Testing / Validation Partnership with Oracle Global Platinum Partner (the

highest level of partnership) Oracle Certified Advantage Partner Go-to-Market Partner for Edge

Applications Partnering Oracle in Fusion

Applications and PeopleSoft 9.1

Testing

1

2

3

Key Differentiators

Reusable Test Script Repository for Oracle

Applications Testing Ready to Use Test Lab with Product

Licenses Development of Automation framework for

Oracle Application Wrapper functions,

reduce script maintenance and

development effort up to 20%. Flexible Costing Model for Test Automation Oracle Applications Test Scripts By

Processes and Across the processes

(Integration Test Scripts)

Integrated Practice and Solution Lab Investment in Oracle Solution Labs

to accelerate product development

& solution capabilities Ready to Use Solution Lab for all

Oracle Enterprise Applications Improved collaboration across the

Competencies under Oracle Universe

umbrella.


HEAT (HCL EBS Accelerated Testing) Framework for EBS Implementation / Upgrade

Test Planning

Test Design

Performance Test Execution & Reporting

Test Requirement

Analysis1

2

3

4

Definition

Operations Analysis

Solution Design

Build

Production / Go Live

Transition

1

2

3

4

5

6

UATDefects closer

5

Support & Knowledge

Transfer

• Gather High level Business requirement for Testing• Identify Oracle Implementation /Upgrade Methodology • Define Scope of Testing and identify scenarios• Define Test Methodology & Test Types & Test Strategy• Identify & Define Oracle Test environment

• Detailed Test Scenario preparation • Freeze Test data format & combinations• System Test script design • Data Migration Test Case Design• Test Design review (by client) and Sign

• Perform go-live checks • Execute & close /reopen fixed defects• Escalate High priority /severity issues• Conduct perform stress and volume test • Prepare Metrics for defined parameters

• Execute end to end Functional, Integration transactions (cases) test cases• Execute Performance , security tests, System tests• Identify & report defects• Support UAT Execution & Signoff

• Production support • Perform KT to customers core team • Hand over Test reports• Highlight open/pending issues

• Define Test Efforts, Schedules & Metrics parameters• Identify & Define Oracle Test environment• Evaluate Interfaces and Customizations for testing• Freeze Data Migration Test Requirements

AIM Implementation Phases

Testing Activities Phases

• Critical Process• Scenarios• Transactions

Scenarios

On Hold

WIP

issues

OpenIssues

Business

ProcessesTest Plan

Environment

• DRE• ArrivalRate• Turnaround Time

•Creation Productivity•Execution Productivity

• Schedule Variance

• Effort variance

Defect

Productivity

Schedule

Effort

Definition

Business

EBSCompon

ent

Test Scope

Functional

Integration

Security

Test Environment

Production Environment

6


Oracle EBS Testing Approach – Integration with the Implementation team

EBS Implementation/ Roll Out

• Test Planning & Efforts Estimation

• Test Specification Walkthrough• Test Scenario Analysis• Test Concept Finalization &

Signoff

• Test Execution• Publishing Test Results• Discuss Defects• Load & Performance test

requirements• Test Script Creation &

Execution• Publishing Performance

Reports • Regression Testing for new

releases

Oracle EBS Implementation

Activities

• Test Cycle Sing Off• Phase Hand Over to UAT

• Test Case Creation• Test Case Review• Test Case Update • Test Data Preparation• Test Environment Setup

Upgrade, Enhancements

• Release Planning & Efforts Estimation

• Test Requirements Analysis• Test Impact Analysis

• NA• NA• NA

• Automation Analysis / Test Data Preparation

• Creation of Automation Pack• Executing automation Test

Script to Check Regression

• Test Case Update• Test Case Execution• Publishing Test Results• Defect Triage Meetings

Upgrade / Enhancement

Activities

• Post Rel Implementation reviews

• Metrics Measurement & base lining

• Post Rel Implementation reviews

• Metrics Measurement & base lining

Testing Activities

Project definition

Requirement Specification

Gap Analysis Document

Configuration

Customization

System & SI Testing

User Acceptance Testing

Performance & Regression Testing

Go-Live

Pla

nn

ing

Init

iati

on

Exe

cuti

on

/Co

ntr

ol

Clo

sure

Project Planning

Project Management(Work Load Assignment)

• Support Process (eg. New Users)• Run Books

Preparation (eg. Changes in Batch, Schedule, Scripts, Dependencies)

• SLAs• Scripts (eg.

Installation Backup, Database Maintenance Related)

Pre Production Validation

Deployment in Association with IES

Release


Submit forSubmit forCreate

Requisition

Create Requisitio

n

Create Purchase

Order

Create Purchase

Order

Create Receipt

upon receiving

Goods

Create Receipt

upon receiving

Goods

Transfer, Import and

Post to General Ledger

Transfer, Import and

Post to General Ledger

Pay the InvoicePay the Invoice

Create an Invoice in Accounts Payable

Create an Invoice in Accounts Payable

ApprovalApproval

1 3 5 7 9 11 13 15 170

2

4

6

8

10

12

Manual Testing (in Minutes -Approx)

Automation Testing (in Minutes - Approx)

Execution time - Manual VS Automation

1 4 7 10 13 16 19 22 25 28 310

2

4

6

8

10

12

Manual Testing (in Minutes -Approx)

Automation Testing (in Minutes - Approx)

Execution time - Manual VS Automation

Procure to Pay (P2P Cycle) Order to Cash (O2C Cycle)

Comparison Chart- Testing CyclesE

xecu

tion

Tim

e

No. of Scenarios No. of Scenarios

Exe

cutio

n T

ime


Agenda

1

2

3



Success Stories


Testing Services Provided to some of our Customers

Description Solution Scope Testing Services

Characteristics

Customer

Consulting

Implementa

tion Servic

es

Application developme

nt

Application

Support

Application Upgra

de

Functional

Systems

Integration

Performance and Volum

e

Automation Regression

Automated Functional and Regression Testing of Oracle Applications for Largest Automotive supplier in the world ü ü ü ü ü ü ü ü

End to End testing for Siebel 8.1 Call Center Application for a large retail chain company in the US ü ü ü

Application Testing in Siebel CRM and OBI reports for a Product Development Company which helps financial institutions manages funds and assets ü ü ü ü ü

Oracle Financials Automation Regression Testing for a financial security company that specializes in life and long term care insurance wealth management and senior supplement insurance. ü ü

Oracle eBusiness Suite testing for a network solution company that provides innovative network solutions and also help the world’s leading organizations transition smoothly to a virtualized world where applications and information can reside anywhere

ü ü ü ü ü

Siebel–CRM On Demand/Web/BI Analytics/Oracle/Interwoven/ Analytics/e-Service for World largest antivirus/security system company ü ü ü ü ü

Functional, Regression, Automation, Performance and Integration Testing on Oracle Utilities products CC&B, WAM, SoA Suite, OUBI and non Oracle Utilities products GIS, Sun IDM, Web logic Portal Server, Secure MDAS & Energy Audit for reduction of AT&C losses in power sector.

ü ü ü ü ü ü ü ü ü


Enterprise Application Testing – Oracle Apps for world’s premier measurement company

15

The Client: Client is one of the world market leader in the test and measurement (T&M) business. It designs, manufactures electronic and bio-analytical measurement instruments and equipment for test and measurement for a variety of research, medical, and industrial applications

Solution

• Testing services are carried out from HCL’s offshore ODC which includes manual and automated functional, system integration, regression and End to End testing across various multiple OUs. It covers the business processes like P2P, O2C, ISO, Manufacturing, Oracle to Siebel/SAP E2E Flows.

• Testing services covers various Oracle Apps modules like Order Management, Istore, Manufacturing, MML, Procurement, Isupplier, Finance, Iproc, Pricing, Planning, Demantra, Configurator, Oracle Mobile, Oracle-Siebel and Oracle-SAP E2E scenarios.

• Interaction and coordination with Business Users and Project Team to execute Functional scenarios in case of any changes or modification in the existing solution in the system.

• Automated and manual Regression Testing during Application, Browser, & JRE upgrades, Refresh and security patch testing.

• Creation and modification of manual and automated scripts using ALM and QTP.

• Creating and updating existing business process documents.

Customer Benefits• Improvement in quality of client applications –

excellent feedback from client business and end users.

• Cycle time reduction through existing test case reusability and automation testing. (Cycle time reduced up to 30%)

• Standardized Test Processes & Framework.

• Test Repository of 326 test cases covering various modules like Order Management, Istore, Manufacturing, MML, Procurement, Isupplier, Finance, Iproc, Pricing, Planning, Demantra, Configurator, Oracle Mobile, Oracle-Siebel and Oracle-SAP E2E scenarios.

• 90% of the existing regression test cases are automated using HP QTP tool.

• Multiple Regression Cycles for Oracle Refresh Validation, Security Patch testing, JRE and Browser upgrades completed.

.

Business Objectives

• Reduction in Functional Defect Leakage in production by improvement in quality of deliverables

• Reduction in cycle time• Improvement in Business and End Users

satisfaction

Technology Spread

• Oracle Application R12.1.3• Middleware: Dazel, Fusion• HP: ALM v11 and QTP v10• Other ERP and web legacy applications

Engagement Model/ Size

• Offshore, Core & Flexi – 5 Resources• Duration – March 2013 [Ongoing]

Area of Engagement

Large Global Test and Measurement company - Global ERP & custom Applications Testing Engagement.

SCOPE OF SERVICES

• Manual, Automated Functional & Regression• End to End Testing between Oracle and other

interfacing ERP/Custom Applications• Test Process standardization and Improvmt.


HCL’s APO methodology enables the world’s largest antivirus enterprise test center optimize its application landscape

The Client: is one of the largest security software product companies providing security solutions. With headquarters in Santa Clara, California , our customer is a leading supplier of network security and availability solutions creating best-of-breed computer security solutions that prevent intrusions on networks and protect computer systems from the next generation of blended attacks and threats.

Solution

HCL’s Test Factory in a Box [TFiB] along with our BATS Asset Methodology process framework for transition, execution and process management was extensively utilized to help our client address process gaps and streamline the application area of SDLC [Software Development Life Cycle]. We quickly ramped up from a 2 to a 32 member team within 6 months, fully implementing TFiB and PM Smart and were able to show a USD 336K value add to our client within the first quarter of the engagement through the development of a data comparison tool

We followed a 3 phased approach:

1. As –Is: We conducted a test consulting exercise and Application Portfolio analysis to develop critical reports for analysis

2. Recommendations: We recommended process changes and solutions for gaps in technical expertise, together with TFiB implementation as agreed upon by our client

3. Implementation: We focused on CTB initially and on process change in the existing landscape. We are now engaged in continuous process improvements in the overall landscape

Customer Benefits

360 K $ Value added to the engagement within first 6 months, this is 50% return on billing [not investment] as a value to customer.

Phoenix Program Go-Live, 3 year Program on client ‘s Web Portal. This Phoenix Project was over run by 1 year when HCL team engaged. HCL team made it go-live within first 6 months and our key resource names have figured in McAfee Web site as a customer recognition.

Siebel CRM On Premise to On-Demand, one of the biggest Application area Programs is being supported around 80% by HCL. No other previous vendor engaged in more than 30% of the functional spread vis-avis our Managed services program which coupled Siebel functional, Oracle BI and Oracle Fusion together is supporting 80% of the functionalities. Customer saw great value is technology collaboration within three HCL teams, all under one Managed services project.

BATS – Test Factory In a Box has been fully implemented. Daily, weekly and monthly review and metrics have helped customer in not only seeing report fast but able to see the trend and act on the missing risks in terms of coverage, resourcing and new projects identification.

Area of Engagement

Service Areas: Enterprise Applications Testing, Performance and Automation Testing, Content Management , Oracle Fusion and Integration testing.

Business Objectives

Our client had just undergone a takeover and faced the challenge of streamlining its Applications Portfolio, while retiring and enhancing certain critical enterprise applications

HCL was to provide APO, QA consulting and QA managed services with gap analysis and focus on CTB [Change the Business]

Technology Spread

Technologies: Siebel, Oracle BI, DB2, Oracle Fusion, Interwoven

IPs / Frameworks: TFiB [Test Factory in a Box], BATS Asset Methodology


Onsite-Offshore 32 PM


Oracle –Testing for Largest State Electricity Utility in India

Client: Is one of the largest state owned electric utility in India covering a base of almost 11,000,000 customers.

Solution

Testing team consisted of utility domain experts ,oracle functional consultants, automation, and manual test engineers.

Use cases and high level business scenarios were created by the BA team during the definition phase.

Low level test cases were created using use case documents after getting validated from domain team.

The test scripts were customized and parameterized

Automation scripts were run using QTP.

Error Handling Mechanism was developed

Functional testing was followed by integration and system integration testing of the complex oracle system with huge customer data.

Documentation and delivery happened from Offshore

Customer Benefits

Faster and better test coverage with the involvement of testing team during definition phase.

Customer was able to Avoid Failures / Outages due to Inadequate or Improper Testing and Reduce Implementation Cycle Time.

Reduced the time to fix bugs by effective root cause analysis by testing BA team.

Reduce Testing Cost and Reduce Overall Patching Cycle time: from Test to Prod.

Risk Mitigation during Customizations, Patches, Process Changes, and Setup Changes etc.

Area of Engagement

Application Testing in Oracle Utility products- Customer Care & Billing , Work and asset management, oracle portal, GIS, Energy Audit.

Business Objectives

Functional Testing for implementation of oracle utility products.

Integration testing of complete utility application with tightly coupled applications integrated using SOA architecture.

Creating and implementing automated scripts for functional testing of oracle customer care & billing , work and asset management.

Implemented HCL automation framework.

Technology Spread

Quality center for test management. QTP for automation.


Onsite-Offshore


The Client: Leading in manufacturing and distribution of Automatic Teller Machines (ATM), Point-Of-Sale Terminals, Business consumables and High-powered Data Warehousing systems. Largest providers of IT maintenance support and services.

Solution

Conduct performance testing on the application as a proof of concept.

Common business processes were identified Test environment accessed through VPN

setup. Applied the Test Strategy and Execution plan HCL developed the Oracle NCA + Web scripts

to automate the business process using LoadRunner software

Identified the bottleneck on the application and reported to the clients. with detailed Performance Test Report

Customer Benefits

Performance report builds the confidence among all the stakeholders, that this application will provide uninterrupted service even in 500 user peak business hours.

Webserver, JVM Heap memory, Server load balancing, Unix server resource CPU utilizations has monitored and tuned with best configuration parameters during load & stress test.

Area of Engagement

Manufacturing ATM Retail

Business Objectives

Oracle E- business suite capacity & scalability measure under load

Oracle Configurator model design stability

Find optimal configuration values in web server for JVM heap memory usage.

Technology Spread

Load Runner 8.1 Protocol: Oracle NCA+Web Monitors: Server Resource

Monitor; Network Latency Monitor

User Load : 500 Users


Onsite(25%)-Offshore(75%)

ORACLE E-Business Suite [Configurator] Performance Testing

Sample Identified Performance Bottleneck

Befo

re T

unin

g

After Application Tuning

Aft

er T

unin

g

HCL’s Test Environment Setup

18



THANK YOU


EATS Product Streams

DOMAIN SERVICES

PRODUCT SERVICES

CORE APPLICATIONS TOOLS, TECHNOLOGIES & PLATFORMS BUSINESS ANALYTICS

SAP Enterprise Resource Planning, Supply Chain Management, Supply Relationship Management, Product Lifecycle Management, Customer Relationship Management

Net Weaver SOA SaaS Mobility Platform

Solution Manager SAP TAO

Business Intelligence Business Objects APO

Oracle Financials, Human Capital Management, Supply Chain Management, Customer Relationship Management

SOA/ Fusion On Demand

BEPL J Developer

OBIEE Data Warehousing

CRM Sales Management, Service Management, Marketing Management, Banking/Financial Solutions, xRM

MS Sharepoint Mobility Platforms

CRM Online Cloud Services Web Services

DW/BI Data Modeling, Source & Target Schema mapping, Extraction Transformation & Loading, Exceptional Data Analysis, Data Warehouse enhancement & Maintenance

Informatica Data Stage Business Objects

Cognos Hyperion

Data Warehousing Reports

RetailFinance Manufacturing Utilities Healthcare/Pharma


Cost of Quality – Our Philosophy

Key parameters of CoQ

CoQ Analysis – large Insurance company in USA

• Lower Operational Cost without compromising Quality• Previously hidden costs related to poor quality become

visible and demystified• In-depth analysis of Cost of Quality can lead to actions to

improve the situation• YoY improvements in COQ (Do more for Less)• Shorter time to market

Benefits

Introduce CoQ led approach • Identify CoQ levels against individual business domains• Define initiatives to reduce CoQ• Capture and analyze CoQ metrics periodically• Base line and measure the phase specific CoQ goals• Analyze and conduct Root Cause Analysis for all deviations• Tie CoQ to Value drivers for the QA


Business Process Testing

Business diagram showing the various processes and sub-processes involved in creating a web order. Consists of Business Process, Application Components and Business Components

Three layered Approach to Business Aligned Testing (implemented for a leading pharmaceutical company in UK)

Business process Modeling of Business process

Bottom up Approach (Where test cases are available) Top down Approach (Where test cases have to be designed)

Components and Test cases Transformation from Application centric view to Business centric view Reusable test/business components Plug and play components to create business scenarios/process

Components and Test cases Test cases automated


EATS Centralized Library with Re-Usable Business Components

What is EATS (SAP/Oracle) Component Library?

Reusability of Components leading to reduced test scripting effort, change control, and test cycle time reduction

SAP Module No. of Reusable components

OTC 249

FI/CO 123

MM 301

WM 116

PP 19

BI 43

CRM 45

• SAP /Oracle modules are based on standard ‘T ‘ Codes or Transaction codes for each Business Transaction• Using the BPT Approach the test steps for each of the ‘T’ Codes can be componentized• Components per module & for each ‘T’ Code are stored in a central repository• Test Cases based on Client Business Processes can then be created using readily available components

Value Delivery From a Test Objective

Oracle Module

No. of Reusable components

AP 86

AR 95

FA 44

GL 63

CE 22

Oracle Module

No. of Reusable components

PO 33

INV 24

OM 15

OIE 35

IPO 32

Total SAP re-usable Components =760 Total Oracle re-usable Components= 449

Value proposition: 5-10% reduction in overall testing cycle time

Documents

Copyright © 2014 HCL Technologies Limited | September 18, 2014 Business Assurance – Oracle Testing Capabilities