42
<Insert Picture Here> Steve Van Hall Principal Sales Consultant, Oracle Corporation Application Testing Suite Overview

Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

<Insert Picture Here>

Steve Van HallPrincipal Sales Consultant, Oracle Corporation

Application Testing Suite Overview

Page 2: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

2

Load Testing andLoad Testing andAccelerators forAccelerators for

Packaged Apps & Packaged Apps & Web ServicesWeb Services

Functional Testing andFunctional Testing andAccelerators forAccelerators for

Packaged Apps & Packaged Apps & Web ServicesWeb Services

Test ManagementTest Management

Real Application TestingReal Application Testing

Data MaskingData Masking

Real UserReal UserExperience MonitoringExperience Monitoring

Service Level Service Level ManagementManagement

Packaged Application Packaged Application ManagementManagement

SOA Application ManagementSOA Application Management

Diagnostic and TuningDiagnostic and Tuning

Provisioning, Configuration Provisioning, Configuration ManagementManagement

Change Tracking Change Tracking and Synchronizationand Synchronization

Oracle Enterprise ManagerOracle Enterprise Manager

ApplicationApplication OperationsOperations

ManagementManagement

TopTop--Down Application Management Down Application Management

ApplicationApplication Quality Quality

ManagementManagement

Application Testing Suite

Page 3: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

3

Application Testing Suite A powerful, integrated testing solution for ensuring application quality, performance and reliability

Functional Testing for Web Apps

Load Testing for Web Apps

Test Manager for Web Applications

Application Testing Suite

Page 4: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

4

Why do Customers Care?

Cost of 1 hour unplanned production downtime

Percent of unplanned downtime that can be eliminated through pre-deployment testing and better QA/Development collaboration

$100,000+

Incremental cost of fixing problems in production80-10,000x

80%

Source: GartnerPercent of applications deployed without testing75%

Application Quality Management is imperative for business agility and for providing high service levels at low cost and risk

• Customers have invested in applications to provide better and more cost-effective service to their customers

• But cost savings not realized

Page 5: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

5

Application Testing Suite: A Lifecycle Approach to Quality

Oracle Load Testing for Web

Applications

Oracle Functional Testing for Web

Applications

Oracle Test Manager for Web Applications

TuneTune Test

Test

Design

Design Develop

Develop

Design Test Plans Based on Application Requirements

Develop Manual Test Cases and Automated Test Scripts

Execute Functional Tests to Validate Application Requirements

Execute Load Tests and Tune Application Performance

Page 6: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

6

Oracle Functional Testing for Web Applications: Automated Functional & Regression Testing

• Automate transactions for Web applications & Web Services

• Execute rigorous functional test cases

• Create automated regression test suites

• Identify and report on functional application failures

• Reuse functional test scripts for load testing

• Accelerators for Applications (Oracle Applications, Web and Forms based)

Page 7: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

7

Functional Testing for Web Applications

• Automate transactions for Web apps & Web Services

• Execute rigorous functional test cases

• Create automated regression test suites

• Identify and report on functional application failures

• Reuse functional test scripts for load testing

• Superior DOM-based recording for Web applications

• Automatically generates test cases to validate application content

• Same scripts can be re-used for functional testing and load testing

• Eclipse based IDE for rich extensions, enhancement, OpenScript

Value Differentiators

Page 8: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

8

Oracle Load Testing for Web Applications: Load and Performance Testing and Tuning

• Create realistic load test scenarios that simulate end-user behavior

• Scale to thousands of concurrent users

• Perform functional content validation under load

• Monitor server-side performance & correlate to end-user response times

• Isolate and resolve performance bottlenecks

Page 9: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

9

Load Testing for Web Applications

• Create realistic load test scenarios simulating end-user behavior

• Scale to thousands of concurrent users

• Perform functional content validation under load

• Monitor server-side performance & correlate to end-user response times

• Easy to create scripts for complex and dynamic Web applications

• Automatic validation of page responses for each Virtual User

• Scalable load generation that enables you to run thousands of users

• Intuitive Web-based interface that enables remote access and multi-user collaboration

Value Differentiators

Page 10: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

10

Oracle Test Manager for Web Applications: Test Process Management

• Manage test process from centralized Web-based console

• Define test requirements

• Develop manual & automated test cases

• Document and track defects

• Create reports

Page 11: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

11

Test Manager for Web Applications

• Manage your test process from a centralized Web-based console

• Define test requirements for your application

• Develop manual and automated test cases

• Document and track defects identified during testing

• Report on the test process and assess application readiness

• Simple and intuitive Web- based interface

• Fully customizable fields and reports to fit your test process

• Integrates test management with defect and requirements tracking

• Integrated with Oracle Functional Testing to drive automated testing

Value Differentiators

Page 12: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

12

<Insert Picture Here>

PRODUCT OVERVIEW

Page 13: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

13

Oracle Functional Testing for Web Applications

Page 14: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

14

Script Recording

Page 15: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

15

Script Page Details

Page 16: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

16

Script Playback

Page 17: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

17

Test Cases

• Default Tests• HTML Comparison• Links, Images, Forms

• User Defined Tests• Text Matching• Object Tests• Table Tests• Server Response

Page 18: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

18

Results Report

Page 19: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

19

Load Test Scripting

Page 20: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

20

Web Services Testing

Page 21: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

21

Oracle Load Testing for Web Applications

Page 22: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

22

Create a Load Test Scenario

Page 23: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

23

Configure Start/Stop and VU Ramp-up

Page 24: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

24

Configure Server Monitors

Page 25: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

25

Run the Load Test

Page 26: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

26

View Real Time Results

Page 27: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

27

Create Post Run Reports

Page 28: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

28

Oracle Test Manager for Web Applications

Page 29: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

29

Manage Test Requirements

Page 30: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

30

Document and Execute Test Cases

Page 31: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

31

Track Issues Identified During Testing

Page 32: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

32

Report on Application Readiness

Page 33: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

33

Application Testing SuiteApplication Testing Suite

Data MaskingData Masking

Real Application TestingReal Application Testing

Real UserReal UserExperience MonitoringExperience Monitoring

Service Level Service Level ManagementManagement

Packaged Application Packaged Application ManagementManagement

SOA Application ManagementSOA Application Management

Diagnostic and TuningDiagnostic and Tuning

Provisioning, Configuration Provisioning, Configuration ManagementManagement

Change Tracking Change Tracking and Synchronizationand Synchronization

Oracle Enterprise ManagerOracle Enterprise Manager

ApplicationApplication OperationsOperations

ManagementManagement

TopTop--Down Application Management Down Application Management

ApplicationApplication Quality Quality

ManagementManagement

Page 34: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

34

Secure Application Testing Data Masking Enables Secure Production-scale Testing

• Testing with production data results in highest quality testing• Production data has sensitive information that is highly regulated• Regulations restrict use of sensitive data and mandate access control

(who, where, how, and why)• Payment Card Industry Data Security Standard (PCI DSS) 6.3.4• Graham-Leach-Bliley Act (GLBA) and Sarbanes-Oxley Act (SOX)• Health Insurance Portability and Accountability Act (HIPAA)• Communications Act (Title 47,222)

• 90% fail compliance, facing fines and remediation costs• Test environments more vulnerable to breaches• Non-production breaches must be disclosed

• $239/record• Up to $35M/breach• And that’s if the data doesn’t end up on the Internet…

Page 35: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

35

Data Masking Pack Test applications with production data for highest quality testing without sharing sensitive information

Development and Testing Database

Production Database

Benefits

Eliminate risk of moving sensitive data to dev & test environments

Share data with partners without exposing sensitive data

No impact on production database

Leverage Masking templates for common data types

Mask related columns in the same way

LAST_NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

LAST_NAME SSN SALARY

ANSKEKSL 111—23-1111 40,000

BKJHHEIEDK 111-34-1345 60,000

Page 36: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

36

• Automatic database referential integrity when masking primary keys• Implicit – database enforced• Explicit – application enforced

• Data mask format library• View sample data before masking• Application masking templates• Define once; execute multiple times

Key Features

Production Test / Development

MaskClone

Page 37: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

37

Data Masking Pack

• Centrally shared mask formats for common sensitive data

• Automated repeatable process for masking sensitive data

• Easy-to-use web interface integrates with other administration functions

• Enables sharing of data in compliance with information security policies

• High performance masking technique optimized for Oracle databases

• Single unified web interface to mask sensitive across all databases

• Enforces referential integrity for packaged and custom applications

• Part of a complete set of information security solutions

Value Differentiators

Page 39: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

39

Business Challenges

• Ensure performance of complex, mission-critical, highly visible online tax application, with massive usage peaks in the week before tax filing deadlines

• Additional testing throughout a complicated set of customer-facing, CRM, HRM, and branch support applications

Solution • Oracle Application Testing Suite’s Load Testing for Web Applications for load and performance testing

Business Results

• Consistently strong application performance every year during crucial tax seasons

• Outperformed industry peers who suffered major application failures

H&R Block “America’s most trusted online tax provider” relies on Oracle Application Testing Suite to prepare for annual online filing season spike

Page 40: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing

40

Business Challenges

• One of the largest college districts in the nation• 250,000 students annually and 11,500 employees across ten colleges

• Major rollout of PeopleSoft Enterprise Student Administration

• Need to ensure application performance during peak usage coinciding with new student enrollment

Solution• Used Oracle Load Testing for Web Applications for

load and performance testing and consulting services for test planning, execution and tuning

• Displaced HP/Mercury (too difficult to use)

Business Results

• Found a number of critical performance problems that would have occurred before peak load of 15K users

• End-user experience with PeopleSoft application was considered rock-solid and customer continues to expand usage of Application Testing Suite

Maricopa Community Colleges Oracle Application Testing Suite helped Maricopa ensure a successful deployment of PeopleSoft Student Administration

Page 41: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing
Page 42: Application Testing Suite Overview - UNYOUG · 9/18/2009  · Incremental cost of fixing problems in production. 80%. Source: Gartner. 75%. ... 9Share data with partners without exposing