Ensure Quality in Test - IBM · Robust support for Java, Web, and VS.Net WinForm- ... Visual Test Editor ... D2 - 10 Ensure Quality in Test.ppt 18

1

Ensure Quality in Test

D2 - 10 Ensure Quality in Test.ppt 2

IBM RationalFunctional Tester

IBM RationalManual Tester

Eclipse

IBM RationalPerformance Tester

Manual testing for analysts andsubject matter experts as well as testers

Automated Functional Testing

Multi-user performance testingReal Time ReportingPre- Production & Production

Integrated Suite of choices for ensuring functional quality

Built on Eclipse / Hyades Open Tester Framework- Promotes testing across entire Lifecycle- Can easily extend test environment with open GUI- Tester function plug-ins available via Eclipse.org

IBM Rational Software Quality Tools –System Integration or Pre-Production

2


Manual or Automated Testing

Reasons to use Manual Reasons to use Automated

1. Useful for short quick tests

2. Useful for new applications

3. Non-technical personnel can test

4. Testing cannot be automated due tonature of application

1. Useful for long complex tests

2. Opportunity to reduce costs for tests thatare repeated frequently

3. Keep pace with rapid changes indevelopment – large workloads

4. Helps with Iterative development – frequenttesting

Many organizations use both manual and automated testing

Industry and customer experience indicates that over 75% of the testing done today is performed manually


� ReliableManages the entire testing processAutomates data-entry and data validation

� RepeatableRich text editing to author detailed manual testsProvides “linked” content to minimize maintenance

� FlexibleSupports technical testers, analysts and subject matter expertsSupports distributed teamsCustomizable for any process or application under testTest script input from Microsoft Word or ExcelGenerates spreadsheet-ready results data

Technical & non-technical Testers

Analysts

- From ad-hoc testing to controlled and efficient testing

Performance TestDeveloper releasesto pre-production Manual Test Functional Test

Introducing IBM Rational Manual Tester –Advances Manual Testing

3


� Provides a rich text editing to document clear, easy to understand tests

� Allows embedding of images or attach files to add clarity and detail

� Provides a rich text editing to document clear, easy to understand tests

� Allows embedding of images or attach files to add clarity and detail

Manual Test document

� Uses granular and broad verification points to capture both detailed observations and higher level test results

� Import existing manual tests documented in Word or Excel

� Uses granular and broad verification points to capture both detailed observations and higher level test results

� Import existing manual tests documented in Word or Excel

Rich Text Editor

IBM Rational Manual Tester –Create Robust, Easy to Follow Tests


� Store critical data used during the test as part of the test instructions� Automate data entry during test execution to speed entry & reduce errors� Automate data validation during test execution to ensure accurate results

� Store critical data used during the test as part of the test instructions� Automate data entry during test execution to speed entry & reduce errors� Automate data validation during test execution to ensure accurate results

Bottom Line: Reduces Human Error

IBM Rational Manual Tester –Assisted Data Entry and Data Verification

4


Fatal Flaw for Mercury and Microsoft

No standalone Manual Tester that supports:- Analysts- Subject Matter Experts- End Users

and performs advanced manual testing

Mercury’s solution for business analysts is to adopt the Quality Center

- Forces automation- Significantly more costly

(10X cost of IBM Rational Manual Tester)

Source: IBM Competitive Project Office Research, 2005


ExecuteEnhanceRecord

Automated Testing – An Iterative Process

� Script Recording� Capture user interactions with the system under test

� Script Enhancing� Modify scripts for situation specific challenges

� Script Execution� Ensure reliable playback for local or remote execution

Effective Test AutomationCreating an Automated Test is a Three Steps Process

5


� IBM Rational Functional Tester� Automated regression testing for Web, J2EE and .Net

� Key Benefits� Minimize test maintenance with scripts resilient to changes� Wizard enhanced automation to speed test creation � Powerful scripting language and IDE for professional testers� Supports Team oriented parallel development� Built on Eclipse

Test automation for the novice and the professional

IDE = Integrated Development Environment

Test Automation with IBM Rational Functional Tester


DEMO: IBM Rational Functional Tester

�Manual Test�Functional Test�System test�Document results

Testers


1. Data driven testing through the use of Wizards

2. Dynamic Verification through regular expressions or data driven values

3. Advanced object map maintenance capabilities

4. Robust support for Java, Web, and VS.Net WinForm-based applications

Lowering the cost of automated testing

6


What Did You Just See?


Testers � Productivity enhanced - record and execute

� Supports data driven testing

� Extensive use of wizards

� Integration with IBM Rational ClearQuest� Activity tracking� “Open Defect”

� Easy to create verification points

� Easily add data points

� Built on Eclipse – open extendible platform



What Is Performance Testing and Why Do it?

� The process of exercising an application by emulating actual users with a load generation tool for the purpose of finding system bottlenecks

� A break at any point in your system means your customers are notgetting the service you think they are

This Page cannot be displayed!

7


Execute & AnalyzeSchedule WorkloadBuild Scripts

� Script Creation Considerations� Visual test editor, varying input data & correlating server

responses

� Scheduling Considerations� Accurately representing a true user workload

� Execute and Analyze Considerations� Validating responses & finding the bottleneck

Creating a performance test is a three step process

Effective Creation of a Performance Test


NEW! IBM Rational Performance Tester V 6.1

� Built for Productivity – Easy to use� Create code free tests� Mask complexity to get the job done� Eclipse based

� Advanced Data Access & Manipulation� Create code free schedules� Automated data variation and synchronization

� Lower Cost of Performance Testing� Low resource requirements� Desktop IDE integration

Load and Performance Testing

8


DEMO: IBM Rational Performance Tester

� Visual Test Editor� Easy for novice to understand, with drill-down for expert users� Benefit: Underlying detail is accessible but hidden to simplify test

creation

� Automatic Identification and Handling of Variable Data� Server responses are automatically identified and handled � Benefit: Allows tests to automatically re-use data sent by server

� Built-in Datapool Editor for Data-Driven Testing� Provides assistance in emulating data set for multiple simulated users� Benefit: Easily change data for more realistic tests


Testers



What Did You Just See?

Testers


The IBM Rational Performance Tester quickly isolates performance problems to improve the quality of your application


� Performance load and page response time� Easy Script Creation� Quick Script Execution – “Performance Schedule”� Built on Eclipse – open extendible platform

9


New Additional Performance Toolkits

1. IBM Problem Resolution Toolkit

2. IBM Performance Optimization Toolkit

� Plug-in for Rational Application Developer� Imports monitoring data from Tivoli

Monitoring for Transaction Performance� Analyze and resolve application problems

� Standalone or Plug-in for Rational Performance Tester� Identifies root cause of poor performance� Focus on round-trip response time decomposition

Operations Development

Business


• One of the largest hotel franchise companies in the world

• Over 5,000 hotels, inns, all-suite hotels and resorts

• 48 countries and territories

• Many brand names such as:Comfort Inn, Comfort Suites, Quality, Sleep Inn, Clarion, MainStay Suites, Econo Lodge and Rodeway Inn

• Massive reservations trackingsystem

� “We have seen a 1400 percentreturn on our investment because we have reduced cycle times for our testing.”

� “We're getting our products out to the field earlier, saving money by reducing cycle times, and putting millions of dollars back into the revenue stream for the company to use on other products and future projects."

Chad MasonQuality AssuranceChoice Hotels International

Ensure QualityCustomer Success

10


Quality – A Decision to Get Right the First Time

Rebecca: The Time Machine commercial goes here.

Documents

Ensure Quality in Test - IBM · Robust support for Java, Web, and VS.Net WinForm- ... Visual Test Editor ... D2 - 10 Ensure Quality in Test.ppt 18