Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license.

Functional Testing with Eclipse

Eric Long

Technology Evangelist, IBM Rational Technology Events

elong@us.ibm.com

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 2

What we WON’T be covering today…

• Unit Testing API Recorder JUnit Testing

• Performance Testing HTTP Recorder

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 3

What we WILL cover…

• Introduction• Manual Testing• Demo• Functional Testing• Demo• Next Steps

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 4

A Touch of Humor

• Trunk Monkey

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 5

What is Manual Functional Testing?The manual process of ensuring fitness for use

• Using human labor to validate the business use cases and fitness for use of an application, system or device

• Includes labor to plan, design, execute and evaluate the status of the application or device under test

• Experience indicates over 75% of the testing done today is performed manually

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 6

Challenges of Manual Functional TestingThree things that complicate the life of a manual testerChallenges of Manual Functional TestingThree things that complicate the life of a manual tester

• Labor Intensive Too much time is spent

maintaining manual test documentation for application changes

• Resistant to Change

Each project has diverse processes, tester skill sets and types of applications and devices under test

• Unreliable

Accidental human-error with data entry and validation often skews test results

• Labor Intensive Too much time is spent

maintaining manual test documentation for application changes

• Resistant to Change

Each project has diverse processes, tester skill sets and types of applications and devices under test

• Unreliable

Accidental human-error with data entry and validation often skews test results

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 7

Eclipse Manual Testing Tools…• Overview

Description of manual test

• Test Cases Defines individual test

cases

• Behavior Order of test cases Loops

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 8

Eclipse Testing Tools• While a test is being run,

a step-by-step progress view is available JUnit-like status bar Input values

Verdict Reason Text

Attachments

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 9

Demo• Manual testing with Eclipse TPTP• Test creation, reuse and execution

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

0

What is Automated Functional Testing?The automated process of ensuring fitness for use

• Using automation tools to capture actions taken against an application in script format.

• Three Step Process Record actions into a script format

Optionally enhance scripts with custom coding

Execute scripts – ideally overnight to increase test productivity to 24/7

RecordRecord

EnhanceEnhance

ExecuteExecute

RecordRecord

EnhanceEnhance

ExecuteExecute

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license.

Manual testing can’t keep pace!Manual testing

can’t keep pace!Rerun the first tests and...

Time

Tests

...take more time

...take more time

...the new tests...

Build 1 Build 2 Build 3, 4, 5 …

Challenge of Manual Functional Testing with Short Test Cycles

• Manual testing alone can’t keep pace with the rapid development of applications… Quality will be sacrificed to keep on schedule

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

2

Challenges of Automated Functional TestingThree things that complicate the life of an automated functional testerChallenges of Automated Functional TestingThree things that complicate the life of an automated functional tester

• Control cost of test automation Inexperienced testers face steep

learning curve for tools Test maintenance grows with

project

• Control cost of test automation Inexperienced testers face steep

learning curve for tools Test maintenance grows with

project

• Testing Tools Lack Flexibility Power users hands are tied by tool

limitations

• Testing Tools Lack Flexibility Power users hands are tied by tool

limitations

• Test Team Integration Managing script changes with

parallel development Sharing test assets with the

larger software team

• Test Team Integration Managing script changes with

parallel development Sharing test assets with the

larger software team

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

3

Automated GUI Test Editor

• Overview• Test Cases• Behavior• Test Controls

Record a new test Play a test case Delete Update Refresh

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

4

Recording Control Center

• Customize wait time• Toggle position-based

recording• Restart• Terminate• Insert verification hooks

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

5

Test Case Generation• After recording a test, here are the results:

Tree structure view containing Shells and Commands Macro view for fine-grained changes

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

6

Test Log

• Events• Properties• Pass/Fail charts• Bug submission

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

7

DemoFunctional testing with Eclipse TPTP preview

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

8

Thank You

• Hope you enjoyed the short presentation• Please remember to fill out your evaluations

Functional Testing with Eclipse TPTP | Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license. 1

9

Legal Notices• Copyright © IBM Corp., 2007-2008. All rights reserved. Source code in this presentation is made

available under the EPL, v1.0, remainder of the presentation is licensed under Creative Commons Att. Nc Nd 2.5 license.

• IBM and the IBM logo are trademarks or registered trademarks of IBM Corporation, in the United States, other countries or both.

• Java and all Java-based marks, among others, are trademarks or registered trademarks of Sun Microsystems in the United States, other countries or both.

• Eclipse and the Eclipse logo are trademarks of Eclipse Foundation, Inc.

• THE INFORMATION DISCUSSED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION, IT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, AND IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, SUCH INFORMATION. ANY INFORMATION CONCERNING IBM'S PRODUCT PLANS OR STRATEGY IS SUBJECT TO CHANGE BY IBM WITHOUT NOTICE.