Frameworks Introduction

8/6/2019 Frameworks Introduction

http://slidepdf.com/reader/full/frameworks-introduction 1/7

Frameworks Introduction

Automated testing is most effective when implemented within a framework. Although, in automatedtesting, the term framework is often used to describe the collective structures that compose unittesting tools, this section will largely focus on a different kind of framework. Here we will discuss the

types of frameworks that may be defined as a set of abstract concepts, processes, procedures andenvironment in which automated tests will be designed, created and implemented. In addition, thisframework definition includes the physical structures used for test creation and implementation, as well as the logical interactions among those components. Over the years, automated testing (and thusautomated test frameworks) has evolved, becoming increasingly defined and sophisticated with eachnew evolutionary phase. These phases can be described in terms of three generations, each generation wielding a set of advantages and challenges, thus each generation remains relevant despite newdevelopments. These generations generally apply to Functional System Test Automation, but in someinstances may expand to address Unit Test Automation. For more information scroll to the lower halfof the Frameworks menu page.

Frameworks

1st Generation Frameworks

Linear

The Linear "framework" typically yields a one-dimensional set of automated tests

Read more

2nd Generation Frameworks

Data-driven

Frameworks built on Data-driven scripting are similar to Linear scripts, in that

Read more

Functional Decomposition



Linear

The Linear "framework" typically yields a one-dimensional set of automated tests in which eachautomated test is treated simply as an extension of its manual counterpart. Driven mostly by the useof the Record & Playback, all components that are executed by a Linear script largely exist within the

body of that script. There is little to no modularity, reusability, or any other Quality Attributeconsidered in the creation of Linear scripts. Linear Scripts, may be useful in environments with a verysmall scope. An example of a small linear script is shown below.

1 Input ³John´ into Username textbox 2 Input ³JPass´ into Password textbox 3 Click Login button 4 If ³Welcome Screen´ exists then 5 Pass the test 6 Else 7 Fail the test 8 End If

Notice that there are not calls to external modules, or external data.

Linear scripts are often driven by Record & Playback should, but in most cases, Record & Playbackshould not be treated as a framework or serious approach for an automation effort meant to span anyreal length of time. Some will agree, however, that while Record and Playback is not good as aframework, it may be useful as a technique.

Linear Script Pros

Quick development ± There is little planning or consideration of the various Quality

Attributes when creating Linear scripts. Couple this information with the fact that Record andPlayback is often the driving force behind Linear script development, then it¶s easy to see thatcost of development in time, resources and money could be relatively low.

S maller tool learning curve ± Test automation typically requires knowledge of theautomation tool features and language, as well as the knowledge of how the tool interacts withthe application under test. The use of Record and Playback in the creation of Linear scriptsdynamically creates code that corresponds with actions performed in the application. This codemay then be studied by the automator for answers to questions about the tool¶s languagesyntax as well as how the automated test tool¶s interaction with the AUT.

Quickly gather information about application dynamics ± This advantage is closelyrelated to the smaller tool learning curve advantage. The use of Record and Playback provides

information about the Aut dynamics, such as how object properties change as activity in theapplication is altered. S cript Independence ± Given the fact that all the components executed by a script exist

within that script, there is little apprehension about making script modifications that mayunknowingly affect some other script.

S implifies error location ± The more advanced an automation framework becomes themore complex it becomes. With complexity comes challenges related to locating the source ofan error, particularly for those that are unfamiliar with the makeup of the automation



framework. Given the fact that all components of a Linear script exist within that script, thereis little question about where the error occurred.

Linear Script Challenges (Cons)

Improper playback ± When relying heavily on Record and Playback, recorded scripts willoften not playback properly. This is due to the fact that the Record and Playback feature is notanalytical. It doesn¶t evaluate the application objects and behavior nor does it make decisionson how best to deal with those objects and behaviors. In an effort to fix the playback issues, aseries of patchwork solutions are often introduced that won¶t stand the test of time.

Red undancy ± Linear scripts don¶t take advantage of reuse, therefore if more than one scriptperforms the same or similar functionality, the functionality will be duplicated in eachrespective script. When the application changes in subsequent releases of the application,excessive maintenance will be the result.

One dimensional scripts ± Little flexibility is offered in altering the way Linear scripts may be executed. Scripts are only readily available to be run at one level, in one location and in one way. If a test manager wants the automator to execute a subset of the total test bed based ondefined priorities and risks, or execute the tests in a different environment, or in a differentsequence, the automator would have to perform time consuming, run-time analysis of thescripts to make it happen. This will decrease the amount of time available for script executionand analysis.

S cripts are difficult to read ± With the absence of reusable components, Linear scripts arereplete with code or automation statements. This will make the script difficult to read andtherefore tedious to analyze and maintain. If a statement in the script fails, it is often difficultto determine what application functionality was affected by failure. Likewise, when it becomesnecessary to make changes to the script, it is a little more tedious to determine where thechanges need to be made.

Requires higher degree of application knowledge ± In order to maintain Linear

scripts, a higher degree of application knowledge is required. This is directly related to the factthat there is little modularity. Modularity helps to make it clear what a block of applicationstatements is responsible for doing. The loose statements in Linear Scripts make it a little lessclear. So when it comes to analyzing and/or debugging a script the automator must first burn asubstantial amount of time gaining a mental understanding of what a given block of statementsdoes in order to effectively maintain the script.



W orksoft Certify

Worksoft Certify® is an automated functional testing solution for SAP lifecycle management andcross-platform business process validation. Worksoft Certify® was first to market with asolution designed for business analysts that is powerful enough to validate cross-platform business

processes without requiring coding. Worksoft Certify® eliminates custom coding and programming, a requirement of most legacy tesautomation products, making it fast and easy to implement and maintain. Using an object-drivenapproach rather than generating scripts or code, Worksoft Certify® validates business process workflows using a data model of fields, screens, and transactions making it easy to keep pace withdynamic changes.

Overview

Worksoft Certify® ConnectâÄ¢ is a family of web-services based applications that extend and enhance

Worksoft Certify® to provide a comprehensive lifecycle management solution for SAP by providing web-based access and programming interfaces to connect with extended audiences and externaapplications.

Worksoft Certify® ConnectÂ provides advanced functionality that extendsÂ Worksoft Certify®Â inorderÂ to solve the following set of enterprise challenges:

Enterprise Reporting

Connect your data and information to an extended audience, including executive management, via a web-based dashboard that includes rich graphical displays of important metrics and key performance

indicators.y Certify Executive Dashboard y Certify Business Process Procedure (BPP)

Compliance

Connect your business validation maps, tests, and results to IT auditors and other compliance andsecurity stakeholders to illustrate the relevant artifacts of lifecycle management.Â

y Certify Executive Dashboard y Certify Business Process Procedure (BPP) y Certify Electronic Signature

Enterprise Integration

Connect Worksoft Certify® with your other enterprise test management solutions to preserve andenhance your existing investments. Certify Connect provides bi-directional integration which allows



you to increase your automation capabilities while extending your existing test and validationprocesses. Worksoft supports the following enterprise solutions:

y SAP® Solution Managery IBM Rational® Quality Managery

HP® Quality Center Worksoft Application Lifecycle Management Solution can consist of a number of additional packagesto suit the client's needs:

Certify Learn Certify Data Certify Impact

Certify Executive Dashboard

Certify Executive DashboardâÄ¢ provides graphical key performance indicators (KPIs) and drill-downreporting capabilities to ensure that users at all levels have the information and visibility needed forimproved decision making and optimal risk management. By identifying and quantifying the overalleffectiveness of business process validation tasks, this solution provides key decision-making tools with up-to-the-minute project status and test results through customizable, web-based charts andgraphs.

Key Features

y Track and report on test requirements includingparent-child dependencies Â Â

y Detail reports and summary reports on test executionand test results

y Historical trending that compares execution resultsover timeÂ

y Email communication for easy team collaboration andtask delegationÂ Â

y Integration with Certify BPPâÄ¢ and Certify eSignatureâÄ¢ for a complete compliance solution

Certify Executive Dashboard is an integral solution that reduces risk and simplifies complianceinitiatives for your complex lifecycle and test automation projects.

Certify Business Process Procedure (BBP)

Certify Business Process ProcedureâÄ¢ (BPP) is a web-based reporting product that automaticallygenerates comprehensive reports for development,Â quality assurance, training and complianceReports capture and catalog a sequential set of test steps, grouped by test process and applicationscreen.



K ey Features

y Dynamic reports: Â on test process execution and testresults

y Screen captures included for a detailed audit and

compliance traily Complements any Worksoft Certify® application andproject

y Browser-based user interface for multi-usercollaboration

y Supports one Â or multiple Â Certify instances anddatabases

Certify Business Process Procedure provides. Â dynamicreporting against your Worksoft Certify® test. Â executionsand test results thus providing a complete audit trail of the business process validation activities.

Certify eSignature

Certify Electronic Signature provides web-based workflow and approval for Worksoft Certify® assetsincluding test requirements, test processes and test results.Â Certify Electronic Signature records andpreserves test assets and generates documentation to aid in compliance including regulations such asFDAâ¼�s 21 CFR Part 11.

Key Features

y Role-based access controls and permissionsy Binding electronic signatures ensures non-

repudiationy Customizable, automatic notification and reminder

featuresy Pre-built Â set of project templates for custom

tailoringy Web-based interface for team collaboration and

workflow

Certify Electronic Signature secures your valuable testing assets against unauthorized change andaccidental removal, providing a permanent system of record for reporting, auditing and compliance.



Products

Worksoft Certify® Certify Performance Test

Code-free, automated functional testing

solution for SAP lifecycle management andcross-platform business process validation.

Code-free load and stress

testing solution specifically designed forSAP applications and built within thenative SAP user interface.

Certify Impact Certify Executive Dashboard

Analyze SAP transports to identify type of change, what is affected and what testshould be run.

Provides management visibility intolifecycle and test management reports,metrics and KPIs.

Certify Electronic Signature Certify Business Process Procedure

Workflow and approval for WorksoftCertify® assets including testrequirements, test processes and testresults.

Automatically generates comprehensivereports for development, quality assurance, training and compliance.

Certify Data Certify Learn

Automatically extracts and moves SAPproduction data for test, development andtraining needs.

Automatically extracts SAP applicationobjects to create a fully populated objectrepository in Worksoft Certify®.

Documents

Frameworks Introduction