Testing Centre Of Excellence From AppLabs

AppLabs confidential and restricted circulation 1

Testing Centre of ExcellenceMyth or Reality

22nd October 2008

Ian Londesbrough


Agenda

» Understand business drivers for TCoE

» Identify the building blocks of the TCoE

» How to build the TCoE

» Assessing TCoE against the Testing Lifecycle

» Deploying the TCoE solution

» Improving and expanding the service

» Build the Business Case

» Summary


Why TCoE? Business Drivers

» Increased business user demand» Complex changes

» Time to market» Multiple releases in a year» Dynamic business changes

» Lack of uniform testing processes» Every project having its own testing process» More people dependant and not process dependant

» Testing is time consuming» Inadequate Automation & usage of tools» No key Accelerators / Frameworks

» Effectiveness of testing» No measurements / metrics


Test Center ofExcellence

Project Support

ExpertiseBuilding

ProcessImprovement

KnowledgeManagement

Methodologies

Tools

Benchmark metrics

Templates

External, internal training

Test Automation tool certifications

Accelerators

Internal projects

Prototypes

Functional, technical support for projects

Problem resolution

Capture experiences

White papers

Best practice repository

Re usable components

The Building Blocks

Complete FormalTest

Review


Proof of conceptBring in Applabs rich experience,

from Testing industry specific Best Practices

Test tools and technology competencyAccess to the latest tools and technologies like

automation tools, scripting languages, databases

Knowledge managementIntegrated knowledge management system to help leverage our learning

Reusable test suites & frameworks Proven & Structured Process Models. Design &

implement best-of-breed solutions & technology

Deepening of skillsThrough training & prototype

development

Measurement & ContinuousImprovementMetrics to ensure enterprise wide implementationRegular check points to evaluate process maturity & Feedback

Strategy definitionLeverage on internal and external knowledge base to define objectives and scope of TCoE Assimilation

Creating a knowledge base through Testingbest practices

AwarenessBuilding a roadmap and vision for the Center of Excellence

DeploymentUsing capabilities and components that the CoE generates, deploy across enterprise

ImprovementImproving value by repeated use – continuously refining the components

Test Center

of Excellence

Building a TCoE


TCoE – AssimilationLooking at every step of the Testing lifecycle

Test LifecycleManagement

TestStrategy

TestPlanning

TestCase

Design

TestExecution

DefectReport

Analysis&

Reports

Test strategydocument

Test plan document

Traceabilitymatrix

Test Scripts

Defect reports

Test summaryreports

R

R

R

Analysis reports

Test case document

R Indicates review point Indicates testing processIndicates test artifacts

StudyRequire-

-ment

Feedback

Test Organization

Test Environment

TestData

TestTools

Test Metrics

ReleaseManagement

ReviewProcess

SoftwareDevelopment

Lifecycle

ConfigurationManagement

ChangeManagement


System Tests

Testing effectiveness

THE “MOSAIC” Assimilation - Spot your candidates for TCoE

Key business element

Packages & Technology enablers

Architecture

Testing Imperative

Strategies

EAI

Cycle time reduction

Data Migration

SOA

Data Integrity

Regression

SAP

WebServices

Performance

Test automation

POS framework

Oracle

DW

Test Process Improvement

Packaged app testing

Bus

ines

sP

artn

ers

IT T

echn

olog

y gr

oups

Lev

erag

e

Platform J2EE .NET AS/400Mainframes

Unix/LinuxWindows

Process & Techniques WIP-CAFÉ OrthogonalArray

Pro

cess

R

ele

van

ceB

usi

nes

s R

ele

van

ceS

yste

ms

Rel

eva

nce

CRM Finance HR Systems Inventory Sales & Marketing

Manugistics JDA Software Seibel

Client/Server

Reliability Modeling


TCoE - Deployment

Step 3

» Environment Planning» Hardware

» Software

Step 1

» People Planning» Test organization» Training

Step 2

» Processes Planning» Management processes» Communication processes» Automation / Tools


TCoE - DeploymentProject Testing Life Cycle

RegressionTest

Test case Design

Integration Test

Fix theDefects

System Test

Fix the Defects

Regression Test UAT

Performance Operations

Testing

Final Regression

Pre-Release Testing

Implement Testing practises

TCoE team working with Project Managers /

Process and Change team

Final Fix


Process and Change Team

Business

Area 1

Define &

improve

Deployment Timelines

Test consultingTransformation level

Test executionTactical level

Execute&

Feed back

Testing Center of Excellence (TCOE)

Business

Area 2

Business

Area 3

Business

Area 4

Business

Area n……

• Improve project quality, reduce costs & delays

• Measure improvement and establish benchmarks

• Define a customized testing framework based on best practices

• Educate people• Consistent logistics, automation and

resources usage

TCoE - Improvement


Path to Success - Build a Business Case

» Define key objectives and scope» What are my the key issues that the TCoE aims to solve» What are the priorities of these issues

» Engagement model with other departments and project teams» To ensure its own success, the TCoE must set rules around how and when

it will provide services to project teams. » Clearly defined entry and exit criteria for its operation

» Quantifiable benefits» What is the ROI on this?» How do I select and measure success criteria

» Where will the funding come from? » For many enterprises, TCoE usually remains a model without powers of

enforcement because they do not have a mechanism to understand the ROI of implementing a COE strategy

» Chargeback or direct from business budget


Summary

» Fully understand what you are trying to achieve through the TCoE – don’t overestimate or oversell the solution

» Plan accordingly by outlining a sensible and pragmatic roadmap to success – bite size chunks are the best approach

» Position the TCoE as an evolutionary process – it’s about continual improvement, refinement and execution (not a one-off)

» Define a well thought-out and structured business case – use metrics and evidence from process improvement initiatives to show the value of the TCoE

» Ensure you have sponsorship at all levels – Business and IT

Questions to: [email protected]

mailto:[email protected]