How do you measure up?

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

How do you measure up?Vital statistics and trends from the 2014-15 World Quality ReportKi-Bae Kim ([email protected])Business Development ManagerHP Software Asia Pacific and Japan

World Quality Report


World Quality ReportPublished since 2009, the World Quality Report (WQR) is recognized as industry’s largest research study and most comprehensive source of market analysis and commentary on the state of enterprise application quality and testing practices


World Quality Report 2014-15: The Research

1,543 respondents

Company Size # of resp.

1,000 – 4,999 4075,000 – 10.000 54310,000 + 593





Trends in Software QA and Testing


Key Trends in Software QA and Testing

Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization


QA and Testing Budgets Continue to Rise

QA Budget keep increasing across industries, and especially for High-Tech, 24% of respondents have allocated 40% of IT Budget to the QA

Market pressures on new technology adoption and shorter delivery cycle resulted QA budget to rise


QA and Testing Budgets Continue to Rise

Growth in Testing Budgets are mainly driven by New Development Work

Test Automation and better Regression Testing enables organization to achieve the required quality with regard to Maintenance Work


QA and Testing Budgets Continue to Rise Adoption of new

technology requires professional testers with deep understanding of the technology

Cloud based testing environment and Service Virtualization are factors considered for cost reduction in Testing Hardware and Infrastructure



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization

Budget

QA and Testing Budgets Continue to Rise, driven by Digital Transformation initiatives



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization


Centralization with Decentralized Approach

Organizations are moving away from siloed QA and Testing Teams

Hybrid approach is favored with the growth of agile development projects


Centralization with Decentralized Approach

Testing Centers of Excellence (TCoE) is growing in many forms



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization

Centralization

Organizations prefer to QA & Testing functions with a combination of centralized

and decentralized approaches



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization


Increases in focusing Customer Experiences

As organizations get matured, challenges in Mobile Testing is decreasing



Now, QA Organizations are facing challenges with Big Data Analytics



With the explosive growth of Social Media, organizations uses Social Media as an channel for hearing customer feedback for application quality



Security, Functionality and Performance are the key focused area ofMobile Application Testing



Security, Functionality and Performance are the key focused area of Testing Cloud based Applications


Testing is not easy with Agile Development

Lack of test processes and professionals that fits agile development causes organizations to struggle maintain quality


Testing is not easy with Agile Development

Organizations are using multiple testing approaches to find best fit



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization

SMAC Technologi

es

Security, Functionality and Performance remains key area of focus while customer

experience is very visible



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization

Agile Testing

Organizations require fast and responsive Testing

aligned with agile development methods



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization


Test Automation Maturity is Increasing

Organizations are facing fewer challenges over time in Test Automation


Test Automation Maturity is Increasing

28% of Test Cases Automated now, targeted to be 40% by 2017



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization

Automation

Many organizations’ maturity in the field of test environment is increasing



Budget

Automation

Agile Testing

SMAC Technologi

es

Centralization


Error prone manual hand-offs and processes

Business

Demands

Planning Dev Testing Go/

No-GoReleas

e Ops

Rapidly increasing WIP

Isolated build and integration processes

Manual Testing increases latency or drives limited test coverage

“patch in production” leads to snowflake systems

Manual and error prone app deployments

Waiting time for build and test environments drives “desk-side” builds

Lack of effective customer insight and high latency drives “kitchen sink” requirements

Poor confidence in test data fosters “release aversion”



Business

Demands


No-GoReleas

e Ops









Agile Testing

SMAC Technologi

es

Automation BudgetCentralizat

ion




No-GoReleas

e









Agile Testing

SMAC Technologi

es

Automation BudgetCentralizat

ion

Business

Demands

Ops

Continuous Assessment

Continuous Assessment

Continuous

Operations

Continuous Delivery

& Deployme

nt

Continuous

Integration &

Testing


Thank YouKi-Bae Kim ([email protected])Business Development ManagerHP Software Asia Pacific and Japan