2012/13 Presentation to NOSQAA November 15, 2012 World Quality
Report 2012-13 Testing for the Future
Slide 2
2 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Company Overview
Slide 3
3 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Sogeti Testing
Practice Overview
Slide 4
4 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Introductions Dan
Hannigan Senior Vice President QA/Testing Services Sogeti USA Dan
Hannigan is a Senior Vice President with Sogeti USA LLC. Sogeti is
a wholly owned subsidiary of Capgemini SA. Dan has been with Sogeti
for 24 years, during this time he has held several positions
including: Director of Consulting Services specializing in package
implementations, Manager of Systems Professionals, Project Manager,
National Practice Manager for Seibel Implementations, Account
Executive (sales), Geographic Vice President for the
Akron/Cleveland offices and is currently the North American
Practice Manager for the Sogeti Quality Assurance and Testing
Practice (Managed Testing Practice). His current responsibilities
include supporting Sogeti Geographic units in the sales and
delivery of QA/Testing solutions, development of solutions within
the practice and Global responsibility to the Sogeti Global team
for Strategic development. Dan also sits on the Global Innovation
Board which is responsible for evaluation of potential Innovations
for inclusion in the Sogeti QA/Testing Solutions. Prior to joining
Sogeti Dan was the CIO for the Conna Corporation Convenience Stores
chain a division of Dairy Mart Convenience Stores.
Slide 5
5 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Agenda Introducing
the World Quality Report Brief Overview North America Global Key
Findings and how these relate to QA/Testing Organizations and
Professionals Key findings by Topic Quality Budgets Testing Centers
of Excellence Mobile Testing Cloud Quality Assurance Resources Key
findings by Sector Q&A
Slide 6
6 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 What is the World
Quality Report? Only global report for application quality
covering: Outsourcing trends, tools, technology, organization
Industries: CPRD; E&U; FS; High-Tech; Public; TME Geographic
analysis: ANZ; Brazil; China; France; Germany; Netherlands; North
America; Nordics; UK Co-sponsored report by Capgemini, Sogeti &
HP Capgemini Group (world leader in testing services) HP (World
leader in application testing technologies Research sample and
methodology 1,553 telephone interviews with CIOs, CFOs, IT
directors and senior managers involved in testing and QA based on a
structured questionnaire. Fourth year the report has been
published
Slide 7
7 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 World Quality Report:
Interviews by Region WQR research based on 1,553 telephone
interviews covering 25 countries Data from questionnaire and
customer quotes
Slide 8
8 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 World Quality Report:
Interviews by Sector and Job Title Interviews by SectorInterviews
by Job Title
Slide 9
9 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 2012-13 World Quality
Report Details 6 x 2 page sector analysis9 x 2 page country
analysis, top trends
Slide 10
10 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 North America
Respondents data Number of respondents: 296 Type of companies:
Medium and Large Private Sector companies, Government and Public
Sector Organizations, Breakdown as Follows: Based on FTE Headcount
10,000+ (119), 5,000-9,999 (99), 1,000-4999 (78) Telephone
interviews carried out April May 2012 Research conducted by
specialist B2B market research company, analysis done by our own
specialists in the Industry Other information on country/sector 58%
of NA Companies plan to use Testing-As-A- Service in the next 12
Months 44% of NA Companies say budgets have increased with 50%
saying additional increase by 2015
Slide 11
11 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 North America Other
information on country/sector The Cloud is seen as a way to
optimize cost management, improve flexibility and help align IT
with the needs of the business. Only 20% of NA organizations rate
internal testing resources as above average in terms of quality 35%
of organizations report that the testing function is highly
decentralized and a further 41% operate combined centralized and
decentralized teams 64% of companies report that internal Testing
functions are performed by business analysts or development teams.
30% of companies plan to implement an internally managed TCOE in
the next 2 years 19% of organizations intend to use 3 rd party TCOE
capability
Slide 12
12 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 North America Other
information on country/sector 1 in 10 organizations is still
implementing a TCOE started in 2011, but only a minority have made
the full transition. The commitment to testing is demonstrated by
the allocation of IT budget to testing, at 18% it is on par with
the global average, but more encouraging is that 40% of this budget
is allocated to innovation/new transformational projects. 44% of
organizations report that the IT budget is increasing and half are
reporting that they expected continued increases thru 2015. 6% of
organizations state clearly that the budget is either static or
decreasing, not particular sector was identified. 60% or
organizations reported that the greatest increase in investment is
in tools and outsourcing
Slide 13
Key Findings and their implications for Organizations
Slide 14
14 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 QA budgets: Stepping
up Majority of organizations expect testing budgets to rise between
now and 2015.
Slide 15
15 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 QA budget: Stepping
up General and universal trend over regions and sectors 42%
reported their testing budget has increased last year same level of
investment in quality is maintained: show importance of QA. 53%
expect their QA budget to rise between now and 2015 Indicate
optimism for future Testing spend on: 41% new transformational work
(testing new application) 59% maintenance work (maintenance of
existing software)
Slide 16
16 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 QA budgets: Stepping
up MY INVESTMENT GOING FORWARD WILL [FOCUS ON] BRINGING MY INTERNAL
TEAMS UP TO STANDARD, INCREASING THE LEVEL OF AUTOMATION USED, AND
DEVELOPING GREATER EFFICIENCIES THROUGHOUT. ALTHOUGH OUR TESTING
BUDGET IS NOT SEPARATE FROM THE WIDER IT BUDGET, THE LEVEL OF
MONITORING AND PERFORMANCE MEASURING HAS INCREASED WE NEED TO
JUSTIFY OUR COSTS. AN AUTOMOTIVE BUSINESS, BRAZIL THE PROBLEM IS
INCREASING PRESSURE TO GET THINGS DONE YESTERDAY. WE HAVE THIS
CONFLICT BETWEEN TESTING ADEQUATELY TO OUR SATISFACTION AND THE
TESTING TIME EXPECTED BY THOSE ON THE BUSINESS SIDE. INVESTMENT HAS
INCREASED BUT THEN EXPECTATION IN SPEED OF DELIVERY HAS ALSO
INCREASED. IT S NOT EASY, AS THE ORGANIZATION NEEDS TO BE ABLE TO
JUMP INTO A MUCH FASTER TESTING MODE WHILE MAINTAINING QUALITY
STANDARDS. A MANUFACTURING BUSINESS, CZECH REPUBLIC
Slide 17
17 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 QA budgets: Stepping
up Figure 3 Areas of Greatest Increase in Spend
Slide 18
18 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 QA Budget: Stepping
up Investment priorities: Budgetary line item: upgrade existing
process and tools Why? Move to newer application lifecycle
platforms and software-on-demand models 2015: 46% of businesses
will dedicate their budget to purchase external resources to
supplement their internal QA team. Investment priorities vary by
region: Eastern Europe invests more in new testing tool (33%
compared to 19% generally and 15% for North America) Public sector
leads the way for increased QA budget : rise of 48% compared to the
previous year despite budget cuts.
Slide 19
19 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Testing Centers of
Excellence: A growing priority Organizations are turning to COEs to
consolidate their QA operations in response to market pressures,
technology demands, and emerging models of testing delivery.
Slide 20
20 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Testing Centers of
Excellence: A growing priority Market unpredictability: some
businesses still looking to shave 30-40% off their testing budgets.
While QA budgets are increasing, still a need to control costs
Technology expectations: growing demand to deliver applications as
quickly, efficiently and as cheaply as possible Diversity of
delivery models: QA departments are maximising on efficiency gains
offered by the cloud, and agile testing (currently being used by
37% of testers)
Slide 21
21 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Testing Centers of
Excellence: A growing priority A TCOE IS SOMETHING IM BUILDING
HERE; IT REPRESENTS A SIGNIFICANT CHANGE IN OUR APPROACH BUT ONE
THAT I PERSONALLY BELIEVE TO BE VITAL TO OUR BUSINESS SINCE IVE
COME FROM AN ORGANIZATION WITH AN OPERATING TESTING CENTER. WE KNOW
THAT IT CAN REDUCE COSTS AND OVERALL TIME OF TESTING PRACTICES, AND
GIVEN THE COMPETITIVE NATURE OF THE MARKET WE OPERATE IN, ITS
CRITICAL TO GET SPEED AND COSTS DOWN WHILE GETTING QUALITY UP. WE
BELIEVE A TCOE CAN DO THIS. FOR US, THE MOVE TOWARDS A TCOE IS PART
OF THE WIDER UNION BETWEEN THE BUSINESS AND IT SIDE OF THE
ORGANIZATION. WE NOW HAVE A MUCH STRONGER LINK BETWEEN THE TWO, AND
WHILE THAT MEANS WE FEEL MORE ABLE TO UNDERSTAND AND ANSWER
DEMANDS, IT DOES INCREASE PRESSURE ON TESTING TO BE MORE EFFICIENT
AS A WHOLE DECENTRALIZED TESTING TEAMS JUST COULDNT PROVIDE THAT
EFFICIENCY AND IT MEANT THAT WALLS EXISTED BETWEEN THE TEAMS,
WHEREAS SHARED EXPERIENCE AND BEST PRACTICE ARE FAR EASIER WITHIN A
TCOE FRAMEWORK. A FINANCIAL SERVICES BUSINESS, FINLAND A
MANUFACTURING BUSINESS, UK
Slide 22
22 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Testing Centers of
Excellence: A growing priority Figure 3 Expected Benefits from
Implementing a Testing Center of Excellence
Slide 23
23 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Testing Centers of
Excellence: A growing priority Why build a TCoE and what benefits
to expect? Speed to market: a key of growing TCoE adoption
Compressing time-to-market (36%) Enhance the agility of QA
operations (17%) To cope with challenges of an unpredictable
economy: Produce better and faster Competition and maximize profits
Contribute to enhance quality and better resource management: An
efficient approach to industrialize testing activity Provide
visibility into the level of quality for any software system or
project A centralized pool of resources that can be leveraged
across multiple projects in an organization
Slide 24
24 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing:
Behind the curve Only 31% of firms surveyed currently test mobile
applications. Why? According to many interviewed for the report
they have no appropriate tools or expertise and limited access to
the devices to test effectively mobile applications.
Slide 25
25 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing:
Behind the curve Why such a need of mobile testing? Proliferation
of devices Need for mobility: performance and usability on the move
Increase in demands and expectations Shift to mobile devices: more
than 5 billion mobile devices in the world for only 2 billion
computers Quote: More and more of our business is done online [in
general] so its something [mobile app] we need to get hold of and
understand quickly A retail business, UK Real need of mobile
testing which is not yet fulfilled....why?
Slide 26
26 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing:
Behind the curve Companies are underprepared: Organizations are ill
equipped: 65% do not have the right tools 52% do not have access to
required devices Fragmentation of mobile devices and frequent
releases: a very changing market which requires adaptability from
testing organizations
Slide 27
27 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing:
Behind the curve Average: 31% of organizations test mobile
application Up to average : Regions with traditionally high levels
of mobile application (Australia & NZ, Nordics, Western and
Southern Europe) Asian challenges : Explosion of the mobile market
in Asia Only 30% of organizations test mobile application so far
Focus on portability and compatibility across devices
Slide 28
28 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing: By
Sectors Manufacturing firms are surprisingly more likely to conduct
mobile testing Some sectors have difficulties to adopt mobile
testing (Public sector, Financial services...)
Slide 29
29 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing: By
sectors Quote on page 28 Retail Business UK increasing investments
are expected over the coming year
Slide 30
30 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing:
Priorities when testing mobile applications
Slide 31
31 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Mobile Testing:
Priorities when testing mobile applications Why testing mobile
applications? Performance: increase efficiency is a priority for
64% of respondents More acute in the UK & Ireland: 75% set
performance as priority demonstrating the maturity of this market
Security: only 18% set security as a priority on average Suggest
changing perspectives in security concerns (Bring-your-on-device
culture and protection of data)
Slide 32
32 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Cloud: Gathering Pace
28% of testing currently occurs in the cloud environment This is
set to rise to 39% by 2015 Only 4% reported no plans for Cloud
testing, down from 31%, 2 years ago.
Slide 33
33 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Cloud: Gathering Pace
THE CLOUD HAS BECOME A SIGNIFICANT PRIORITY FOR OUR ORGANIZATIONAL
DIRECTION IN THE INFORMATION TECHNOLOGY DEPARTMENT. WITH REGARDS TO
TESTING, ITS OPENING UP A WAY OF TURNING ON AND OFF A STREAM OF NEW
SKILLS AND ABILITIES, THAT IS BOTH FAST AND COST-EFFECTIVE. A
FINANCIAL SERVICES BUSINESS, THE NETHERLANDS WE EXPERIENCE PEAKS
AND TROUGHS IN OUR TESTING PROGRAM, SO TAAS PROVIDES A CERTAIN
DEGREE OF FLEXIBILITY. WHILE SOME APPLICATIONS MAY BE RUN OF THE
MILL, SOME MAY HAVE MORE AD HOC REQUIREMENTS. TAAS ALLOWS US TO
MEET UNIQUE OR TEMPORARY NEEDS WITHOUT THE BURDEN OF GREAT COST OR
ADDING TO PROJECT TIME. A RETAIL BUSINESS, DENMARK
Slide 34
34 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Cloud: Rapid Growth
In the UK the Cloud has more than gathered pace: Only 11% dont plan
to use the Cloud.
Slide 35
35 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Cloud: Benefits
Organizations are rapidly turning to the Cloud for cost savings,
flexibility, agility better resource and time management.
Slide 36
36 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Quality Assurance
Resources: A question of value 59%: qualify their internal QA teams
as on average Only 4-5% are confident that their resources
(internal and external) are best in class
Slide 37
37 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Quality Assurance
Resources: A question of value Critical to assess the quality of
software applications for organizations Need confidence in the
quality of QA resources In developed countries, QA is becoming a
recognized and dedicated profession 33% of companies express more
confidence in outsourced resources than in their own employees
desire to increase QA skills Find the right balance between
in-house and external teams
Slide 38
38 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Quality Assurance
Resources: A question of value OUTSOURCED TESTING WILL ALWAYS BE AN
IMPORTANT OPTION, BUT HOW WE SOURCE THOSE TESTERS DOES TEND TO
DEPEND ON PROJECT OR COST, RATHER THAN ANY SPECIFIC PREDEFINED
RULES. WE USED TO USE INDIA-BASED SUPPLIERS A LOT MORE THAN WE DO
TODAY, BUT THE COST BENEFITS WERE NOT BALANCED BY OUR INTERNAL
CLIENT SATISFACTION FEEDBACK. A FINANCIAL SERVICES BUSINESS,
AUSTRALIA ID LOVE TO BE ABLE TO PROFESSIONALIZE OUR TESTING
FUNCTION GIVE PEOPLE A CAREER AND THE PAY TO MATCH AND THEYLL STICK
WITH YOU. BUT THE REALITY IS QUITE THE OPPOSITE. TESTING IS SEEN AS
A NECESSARY EVIL IN MANY ORGANIZATIONS. THIS MEANS ORGANIZATIONS
NEVER GIVE [TESTERS] THE PROPER ATTENTION [THEY] DESERVE AND WE END
UP BUYING EXTERNAL EXPERTS WHO MAY HAVE THE SKILLS, BUT NOT
NECESSARILY THE INTIMATE KNOWLEDGE OF OUR BUSINESS. A RETAIL
BUSINESS, DENMARK
Slide 39
39 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Quality Assurance
Resources: A question of value North America: most highly
outsourced region for QA (to lower- cost labor market) FS:
recognize much more than any other sector the value of experienced
QA resources
Slide 40
Key findings by sectors
Slide 41
41 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Consumer products,
Retail and Distribution Todays trends: mobile and internet commerce
Invest in QA/testing to meet higher expectations from customers 41%
say that their QA budget has increased (35% previously) Need of
innovation : 45% of testing activities implemented in new or
transformational projects Our survey findings: TCoEs: 6% already
functional, 25% plan to develop them Cloud: 21% of their
applications are cloud based Mobile : 34% are currently testing
mobile application. The key criterion in this domain is the
capacity to test application on several networks (60%)
Slide 42
42 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 Energy &
Utilities Undergo major structural transformation (liberalization
of markets) Challenge: maintain antiquated legacy systems and
invest in innovative product lines IT budget has remained largely
static this year (for 51% of respondents) Our survey findings:
TCoEs: a large proportion say having no plans for a TCoE (44%)
Cloud: 1 in 5 of their applications hosted in the cloud TaaS: 47%
plan to use TaaS within next year Mobile: 65% do not test mobile
application Preference for upgrading internal expertise
Slide 43
43 Copyright 2012 Capgemini and Sogeti. All Rights Reserved
World Quality Report 2012-13 | September 2012 High Tech Fiercely
competitive sector with a quick pace of change Evolving
relationship and interaction between consumers and organisations
41% say that their IT budget has increased this year Plan to invest
in new testing tools by 2015 (45%), much more than any other sector
This sector will lead the way of innovation, what is reflected in
its approach of QA Our survey findings: TCoE: 43% plan to develop
TCoE Cloud: 62% of their applications are hosted in the cloud TaaS:
13% use this service and 43% intend to use it within next year
Mobile: 30% currently test mobile application
Slide 44
www.capgemini.com www.capgemini.com/testing
www.sogeti.com/testing www.hp.com The information contained in this
presentation is proprietary. It is for internal and intermediary
use only. Copyright 2012 Capgemini and Sogeti. All rights reserved.
Rightshore is a trademark belonging to Capgemini. No part of this
document may be modified, deleted or expanded by any process or
means without prior written permission from Capgemini. About
Capgemini and Sogeti With around 120,000 people in 40 countries,
Capgemini is one of the world's foremost providers of consulting,
technology and outsourcing services. The Group reported 2011 global
revenues of EUR 9.7 billion. Together with its clients, Capgemini
creates and delivers business and technology solutions that fit
their needs and drive the results they want. A deeply multicultural
organization, Capgemini has developed its own way of working, the
Collaborative Business Experience, and draws on Rightshore , its
worldwide delivery model. Sogeti, its wholly-owned subsidiary, is a
leading provider of local professional services, bringing together
more than 20,000 professionals in 15 countries and is present in
over 100 locations in Europe, the US and India. Together, Capgemini
and Sogeti have developed innovative, business-driven quality
assurance (QA) and testing services, combining best-in-breed
testing methodologies (TMap and TPI ) and the global delivery
model, Rightshore , to help organizations achieve their testing and
QA goals. Capgemini and Sogeti have created one of the largest
dedicated testing practices in the world, with over 9,500 test
professionals and a further 14,500 application specialists, notably
through a common center of excellence with testing specialists
developed in India. About HP At HP, we dont just believe in the
power of technology. We believe in the power of people when
technology works for them. To help you create. To make the digital
tangible. To harness the power of human information. At HP, we work
to make what you do matter even more. Our Business Technology
Optimization (BTO) products, along with our new and complete
approach to Application Lifecycle Management (ALM), help our
customers to achieve better business outcomes. TMap , TMap NEXT ,
TPI and TPI NEXT are registered trademarks of Sogeti, part of the
Capgemini Group.