View
3
Download
0
Category
Preview:
Citation preview
The World Quality Report 2010-2011
How does your organization compare against
today’s trends in software quality and
testing?
2World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Mattias Bergströmner
- Global Service Line Testing
- Subject Matter Expert Testing
- Strategic Sales & Delivery
+46 730 88 40 26
+ 46 853 68 40 26
mattias.bergstromner@sogeti.se
Speaker
3World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Report Demographics
Key Findings
Industry Perspectives
Testing Tools and Technology
Skills and Test Organization
Testing Outsourcing Trends
Virtualization and Testing on the Cloud
Leveraging Agile Methodologies
The State of Quality
What next ?
Agenda
4World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
This presentation
Take off
Go directly to10 000 ft
Hope you are well seated
Enjoy and relax.
5World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Report Demographics
7World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
World Quality Report profile - geography
North America
52%
Europe
30%
Asia
9%
Rest of the World
9%
30 000 CXOs,
IT directors, QA Mgrs
and engineers at various
companies around the
world.
8World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
World Quality Report profile – size of the company
0%
5%
10%
15%
20%
25%
30%
35%
40%
Enterprise Large Mid size Small
27%
17% 18%
38%
Below 1000* Over 20 000*1000 – 4999*5000 – 20 000*
*employees
World Quality Report 2010-2011
Key Findings
11World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Highlights and Key Trends
Economic Impact
Most companies had to reduce their IT spend, but 71% are still investing in new
application development projects
50% indicate resource cuts and heavier project loads have forced their project
teams to take on more work
Methodology
70% admit to following specific ALM (Application Lifecycle Management)
methodology
82% follow testing processes consistently for more than half of their projects
Skills
QA organizations increasingly require well-rounded resource skill sets; testing,
development & methodologies = greater convergence
12World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Highlights and Key Trends
Agile
Agile delivery methods continue to gain popularity; 60%+ leverage agile, although
mostly experimentally and gradually, with time to market & quality benefits
Outsourcing
Nearly 50% outsource application development and testing irrespective of
methodology used, and plan to increase offshore resources in the coming year. The
biggest growth is seen in Europe.
Virtualization and the Cloud
Nearly 75% starting to leverage deployment of some applications on the Cloud -
cost reduction and agile are main reasons
Industry Perspectives
14World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
CPR companies place greater premium
on aligning business and IT priorities,
but there is significant disconnect
between business and QA groups in
sector
63% of survey responses feel that
business thinks role of QA is to
execute scripts, even though execution
accounts for only a fraction (20-25%) of
QA activities.
CPR respondent say 67% of their testers
have little CPR domain expertise, lower
than other sectors
Despite downturn, CPR sector is
increasing investment in IT and new
application development
Almost half are leveraging outsourced
resources for testing
Industry notes: Consumer Products and Retail
“I don’t get no
RESPECT!”
15World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Heavy reliance on IT systems for core
functions but no standardized ERP solution
– a lot of systems requiring effort to
maintain and difficult to integrate in
acquisition/ merger
Still supporting ever-expanding datacenters
and aging infrastructure
70% of Distributions/Logistics respondents
turning to agile development to help build new
SOA platforms
All claim to be using integrated automation tools
to support agile initiatives, but number of
initiatives remains small (less than 25%)
Some are starting to bring their applications
to the cloud
Industry notes: Distribution/Logistics
16World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Application performance testing considered
a requirement in this sector; accuracy and
precision are essential given multi-trillion $
transactions
Still feeling the impact of the recession and
increasing regulation
Banks’ existing distribution and legacy
systems not set up to support changing
customer banking behavior patterns with
heavy reliance on web-based services and
transactions
64% of respondents have reduced IT
investments due to the economic conditions
But 80% say they are still investing in new
application developments projects
66% are leveraging Agile in their ALM
Nearly 70% are using outsourcing services
for testing, with increasing reliance
Industry notes: Financial Services
“I’m repaying the
bailout money from
my phone”
17World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
“It’s better to be first than to be better” - quality often takes second place
to time to market
Quality = usability, design and positive user experience
Sector achieves higher quality with limited resources
through efficiency and innovation
80% use Agile; of those 30% use Agile for over 50%
of their application development
Among the first to embrace the Cloud to optimize
IT infrastructure
They plan to test 25%+ of applications on the Cloud
Outsourcing is not preferred route – as app development
core to the business
QA is integral to app delivery process: 76% understand that
primary function of QA is not simply execution of test scripts
Industry notes: High Tech
“Iphone
came
first!”
“Droid
is
faster!
”
18World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
IT budgets shrinking, public scrutiny and
regulation forcing sector to take more strategic
and ROI-approach to IT investment
Cloud coming to the fore; all government
sector respondents confirm they intend to
move some applications to the cloud in next
3 years
Quality is very important due to downstream
consequences of poorly performing applications
Most have well-defined ALM methodology +
highest number of responses for following a
standard methodology such as TMap®
But slow to adopt Agile. 69% respondents do
not use agile
Sector traditionally not used outsourcing and
offshoring; 32% use QA outsourcing and 21%
plan to increase their use
Industry notes: Public Sector
“Yes we can???”
19World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
IT is second largest capital expense
with investment in self-service online
applications for customer interaction
Sector continues to invest heavily in
new IT projects – 76% in new
application development
Looking to consolidate, centralize and
simplify strategic IT systems –
standardizing on a single streamlined
system
69% - greatest challenge is capturing
business requirements and managing
change
Quality is more than functionality – its
about the user experience.
Industry notes: Telecommunications
40% are increasing their outsourcing and
want more specialist services eg SAP
Forefront of adopting virtualization – all
are planning to test applications in the
Cloud, + 31% indicate they expect to test
over half of their applications in the Cloud
Testing Tools and Technology
• The Role of Automation
• The Case for Return on Investment
21World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Leverage of automation technology across ALM
Test
Cases
Defect
Manage-
ment
Require-
ments
Use
Case
Business
IP
Domain
Mgmt
All of the
AboveBusiness
Flow
Modeling
22World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Need for Automation Investment
0%
5%
10%
15%
20%
25%23%
20% 20% 19%
14%
1%
3%
Business
Flow
Modeling
Require-
ments
Test
Manage-
ment &
Execution
Defect
Manage-
ment
Environ-
ments &
Data
Management
None; we
have all that
we need
Testing
Through
the Cloud
23World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
How much ROI are you getting from Investments?
100%
Up to 80%
Up to 50%
Less than 25%
None
Can't Quantify
Skills and Test Organization
• Domain knowledge and Skills
25World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Does QA need to have domain knowledge?
NA
EU
ROW
ASIA
Experts in our
industry domain
Few years’ relevant
industry domain knowledge
Very little
Doing more with less is here to stay.
27World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Most important skills when hiring QA
Security skills
Networking skills
Mainframe skills
Database skills
Scripting skills (Perl, Python, etc.)
Development skills (C++, Java, etc.)
Business Knowledge
QA skills
Testing Outsourcing Trends
29World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Do you outsource QA?
NA
EU
ROW
ASIA
Yes
No
30World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
South East Asia
Eastern Europe
South America/Latin America
Nearshore
India
Contractors Co-located
China
Africa
Where do you prefer to outsource QA?
Virtualization and Testing on the Cloud
33World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
What percentage of applications are virtualized?
34World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Top Cloud migration challenges
Application performance
issues
We have issues but we do not
know the reasons
We have not seen any issues
Infrastructure performance
problems
Application functionality
issues
Security and vulnerability
problems
35World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
How are you leveraging cloud in testing?
We do not leverage virtualization
/cloud in our testing efforts
We leverage cloud services to
generate traffic for our performance
testing efforts
We use testing tools hosted
in the cloud
We set up test environments using
cloud services
Leveraging Agile Methodologies
38World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Do you leverage Agile methods in application
delivery?
No
Yes
40World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
What is the biggest challenge working with
offshore resources for Agile delivery?
The State of Quality
• Year on Year improvement
• The Role of processes and frameworks
42World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Overall is Quality getting better? (Last two years)
Yes
No
43World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
Which Test Methodologies are used?
What Next?
46World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
What next?
Investment shift to requirements visualization, business flow modeling and test
environment and data management
Increased demand for testers with strong technical skills and relevant domain and
business knowledge
Agile delivery methods will enable businesses to focus on projects that bring fast ROI
Hosting applications on a cloud will help reduce infrastructure costs, increase agility
and capacity planning
Trend for increased outsourcing remains, provided vendors offer more specialized
value-added services and assets and industry skills
Speak to us about participating in our 2011-12 WQR survey
mattias.bergstromner@sogeti.se
47World Quality Report 2010
Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.
For more information
Download the World Quality Report at
www.capgemini.com/wqr2010-11
www.sogeti.com/Curious-about-
Sogeti/publications
Or contact
Mattias Bergströmner
+46 730 88 40 26
+46 853 68 40 26
mattias.bergstromner@sogeti.se
Thank you !
Recommended