THE FUTURE OF TESTING Tilo Linz, imbus AG

TILO LINZ CoFounder and member of managing board imbus AG

President ISTQB (2002-2005)

Chairman German Testing Board e.V. (2002-2013)

Author

tilo.linz@imbus.de www.imbus.de

LOOKING INTO THE FUTURE

Sour

ce:

http

://d

e.w

ikip

edia

.org

/wik

i/Sze

nario

tech

nik

ht

tp:/

/en.

wik

iped

ia.o

rg/w

iki/S

cena

rio_p

lann

ing

Wild card

past today tomorrow

Imagine scenarios of tomorrow

Scenario A

Scenario B

Scenario C

…

Identify situation today

By Scenario Planning

Analyse drivers of change

Example

SOFTWARE TESTING DIMENSIONS Tomorrow

?

?

?

Drivers of Change

Objects & Objectives to test

Methods & Tools available

Standards & Processes to follow

Today IT-Applications, mobile Apps, embedded Systems, Systems of Systems, … Test Automation, Load Test, Code-Analysis, …

ISTQB, V-Model, Scrum, IEEE 829, IEEE 1044, …

DRIVERS OF CHANGE

Plateau will be reached in: o < 2 years ● 2-5 years ● 5-10 years > 10 years

Source: G

artner Hype Cycle for Application Development, 2014

Application Development Trends e.g.: ● Crowdtesting ● Test Data Management ● Cloud Testing Tools ● SOA Testing ● Behaviour-Driven Dev.

DRIVERS OF CHANGE

Plateau will be reached in: o < 2 years ● 2-5 years ● 5-10 years > 10 years

Source: G

artner Hype Cycle for Emerging Technologies, 2013

Emerging Technologies ● Cloud Computing ● Mobile Robots ● Autonomous Vehicles ● Biochips Internet of Things Brain-Computer Interface

SOFTWARE TESTING 2014

On the Rise o ISTQB

Certified Agile Tester ● Enterprise-Class

Agile Dev & Testing

At the Peak o ISO 29119 ● Test Data Management ● Test-First/Behavior-

Driven Test

Sliding Into the Trough ● Crowdtesting Model Based Testing

Climbing the Slope o Managed Testing Services ● Security Testing ● Code Analysis Tools & Services ● Agile Testing

Plateau of Productivity Test Automation Tools Independent Testing

Services ISTQB Certified Tester V-Model Testing

Sources: Author’s view, based on e.g. Gartner Hype Cycles 2013, 2014 www.testtoolreview.com

ISTQB EXTENSION SYLLABI ISTQB Certified Agile Tester Released http://www.istqb.org/downloads/syllabi.html

ISTQB Model Based Testing ISTQB Working Group established

GTB Certified Automotive Software Tester GTB Working Group established ISTQB Pilot

TESTING IN SCRUM

Agile vs. Traditional Approaches Planning an Agile Project Unit Testing and Test First Integration Testing and Continuous Integration System Testing and Testing Nonstop Quality Management and Quality Assurance Case Studies

http://www.rockynook.com/shop/computing/testing-in-scrum/

A Guide for Software Quality Assurance in the Agile World

TESTTOOLREVIEW.COM comment, discuss, share best practices

find tools quickly by category

find tools by name or other criterias

SOFTWARE TESTING TRENDS

Objects & Objectives to test

Methods & Tools available

Standards & Processes to follow

Today PC-Applications, mobile Apps, embedded Systems, Systems of Systems, … Test Automation, Load Test, Code-Analysis, …

ISTQB, V-Model, Scrum, IEEE 829, IEEE 1044, …

Tomorrow

● Cloud-based Systems ● Mobile Robots ● Autonom. Vehicles Internet of Things Brain-Comp.Interface ● Cloud Testing Tools ● SOA Testing ● Test Data Managem. ● ? ?

● Crowdtesting ● Test-Driven ● ? ?

Drivers of Change

● Mobile ● Cloud ● Artificial Intelligence Bio-IT

Wild Cards ?

TESTING IN 20X0 3 SCENARIOS

TESTS LEAD TO ACCIDENTS The Internet of Things (alias Outernet) leads to a rapid increase in connectivity. It tends to become more difficult to test individual system elements of the Outernet since they have to be isolated for this purpose. In most cases, setting up a separate test environment is foregone and testing new system elements takes place in their real environment.

Such tests repeatedly cause unexpected side effects on the Outernet which will lead to numerous accidents and damage.

… 2020 ? … 2035 ? … 2050 ?

Scenario A

TEST FIRST IS STANDARD The weak AI carries so many risks resulting not least from the intended autonomy that their development will be increasingly controlled by the state, both nationally and globally. Eventually, only "testable" AI systems are approved.

The consequence is the natural and broad application of "Test Driven Development". With this, the testers have arrived in the post-empirical age: they decide what will be ready to go into production.

… 2020 ? … 2035 ? … 2050 ?

Scenario B

THE NEURO-SOFTWARE TESTER Due to innovative devices – from the smart contact lens to the brain-computer interface – the human brain increasingly participates in the IT system. This leads to an increasing data exchange between brains and computers.

The brain thus needs to be integrated in the tests to a certain extent. Part of the software testers becomes neuro-software testers.

… 2020 ? … 2035 ? … 2050 ?

Scenario C

imbus TREND STUDY “The Future of Testing”

will be published Nov 2014 Ask for your copy via email to:

tilo.linz@imbus.de Or join us on Xing, linkedIn, twitter www.imbus.de