Solution Testing in the Cloud - ANZTB - Australia & New ... · @testRUNnz Synchronicity Solution Testing in the Cloud with Agile Teams ANZTB Test 2016: Advancing Testing Expertise

@testRUNnz Synchronicity

Solution Testing in the Cloud with Agile

TeamsANZTB Test 2016: Advancing Testing Expertise Conference

Chris SAUNDERS May 2016 Melbourne AUSTRALIA


Interactive

Think

FUN

Optional

doodle

Non-verbal Visual

Audio

How many words are there?

VerbalActivities

Words


Solution Testing

in the Cloud

withAgile

TeamsThink


A Regular Heartbeat


A Regular HeartbeatIs similar to a testing heartbeat

By Dr. Jana (http://docjana.com/images/gifs/heart_beating.gif) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

Regular interval

Expected event

Varyingintervals

Life

Patterns

Information


A Regular HeartbeatIs similar to a testing heartbeat


Continuous DeliveryRequires a regular heartbeat

ScopeBig Release

Model

Bug: Missing Side

Bar Translations

Feature:

Enhanced Search

1.0

2.1

2.0

July Sept Nov JanMay

Continuous Delivery

ModelImprovement:

UX Colour Change


Heart RateTesting your fitness level


Medical Disclaimer

Content is not intended to be professional

medical advice.

For any medical questions, always seek

advice of a qualified health professional.


RELAX


RELAXResting heart rate

Feet flat

on floor

Back

straight

Breath in

Breath outHands

on your

lap


Heart RatePulse

Wrist

Inside of

your elbow

Side of

your neck

Top of

the foot


Heart RateCount X 4 = beats per minute (bpm)

16 x 4 = 64 bpm15s

00:0100:0200:0300:00

15 Second Count Down


Heart RateObservations

Age18-25 26-35 36-45 46-55 56-65

Athlete 49-55 49-54 50-56 50-57 51-56

Excellent 56-61 55-61 57-62 58-63 57-61

Good 62-65 62-65 63-66 64-67 62-67

Above

Average66-69 66-70 67-70 68-71 68-71

Average 70-73 71-74 71-75 72-76 72-75

Below

Average74-81 75-81 76-82 77-83 76-81

Poor 82+ 82+ 83+ 84+ 82+

Age 18-25 26-35 36-45 46-55 56-65

Athlete 54-60 54-59 54-59 54-60 54-59

Excellent 61-65 60-64 60-64 61-65 60-64

Good 66-69 65-68 65-69 66-69 65-68

Above

Average70-73 69-72 70-73 70-73 69-73

Average 74-78 73-76 74-78 74-77 74-77

Below

Average79-84 77-82 79-84 78-83 78-83

Poor 85+ 83+ 85+ 84+ 84+

Male Female

63-66

36-45

Good


TESTING = LEARNING


Solution Testing


Product Testing


Product TestingA product is similar to a person


UNIQUE


UNIQUE ABILITIES


UNIQUE EXPERIENCES


Product TestingA product is similar to a person


Solution Testing


SOLUTION


Solution TestingA solution is similar to a

community of people


Solution TestingA solution is similar to a

community of people

Scripted

Environments

---------

----

-----

--------------

---


The Cloud


1985Old Network Schematics


1985Old Network Schematics


1994Network ≡ Cloud


2016 SurveySource: Cloud Computing Trends: 2016 State of the Cloud Survey

(1,060 IT professionals)

95%

29%

of respondents are

using the cloud

Heavy cloud users


Solution Testing

in the Cloud


Solution Testing

Solution Development Solution Cloud Deployment

Feature. Bug.

Improvement. No

Yes

MergeBranch

Release

Develop

Packaged

Solution

Stage

Test

ProductionDevelopment

Observations

Script:

Environments

---------

Product

Configuration

-----

---------

Data

-----

---------

Multiple Teams


Environment Configuration and

Management


Vagrant

Create and configure lightweight, reproducible, and portable development

environments.

vagrantup.com


Puppet

With Puppet, you define the state of your IT

infrastructure, and Puppet automatically enforces the

desired state.

puppetlabs.com


Puppet

user { chrissaunders':

ensure => 'present',

home => '/home/chrissaunders ',

comment => ‘Chris Saunders',

groups => 'web',

password => ‘I$LOVE$TESTING',

password_max_age => '99999',

password_min_age => '0',

shell => '/bin/bash',

uid => '501‘,

}


RELAX


RELAXResting heart rate

Feet flat

on floor

Back

straight

Breath in

Breath outHands

on your

lap



16 x 4 = 64 bpm15s

00:0100:0200:0300:00




Age65-56 55-46 45-36 35-26 25-18

Athlete 54-59 54-60 54-59 54-59 54-60

Excellent 60-64 61-65 60-64 60-64 61-65

Good 65-68 66-69 65-69 65-68 66-69

Above

Average69-73 70-73 70-73 69-72 70-73

Average 74-77 74-77 74-78 73-76 74-78

Below

Average78-83 78-83 79-84 77-82 79-84

Poor 84+ 84+ 85+ 83+ 85+

Age 65-56 55-46 45-36 35-26 25-18

Athlete 51-56 50-57 50-56 49-54 49-55

Excellent 57-61 58-63 57-62 55-61 56-61

Good 62-67 64-67 63-66 62-65 62-65

Above

Average68-71 68-71 67-70 66-70 66-69

Average 72-75 72-76 71-75 71-74 70-73

Below

Average76-81 77-83 76-82 75-81 74-81

Poor 82+ 84+ 83+ 82+ 82+

MaleFemale

63-66

45-36

Good


AgileTeams


Development People Making Solutions


Agile Team


Scrum or Kanban


Tribe


Department


Development Group


Connections between Individuals, Teams and Tribes


Solution DeliveryThree Agile Teams

Scope

JulMay

Green Tribe

Red Tribe

Blue Tribe

June


Solution Testing

in the Cloud

withAgile

Teams


BALLOONS & TWINE


The Balloon Tribe


FEATURE


PRODUCT


SOLUTION


The Balloon TribeCreating our Balloon Tribe


Agile TeamsFour people in a Team

Team colour.

Other teams.

Features

X 8 X 8


Solution1. Group balloons

into solution is system integration testing.

2. User acceptance testing.

Product

1. Inhaling is component test.2. Exhaling is coding.

3. Knots & twine is component integration test.

4. Group balloons into each colour is system testing

A different person must tie the knots, to the one who Blows it up.

Cross-Functional

The Balloon Tribe

Features


BALLOONS & TWINE



into solution

2. User acceptance testing.1. Inhaling

2. Exhaling

3. Knots & twine

4. Group balloons


Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration


The Balloon Tribe

Product Focused Completed own

coloured balloons

Solution Focused Completed other coloured balloons



into solution


2. Exhaling

3. Knots & twine

4. Group balloons


Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration


Solution DeliveryHave you delivered a solution yet?

Scope

2 min0 min

Green Tribe

Red Tribe

Blue Tribe

1 min



into solution


2. Exhaling

3. Knots & twine

4. Group balloons


Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration


The Balloon Tribe

Solution


The Balloon Tribe

Solution Solution


USER ACCEPTANCE TESTING


RELAX


RELAX



22 x 4 = 88 bpm15s

00:0100:0200:0300:00




Age18-25 26-35 36-45 46-55 56-65

Athlete 49-55 49-54 50-56 50-57 51-56

Excellent 56-61 55-61 57-62 58-63 57-61

Good 62-65 62-65 63-66 64-67 62-67

Above

Average66-69 66-70 67-70 68-71 68-71

Average 70-73 71-74 71-75 72-76 72-75

Below

Average74-81 75-81 76-82 77-83 76-81

Poor 82+ 82+ 83+ 84+ 82+

Age 18-25 26-35 36-45 46-55 56-65

Athlete 54-60 54-59 54-59 54-60 54-59

Excellent 61-65 60-64 60-64 61-65 60-64

Good 66-69 65-68 65-69 66-69 65-68

Above

Average70-73 69-72 70-73 70-73 69-73

Average 74-78 73-76 74-78 74-77 74-77

Below

Average79-84 77-82 79-84 78-83 78-83

Poor 85+ 83+ 85+ 84+ 84+

Male Female

83+

36-45

Poor


TESTING HEARTBEAT OBSERVATIONS


Solution Testingin the cloud with Agile Teams

By Dr. Jana (http://docjana.com/images/gifs/heart_beating.gif) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

Solution Testing

in the Cloud

withAgile

Teams


RELAX

DISCUSSION TIME

Synchronicity

Simultaneous cultural and

technical transformation


The following slides are not for the ANZTB presentation



into solution


2. Exhaling

3. Knots & twine

4. Group balloons


Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration


Testing Heartbeat and Test Levels


Standard Glossary of Terms

http://anztb.org/downloads.php

http://anztb.org/downloads.php


Test LevelsDifferent sizes and feel different

A group of test activities that are organised and managed together.

Examples of test levels:• component test• integration test • system test• acceptance test


Component TestIt feels like playful small drumming

A humming bird’s heart rate is 1200bpm

The testing of individual software components. E.g. A web service, a web resource, or a module that encapsulates a set of related functions (or data).


Component Integration Test

It feels like fast playful clicking fingers

A rat’s heart rate is 400bpm

Testing performed to expose defects in the interfaces and interaction between integrated

components.


System Test It feels like a regular finger clap

A cat’s heart rate is 120bpm

Testing an integrated system to verify that it meets specified requirements.


System Integration Test

It feels like a regular clock clap

A giraffe’s heart rate is 60bpm

Testing performed to expose defects in the interfaces and in the interactions between integrated

components or systems.


Acceptance TestIt feels like a very slow clap

An elephant’s heart rate is 30bpm

Formal testing with respect to user needs, requirements, and business processes conducted to determine whether or not a system satisfies the acceptance criteria.


Beta TestIt feels like a very, very slow stomp

A blue whale’s heart rate is 10bpm

Testing by users at an external site, to determine whether or not a component or system satisfies the

user needs and fits within the business processes.


Size matters

Test Levels


Test Levels

Testing Pyramid

Beta Test

Acceptance Test

System Integration Test

System Test

Component Integration Test

Component Test

Documents

Solution Testing in the Cloud - ANZTB - Australia & New ... · @testRUNnz Synchronicity Solution Testing in the Cloud with Agile Teams ANZTB Test 2016: Advancing Testing Expertise