27
What Is This Exploratory Testing Thing? Tony Bruce

What is this exploratory testing thing

Embed Size (px)

Citation preview

Page 1: What is this exploratory testing thing

What Is This

Exploratory Testing

Thing?Tony Bruce

Page 2: What is this exploratory testing thing

It’s all about me!

Tony Bruce Consulting Ltd

[email protected]

dancedwiththetester.blogspot.co.uk

@tonybruce77

Associate with

[email protected]

Page 3: What is this exploratory testing thing

Big bit of self promotion

January 2015 Workshop

Page 4: What is this exploratory testing thing

Perception of?

Page 5: What is this exploratory testing thing

Perception of?

● Doing random stuff to see

what happens

● Impromptu bug searching

● Undisciplined

● Undocumented

● Quick

● Untooled

● Unestimateable

● Unmanageable

Page 6: What is this exploratory testing thing

What is it?

The plainest definition of exploratory testing is test design

and test execution at the same time.- James Bach - http://www.satisfice.com/articles/what_is_et.shtml

Simultaneously designing and executing tests to learn about

the system, using your insights from the last experiment to

inform the next- Elisabeth Hendrickson - Explore It!: Reduce Risk and Increase Confidence with Exploratory

Testing

Page 7: What is this exploratory testing thing

What is it?

http://swtester.blogspot.ca/2012/05/what-is-exploratory-testing.html

Page 8: What is this exploratory testing thing

What is it?

Leaders

hip

Under

Pre

ssure

: T

actics fro

m the F

ront Lin

e -

Bob S

tew

art

Page 9: What is this exploratory testing thing

What can it involve?

Scientific MethodQuestion

Hypothesis

Strategy

Experiment

Data

Analysis

Conclusion

Page 10: What is this exploratory testing thing

What can it involve?

Page 11: What is this exploratory testing thing

What can it include?

…...when a programmer is creating unit tests to drive the

development (Q1), they are thinking about the feature and

design and making choices about what to automate. There is

a lot of learning going on in this process and I would very

much consider this discovery process as "exploratory"......

…...executing these checks that were created in an

exploratory way is no longer an exploratory testing

activity…….

http://swtester.blogspot.ca/2012/05/what-is-exploratory-testing.html

Example

Page 12: What is this exploratory testing thing

What can it include? - People/Pairs

Example

● Locked down Jira

● Group of Product Owners

● Exploring

● What worked for them

● What didn’t work for them

Page 13: What is this exploratory testing thing

Report & Manage

Page 14: What is this exploratory testing thing

Session Based Test Management

Page 15: What is this exploratory testing thing

Session Based

Exp

lora

tory

Te

stin

g in

Ag

ile C

on

text -

Elis

ab

eth

Hen

dric

kso

n

Page 16: What is this exploratory testing thing

Session Based

Date/Time:

Mission:

Task:

Setup:

Data:

Notes:

Issues:

Thoughts:

The entire session report consists of

these sections:

• Session charter (includes a mission

statement, and areas to be tested)

• Tester name(s)

• Date and time started

• Task breakdown

• Data files

• Test notes

• Issues

• Bugs

http://www.satisfice.com/articles/sbtm.pdf

Page 17: What is this exploratory testing thing

Session

Example Session Sheet

CHARTER

-----------------------------------------------

Analyze MapMaker’s View menu functionality and

report on

areas of potential risk.

#AREAS

OS | Windows 2000

Menu | View

Strategy | Function Testing

Strategy | Functional Analysis

START

-----------------------------------------------

5/30/00 03:20 pm

TESTER

-----------------------------------------------

Jonathan Bach

TASK BREAKDOWN

-----------------------------------------------

TEST NOTES

-----------------------------------------------

I touched each of the menu items, below, but focused

mostly on zooming behavior with various

combinations of map elements displayed.

View: Welcome Screen

Navigator

Locator Map

Legend

Map Elements

Highway Levels

Street Levels

Airport Diagrams

BUGS

-----------------------------------------------

#BUG 1321

Zooming in makes you put in the CD 2 when you get

to a certain level of granularity (the street names level)

--

http

://ww

w.s

atis

fice

.com

/artic

les/s

btm

.pd

f

Page 18: What is this exploratory testing thing

Manage

Discipline Structure

FocusManageable

Planning

RepeatableEstimatable Time-box

Page 19: What is this exploratory testing thing

Tools

Page 20: What is this exploratory testing thing

Tools

Browser

- Add-ons

- Extensions

- Developer tools

Others

- Accessibility

- Security

- Debugging

- Automation

- Ide

- Infrastructure

Page 21: What is this exploratory testing thing

What is in it for you?

How does the team

benefit?● Learn

● Information

● Intelligence

Page 22: What is this exploratory testing thing

Information Flow

Page 23: What is this exploratory testing thing

Information Flow

Information

- Session reports

- Documents

- Coverage

- Unknowns - Knowns

- Augment automation

- Visual

- Charters/Missions

- Pair

Page 24: What is this exploratory testing thing

Challenges

What stops people being as productive as they

could be with Exploratory Testing?

Page 25: What is this exploratory testing thing

Challenges

How can we talk about the differences between

Scripted and Exploratory?

Page 26: What is this exploratory testing thing

Challenges

What are yours?

Page 27: What is this exploratory testing thing

Thank you

Tony Bruce Consulting Ltd

[email protected]

dancedwiththetester.blogspot.co.uk

@tonybruce77

Associate with

[email protected]