37
Liz Keogh @lunivore

How to test the inside of your head

Embed Size (px)

DESCRIPTION

Selenium Conference keynote on cognitive bias, testing and Martians.

Citation preview

Page 1: How to test the inside of your head

Liz Keogh

@lunivore

Page 2: How to test the inside of your head

A story because we all love

sleeping

Page 3: How to test the inside of your head

Observe data

Filter data

Generate assumptions

Draw conclusions

Build beliefs

Page 4: How to test the inside of your head
Page 5: How to test the inside of your head

Cydonia, Viking 1, 1976

Page 6: How to test the inside of your head

Cydonia, Viking 1, 1976

Page 7: How to test the inside of your head
Page 8: How to test the inside of your head
Page 9: How to test the inside of your head
Page 10: How to test the inside of your head
Page 11: How to test the inside of your head

Scenarios

Given a context

When an event happens

Then an outcome should occur

Page 12: How to test the inside of your head

Examples

Given Fred has bought a microwave

And the microwave cost £100

When we refund the microwave

Then Fred should be refunded £100.

Page 13: How to test the inside of your head

Is there a context in which this event will create a different outcome?

Context Questioning

Page 14: How to test the inside of your head

Cydonia, Mars Reconnaisance Orbiter, 2006

Page 15: How to test the inside of your head

Martian channels by Percival Lowell

Page 16: How to test the inside of your head

Confirmation Bias

Think we’re right

Look for validation Feel really good!

Page 17: How to test the inside of your head

Confirmation Bias

Think we’re right

Find out we’re not Boo!

Page 18: How to test the inside of your head

Google effect

Apophenia Pareidolia

Confirmation Bias

Actor-Observer

Bias

Illusion of Control

Insensitivity to sample

size

Omission bias

Negativity bias

Naïve cynicism

Fundamental Attribution

Error

System justification

Worse-than-average effect

Illusion of transparency

Trait ascryption

bias

Cryptomnesia

Choice-supportive

bias Forer effect

Normalcy bias

Bandwagon effect

Decoy effect

Hyperbolic discounting

Restraint bias

Stereotyping

Distinction bias

Pseudocertainty effect

Pessimism bias

Optimism bias

Moral luck

False consensus

effect

Anchoring

Congruence bias

Overconfidence effect

Loss Aversion

159 Cognitive Biases on Wikipedia

Page 19: How to test the inside of your head

Observe data

Filter data

Generate assumptions

Draw conclusions

Build beliefs

Page 20: How to test the inside of your head
Page 21: How to test the inside of your head

Scenarios

Given a context

When an event happens

Then an outcome should occur

Page 22: How to test the inside of your head

Traditional

Rework

Developers Testers

Deliberate Discovery skills

Page 23: How to test the inside of your head

Behavior Driven Development

Less Rework

Developers Testers

Deliberate Discovery skills

Testers

Page 24: How to test the inside of your head

Is there a context in which this event will create a different outcome?

Context Questioning

Page 25: How to test the inside of your head

Is this the only outcome that matters?

Outcome Questioning

Page 26: How to test the inside of your head

Options have value.

Options expire.

Never commit early unless you know why.

Page 27: How to test the inside of your head

The Huddle

Developer

Page 28: How to test the inside of your head
Page 29: How to test the inside of your head

Is there a different context which might have produced

this outcome?

Assumption Questioning

Page 30: How to test the inside of your head
Page 31: How to test the inside of your head
Page 32: How to test the inside of your head
Page 33: How to test the inside of your head

“Nobody loves me.”

Page 34: How to test the inside of your head
Page 35: How to test the inside of your head
Page 36: How to test the inside of your head

A story because we all love

sleeping

Page 37: How to test the inside of your head

Liz Keogh [email protected] @lunivore