54
@cyetain LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT

LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

Embed Size (px)

DESCRIPTION

A3, PDCA and the Build Measure Learn loop (to name a few loops) are all informed by experimentation. Kanban embraces the scientific method explicitly; "Improve Collaboratively (using models & the scientific method)" and Lean implementations can be more effectively supported by a sound understanding of the philosophy of science and proper experimental design. This presentation will briefly explore the basics of the scientific method, including deductive, inductive and abductive logic, probability, parsimony, and hypothesis testing. Through a series of group exercises, the audience will grapple with the concepts and return home ready to create an execute their first scientific experiment.

Citation preview

Page 1: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

LEARN LIKE A SCIENTIST:

YOUR FIRST EXPERIMENT

Page 2: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

blog http://jabe.coSend Anonymous Feedback

http://sayat.me/jabebloom

Joshua (Jabe) Bloom

&CTO:

Page 3: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

#lkce13@cyetain

Page 4: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Page 5: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Qualities and Assumptions of

Science

Page 6: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Demarcation

Pseudoscience Scientism

Page 7: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

If It Is Scientific, You Can Show Me How You Did It and We Can See

If I can Repeat It.

Page 8: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Wherever possible there must be independent confirmation of the facts. !Encourage substantive debate on the evidence by knowledgeable proponents of all points

of view. !Arguments from authority carry little weight (in science there are no "authorities"). !

Spin more than one hypothesis - don't simply run with the first idea that caught your fancy. !

Try not to get overly attached to a hypothesis just because it's yours. !Quantify, wherever possible. !

If there is a chain of argument every link in the chain must work. !Occam's razor - if there are two hypotheses that explain the data equally well choose

the simpler. !Ask whether the hypothesis can, at least in principle, be falsified (shown to be false by

some unambiguous test). In other words, it is testable? Can others duplicate the experiment and get the same result?

Baloney Detection Kit

http://jabe.co/BaloneyKitCarl Sagan

Page 9: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Criteria of

Truth

Page 10: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Lousy Criteria

Authority Custom

Emotions Naïve Realism

Page 11: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

The truths science attempts to reveal about atoms and the solar system and even

about microbes and bacteria would still be true even if human beings had

never existed !-Anthony O'Hear

Page 12: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Veritas est adaequatio rei et intellectus

A judgment is said to be true when it conforms to the external reality

!

-Thomas Aquinas

Page 13: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

[Abduction] goes upon the hope that there is sufficient affinity between the reasoner's mind and nature's to render

guessing not altogether hopeless, provided each guess is checked by

comparison with observation... The effort should therefore be to make each

hypothesis... as near an even bet as possible.

-Charles Peirce

Page 14: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

That's the whole point to the Scientific Method. It can never actually verify truth, but it can

show what is not true. !

-Jim Haines

Page 15: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

that which does not work is not true

!

-William Ernest Hocking

Page 16: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain@cyetain

Fallibility

Page 17: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Pieces of behaviour, beliefs, arguments, policies, and other

exercises of the human mind may all be described as rational. To accept something as rational is to accept it as making sense, as appropriate, or

required, or in accordance with some acknowledged goal, such as aiming

at truth or aiming at the good -Blackburn

Rationality

Page 18: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Page 19: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain@cyetain

Abductionnot just for

Aliens

@cyetain

Page 20: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

ABDUCE

DEDUCE

INDUCE

Predictive

Probable

Plausible

The Way

Computers "Think"

The Way

Humans Think

Binary

Probability

Analogue

Justifiable

Page 21: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Parsimony

Occam’s Razor

Page 22: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Page 23: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Inspiration Exploration

Testing Collaboration Exploitation

Page 24: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Inspiration

New Technology, New Problems, Personal Practice, Managed

Serendipity !

Surprise

Page 25: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

ExplorationObservations,

Research, Questioning, Collaboration

Page 26: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Testing

Hypothesis Generation, Defining

Expectation, Experimentation

Page 27: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Collaboration

Explanation, Conversation, Interpretation,

Challenging, Peer Reviewing, Repeating/

Validating

Page 28: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Exploitation

$$, Solve Problems, Make the World Better,

Delight Customers

Page 29: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Scientific examination arises out of, and is

dependent upon, a previous, or an ontologically prior

praxis context. -Ihde

Page 30: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Exploitation

Collaboration

Testing

Exploration

Inspiration

Page 31: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

What Do Knowledge Workers

Use Science For?

Page 32: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Scientific Realism vs

Instrumentalism

Page 33: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Pragmatic Economic

Instrumentalist

Page 34: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Page 35: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Guess -> Knowledge !

Knowledge to Profit !

Canaries

Page 36: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Improve collaboratively, evolve experimentally, using

models and the scientific method

Page 37: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

The link between objective truth and inter-subjective agreement is so strong that the former is difficult to defend when the latter

fails. !-Hugh G. Gauch, Jr

Page 38: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Your First Experiments

Page 39: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

SAFETY RULES

Page 40: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Safe-To-Fail

First Don’t Do (too much) Harm

Page 41: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Turn Commitments into Options

(bring a rope)

Page 42: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

There is no surer way to screw up an experiment

than to be certain of its outcome.

!

-Stuart Firestein

Page 43: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain@cyetain

ABDUCE

DEDUCE

INDUCE

Experiences Hypothesises

ExpectedOutcomes

If Coherent

If Expected Outcomes Match Reality

EffectiveMatch

Page 44: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Build

Learn Measure

Page 45: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Build

Learn Measure

Page 46: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

LeanUX New Product Dev

Page 47: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Problem Hypothesis

Page 48: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Problem Hypothesis

CustomerHypothesis

Page 49: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Problem Hypothesis

CustomerHypothesis

SolutionHypothesis

Page 50: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Problem Hypothesis

CustomerHypothesis

SolutionHypothesis

WHY?

Assumptions Assumptions

Assumptions

Page 51: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Which of these Assumptions MUST be True for my model to

be coherent?

Page 52: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

How can I invalidate these

assumptions?

Page 53: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Write Down What You Think Will Happen BEFORE You DO It.

!

Show it to your peers. !

Honestly PUBLICLY Examine Your Results

Page 54: LEARN LIKE A SCIENTIST: YOUR FIRST EXPERIMENT (JABE BLOOM) - LKCE13

@cyetain

Joshua (Jabe) Bloom CTO : The Library Corporation

& TLC Labs http://tlclabs.co

blog http://blog.jabebloom.com !!

Send Anonymous Feedback http://sayat.me/jabebloom