60
Jeffrey Heer @jeffrey_heer Univ. of Washington + Trifacta Visualization for DISCOVERY

DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Jeffrey Heer @jeffrey_heer Univ. of Washington + Trifacta

Visualization for DISCOVERY

Page 2: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species

Page 3: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 4: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 5: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Which antibiotic should one use?

Page 6: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Show data variation, not design variation.

- Edward Tufte

Page 7: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Aerobacter aerogenes

Brucella abortus

Bacillus anthracis

Diplococcus pneumoniae

Escherichia coli

Klebsiella pneumoniaeMycobacterium tuberculosis

Proteus vulgaris

Pseudomonas aeruginosa

Salmonella typhosa

Salmonella schottmuelleri

Staphylococcus albus

Staphylococcus aureus

Streptococcus fecalis

Streptococcus hemolyticus

Streptococcus viridans

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Wainer & Lysen Am. Sci. 2009

Page 8: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Aerobacter aerogenes

Brucella abortus

Bacillus anthracis

Diplococcus pneumoniae

Escherichia coli

Klebsiella pneumoniaeMycobacterium tuberculosis

Proteus vulgaris

Pseudomonas aeruginosa

Salmonella typhosa

Salmonella schottmuelleri

Staphylococcus albus

Staphylococcus aureus

Streptococcus fecalis

Streptococcus hemolyticus

Streptococcus viridans

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Wainer & Lysen Am. Sci. 2009

What does antibiotic response reveal about the

biology of bacteria?

Page 9: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Aerobacter aerogenes

Brucella abortus

Bacillus anthracis

Diplococcus pneumoniae

Escherichia coli

Klebsiella pneumoniaeMycobacterium tuberculosis

Proteus vulgaris

Pseudomonas aeruginosa

Salmonella typhosa

Salmonella schottmuelleri

Staphylococcus albus

Staphylococcus aureus

Streptococcus fecalis

Streptococcus hemolyticus

Streptococcus viridans

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Wainer & Lysen Am. Sci. 2009

Page 10: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Aerobacter aerogenes

Brucella abortus

Bacillus anthracis

Diplococcus pneumoniae

Escherichia coli

Klebsiella pneumoniaeMycobacterium tuberculosis

Proteus vulgaris

Pseudomonas aeruginosa

Salmonella typhosa

Salmonella schottmuelleri

Staphylococcus albus

Staphylococcus aureus

Streptococcus fecalis

Streptococcus hemolyticus

Streptococcus viridans

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Wainer & Lysen Am. Sci. 2009

?

?

Page 11: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Aerobacter aerogenes

Brucella abortus

Bacillus anthracis

Diplococcus pneumoniae

Escherichia coli

Klebsiella pneumoniaeMycobacterium tuberculosis

Proteus vulgaris

Pseudomonas aeruginosa

Salmonella typhosa

Salmonella schottmuelleri

Staphylococcus albus

Staphylococcus aureus

Streptococcus fecalis

Streptococcus hemolyticus

Streptococcus viridans

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Wainer & Lysen Am. Sci. 2009

Not a streptococcus!

Actually a streptococcus!

Page 12: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

How might our tools spur new questions and

prompt skepticism?

Page 13: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 14: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 15: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

0 10 20 30 40

Neomycin

0

200

400

600

800

Penicillin

Page 16: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

0.001 0.01 0.1 1 10 100

Log10(Neomycin)

0.001

0.01

0.1

1

10

100

1,000Lo

g10(Pe

nicillin)

Page 17: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

0.0010.010.1110100

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

Page 18: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

Page 19: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusAerobacterBrucellaBacillusDiplococcusEscherichiaKlebsiellaMycobacteriumProteusPseudomonasSalmonellaStaphylococcusStreptococcus

Page 20: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Page 21: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Aerobacter aerogenes

Brucella abortus

Bacillus anthracis

Diplococcus pneumoniae

Escherichia coli

Klebsiella pneumoniaeMycobacterium tuberculosis

Proteus vulgaris

Pseudomonas aeruginosa

Salmonella typhosa

Salmonella schottmuelleri

Staphylococcus albus

Staphylococcus aureus

Streptococcus fecalis

Streptococcus hemolyticus

Streptococcus viridans

0.0010.010.11101001,000

Log10(1 / Neomycin)

0.001

0.01

0.1

1

10

100

1,000

Log1

0(1

/ Pen

icill

in)

GenusStreptococcus

Staphylococcus

Salmonella

Other

Page 22: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

A Combinatorial Design Space

Page 23: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Variable Selection

A Combinatorial Design Space

Page 24: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Variable Selection

2. Data Transformation

A Combinatorial Design Space

Page 25: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Variable Selection

2. Data Transformation

3. Visual Encoding Design

A Combinatorial Design Space

Page 26: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Variable Selection

2. Data Transformation

3. Visual Encoding Design

—> Thousands of possible charts!

A Combinatorial Design Space

Page 27: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

How might we augment manual chart construction

with interactive browsing of recommended visualizations?

Page 28: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 29: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

ggplot(diamonds, aes(x=price, fill=cut))+ geom_bar(position="dodge")

Page 30: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 31: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Trifacta Visual Profiler

2. Data Voyager (UW + Tableau)

Page 32: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Trifacta Visual Profiler

2. Data Voyager (UW + Tableau)

Page 33: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 34: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

OverviewOverview

Trifacta Visual Profiler

Page 35: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

DetailsDetails

Trifacta Visual Profiler

Page 36: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 37: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 38: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 39: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 40: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 41: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Trifacta Visual Profiler

Page 42: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

1. Trifacta Visual Profiler

2. Data Voyager (UW + Tableau)

Page 43: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 44: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

User

Page 45: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

User

Data Set

Page 46: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Compass Recommendation Engine

Data Schema & Statistics

User

Page 47: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Compass Recommendation Engine

Data Schema & Statistics

User

1. Select data variables 2. Apply transformations 3. Pick visual encodings

Page 48: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Compass Recommendation Engine

Data Schema & Statistics

User

Constrain & rank choices by data type, statistics & perceptual principles.

Page 49: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Data Schema & Statistics

Ranked and Clustered Vega-lite Specifications

User

Compass Recommendation Engine

Page 50: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Compass Recommendation Engine

Vega-lite Compiler

Vega-lite Specifications

Ranked and Clustered Vega-lite Specifications

User

Data Schema & Statistics

Page 51: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Compass Recommendation Engine

Vega Renderer

Vega-lite Compiler

Vega-lite Specifications

VegaSpecifications

Ranked and Clustered Vega-lite Specifications

User

Data Schema & Statistics

Page 52: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Compass Recommendation Engine

Vega Renderer

Interactive Visualizations

Vega-lite Specifications

VegaSpecifications

Ranked and Clustered Vega-lite Specifications

User

Data Schema & Statistics

Vega-lite Compiler

Page 53: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Interactive Visualizations

Compass Recommendation Engine

Vega Renderer

Interactive Visualizations

Vega-lite Specifications

VegaSpecifications

Ranked and Clustered Vega-lite Specifications

User

Data Schema & Statistics

Vega-lite Compiler

Page 54: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Interactive Visualizations

User Selection

Compass Recommendation Engine

Vega Renderer

Interactive Visualizations

Vega-lite Specifications

VegaSpecifications

User Selection, Data Schema

& Statistics

Ranked and Clustered Vega-lite Specifications

User

Vega-lite Compiler

Page 55: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Voyager Visualization Browser

Interactive Visualizations

User Selection

Compass Recommendation Engine

Vega Renderer

Interactive Visualizations

Vega-lite Specifications

VegaSpecifications

User Selection, Data Schema

& Statistics

Ranked and Clustered Vega-lite Specifications

User

Improves data coverage! +3x variable sets shown +1.5x more interacted with

Vega-lite Compiler

Page 56: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Refining visualization recommendation What to optimize? How to evaluate?

Scaling interactive visualizations Large D harder than large N…

Help avoid statistical pitfalls Recognize mix effects, convey uncertainty

Ongoing Challenges

Page 57: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

How might our tools spur new questions and

prompt skepticism?

Page 58: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not
Page 59: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

vega.github.io

Page 60: DISCOVERY - visualdatascience.org · DISCOVERY. Effectiveness of Penicillin, Neomycin & Streptomycin vs. Bacteria Species. Which antibiotic should one use? Show data variation, not

Jeffrey Heer @jeffrey_heer Univ. of Washington + Trifacta

Visualization for DISCOVERY