Beyond Data Discovery: The Value Unlocked by Modern Data Modeling

Preview:

Citation preview

Beyond Data Discovery The Value Unlocked by Modern Data Modeling

November 5, 2015

Presented by

— This webinar will be recorded

— We will take questions at the end

Welcome & Webinar Overview

Zach TaylorProduct Manager

Talal AssirSenior Data Analyst

Meet our presenters

Data Modeling

Transforming data into understanding

is hard

Agenda

11 Concepts

2 Live Modeling

3 NYC Taxi Cab Data

Less on this...

More on this...

Traditional Approach

Restricted Q&AELT - Heavy Transformation

END USERBI TEAMETL TEAM EDW TEAM

A B

?C

I

G

J

M

H

N

F

L

D

K

Q

BZ C

P

E

R

S

Q

F

X

EB

Z

A

X

EVENT DATA

TRANSACTIONAL DATA

OLAP / Data Summaries

SUMMARY

Build Incrementally

Reusability

Content Creator

Model Builder

Consumer Complexity Tradeoff

● Get it to people quickly

● Crowdsource

● Have a shared view

Enable Learning

The Alternative

● Feedback loop is broken

● Data brawls

● Reusability is lost

● Modular

● Interconnected

● Light architecture

Fast Iteration Cycles

Fast Iteration Cycles

Make Change Easy

measure: daily_usage_minutessql: SUM(daily_usage.approximate_usage_in_minutes)

measure: approximate_usage_in_minutestype: sumsql: ${TABLE}.approximate_usage_in_minutes

dimension: license_health sql: | CASE WHEN ${approximate_usage_in_minutes} = 0 THEN 0 ELSE ( (CASE WHEN ${approximate_usage_in_minutes} < 400 THEN 0 WHEN ${approximate_usage_in_minutes} < 1000 THEN 10 ELSE 25 END)

1

3

2

Build a Model

Check out NYC Taxi data

Building a Model

TripDriver IDPickup TimeDropoff TimeFare Amount

Building a Model

TripDriver IDPickup TimeDropoff TimeFare Amount

Next Pickup TimeIdle DistanceIdle Time

Building a Model

TripDriver IDPickup TimeDropoff TimeFare Amount

Next Pickup TimeIdle DistanceIdle Time

ShiftStart TimeEnd TimeUtilization

Building a Model

TripDriver IDPickup TimeDropoff TimeFare Amount

Next Pickup TimeIdle DistanceIdle Time

ShiftStart TimeEnd TimeUtilization

DriverDriver IDLifetime tripsAverage shift lengthAverage trips/shift

Q & A

Thank you

• This webinar will be posted on looker.com tomorrow.

Thank you

Recommended