Visualizing Big Data In Drupal Using Data Visualizations to Drive Knowledge Discovery David Hazel - [email protected] Assistant Director - Center for Web and

Visualizing Big Data In Drupal Using Data Visualizations to Drive Knowledge Discovery

David Hazel - [email protected]

Assistant Director - Center for Web and Data Science

Brad Porter - [email protected]

Undergrad. Research Assist. - Center for Web and Data Science

PNWDS - 2012 University of Washington, Tacoma

10/21/2012 UW Tacoma / WebDataScience.org

• Consistent Look and Feel• Content Management• Modules• Secure and Solid Code Base• Great Community

Why We Use Drupal?


• HTML5• Slick UI• Fast Query Management• Explore Really Big Data• SCALE

But...I want


So...We turn To


django


RoR




• Tradeoffs• Drupal vs Custom

The Problem


World of BIG DATA

PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012

• Really large data sets• Complex queries• Inconsistent load times• Visualize Data in meaningful ways

Some Real World Examples


• DDRS• CHF Risk of Readmission• Adoptopedia

Dietary Data Recording System


CHF Risk of Readmission


• No reimbursement for readmission within 30 days

• Examine Factors that Contribute to Readmission

• Better Care• Reduced Costs

Adoptopedia


What do all these have in common




OSPI Data Dashboard Project


Center for Web and Data ScienceCenter for Strong Communities & Schools

OSPIState Needs Projects

Lots of Data


• 10 Sites across WA State• 100's of Trainings

• Homemade survey systemo MySQL database (LAMP)o How to merge data

Seemingly missing data Hardcoded modifications

Data + Challenges


• Drupal surveyso Separate PostgreSQL databaseo Webform module

Lacking queue system

Data + Challenges Cont.


Data Flow


Standardized questions integrated into Webform

Drive visualizations

Import into external datamart

Visualizing the Data


• Custom modules• pull data from External Datamart• Load JSON into Browser• Visualize the Data

wds_viz.module


Why D3.js?


• Transitioning From Flasho Printer Compatibilityo No plugins necessary

• Image Embeddingo Lower Bandwidtho Dynamic Graphs

Pie Chart


Choropleth


Bar Graph


Parallel Coordinates


Implementation / Integration


• Under 40 lines of code

• Completely customizable







• Map is Drawn• Plot svg circles• Calculate x,y = long/lat• Set color palette based on count• Set r = 0• Time series change r

Heat map Constructions


• Heatmap transition• function changeHeat()

CODE DEMO


Vision: To be the Rosetta Stone for Societal Big Data

Center for Web and Data Science

Q&A


Documents

Visualizing Big Data In Drupal Using Data Visualizations to Drive Knowledge Discovery David Hazel - [email protected] Assistant Director - Center for Web and