Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente

Preview:

DESCRIPTION

Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente

Citation preview

Esteban MoroAlejandro Llorente

Analytics & Models

INNOVA CHALLENGE Taller 8 Octubre

① Introduction to cartographic data

② Getting Points of Interest

③ Extracting data from Innova Challenge API

④ Merging activity and cartography

⑤ Building a recommender system

⑥ From analytics to the app: RShiny

Index

Workshop30thOctober

Introduction to cartographic data in R

INNOVA CHALLENGE Taller 8 Octubre

Loading and filtering Shapefiles

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

plot(map) plot(mapMadrid)

Loading and filtering Shapefiles

Workshop30thOctober

Getting points of interest

INNOVA CHALLENGE Taller 8 Octubre

Google Points Of Interest

Parameters

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Google Points Of Interest

Obtaining places information

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Google Points Of Interest

Obtaining POI around Puerta del Sol and color them by type

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Google Points Of Interest

Using Google Maps as background

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Google Points Of Interest

Workshop30thOctober

Extracting data fromInnova Challenge API

INNOVA CHALLENGE Taller 8 Octubre

Connecting to the API

Parameters

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Extracting data

Connecting to the API

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Building the adjacency list

Connecting to the API

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Building and plotting the graph

Connecting to the API

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Connecting to the API

Workshop30thOctober

Merging activity andcartography

INNOVA CHALLENGE Taller 8 Octubre

Data + Cartography

Reading files

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Merging & plotting data and maps

Data + Cartography

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Data + Cartography

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Building our own polygons: a regular grid

Data + Cartography

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Data + Cartography

Workshop30thOctober

Building a recommender system

INNOVA CHALLENGE Taller 8 Octubre

Recommending by profile

?

????

???

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Getting data from the API

Recommending by profile

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Reading and preprocessing data

Recommending by profile

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Parameters

Result of preprocessing

Recommending by profile

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Recommending by profile

Recommendation map

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Recommending by profile

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Recommending by origin postal code

? ???

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Getting data from the API

Recommending by origin postal code

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Analogous data preprocessing and visualizing results

Recommending by origin postal code

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Combining classifiers

+

Geographic and demographic based recommender system

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Combining classifiers

Getting and merging recommendations

Workshop30thOctober

INNOVA CHALLENGE Taller 8 OctubreWorkshop

30thOctober

Combining classifiers

From analytics to the app:RShiny

INNOVA CHALLENGE Taller 8 Octubre

What’s RShiny

1 Web development framework with R.

2 Declarative user interface definition.

3 Server processing as servlets.

4 Agile prototyping.

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Installing Shiny

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Shiny project structure

ui.R: definition of user interface.• Layout• Plots• Control panels and filters• Tabs

server.R: definition of functions that generate the output to visualize in ui.R

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Our Goal

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Our Goal

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Our Goal

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

User interface definition

Requirements

1. Title of the application

2. Tabs to handle visualizations

3. Conditional panels

4. Filters: radio buttons, sliders and selectors

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

ui.R

Layout, title and beginning of the control panel

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Control panel definition

ui.R

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

Main panel definition

ui.R

Workshop30thOctober

Control panel definition

INNOVA CHALLENGE Taller 8 Octubre

server.R

Importing modules and first line

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

server.R

Output definitions

Workshop30thOctober

INNOVA CHALLENGE Taller 8 Octubre

And it works!

Recommender system

@estebanmoro esteban.moro@iic.uam.es@llorentealex alejandro.llorente@iic.uam.es

Workshop30thOctober

Recommended