BIG DATA ANALYTICS

Asst. Prof. Natawut Nupairoj, Ph.D.

Head of Department

Department of Computing Engineering

Chulalongkorn University

natawut.n@chula.ac.th

https://natawutn.wordpress.com

Data is a new class of economic asset, like currency and gold - World Economic Forum

BIG DATA

Source: IBM

..

BIG DATA

40,000+ = 500+Wifi + NAT

Log

90 = 39,000,000,000 events (6.5TB)

Internal External

Structured Unstructured

USHAHIDI2007

Kenya

2010

Haiti

Chile

Washington DC

Russia

2011

Christchurch

Middle East

India

Japan

Australia

US

Macedonia

2012

Balkans

2014Kenya

BIG DATA ARCHITECTURE

Data Source

Data Source

Data Source

Data Source

Data

Ingestion

Fast Data Path

Big Data Path

Data Stream Processors

Data Lake

(Landing Zone)

Data Refinery /

Data Analytics

Da

ta V

isu

aliz

atio

n

Traditional Data Warehouse / Reporting tools

NOSQL

Python R

Data Science

(Data Analytics)

Data Engineering

(Big Data)

( )

GPS

VDO Streaming /

:

?

?

?

DATA ANALYTICS

DATA VALUE CHAIN

Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/

DATA VALUE CHAIN

Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/

Data Engineering

Data Science

DATA VALUE CHAIN IT LOG

Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/

Data Engineering

Data Science

BIG DATA Bigger / Faster / More Up-to-Date Data Warehouse

Social Listening / Crowdsourcing

Workforce Planning / Economics Planning

Smart Education

Precision Agricultural / Resource Management

Preventive Healthcare

Fraud Detection (e.g. Tax, Social Security, etc.)

Video Analytics / Satellite Image Analytics

Real-Time Data Warehouse

Data Driven Organization