• How big is data now ?

• 5V

• Hadoop ecosystem

• Challenges

• Landscape

HOW BIG IS DATA NOW ?

EVERY 2

DAYS

EVERY 2 DAYS

WE CREATE AS MUCH

INFORMATION AS WE DID UP

TO 2003

IN THE DEVELOPED ECONOMIES OF EUROPE,

GOVERNMENT ADMINISTRATORS COULD SAVE MORE

THAN €100 BILLION ($149 BILLION) IN

OPERATIONAL EFFICIENCY IMPROVEMENTS ALONE BY USING BIG DATA

5V

VOLUME

VELOCITY

VARIETY• Text

• Picture, video

• Location

• Health

• …

VERACITY (TRUST)

volume

veracity

variety

velocityvalue

VALUE EXAMPLES

• 1.9 million IT jobs will be created in the US by 2015 to carry out big data projects

• Identify potential crime areas three times more accurately

• Healthcare industry could save $1,000 / person a year

HADOOP ECOSYSTEM

MAPREDUCE

GOOGLE FILE SYSTEM

HADOOP ECOSYSTEM

MACHINE LEARNING

CHALLENGES

• Making tools easier to use.  More mature software

• Getting quicker answers across large data sets

• Adoption

• Find other use cases than web log

LANDSCAPE

WHAT’S NEXT ?