21
1 The linked image cannot be displayed. The file may have been moved, renamed, or deleted. Verify that the link points to the correct file and location. Hadoop and the Future of Data Management Chris Poulos, VP Asia Pacific & Japan Gab Gennai , Technical Services Director – Asia Pacific & Japan

Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

Embed Size (px)

DESCRIPTION

Speaker: 1. Christopher Poulos | Vice President, Asia Pacific and Japan at Cloudera 2. Gab Gennai | Technical Services Director, Asia Pacific and Japan at Cloudera Introduction: With no doubt Apache Hadoop is leading the way in enterprise architecture, find out how easily it integrates with your existing hardware and software infrastructure.

Citation preview

Page 1: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

1"

The linked image cannot be displayed. The file may have been moved, renamed, or deleted. Verify that the link points to the correct file and location.

Hadoop"and"the"Future"of"Data"Management"Chris"Poulos,"VP"Asia"Pacific"&"Japan"Gab"Gennai","Technical"Services"Director"–"Asia"Pacific"&"Japan"

Page 2: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

2"

Data"PotenGal"is"Out"There"

2"

Page 3: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

3"

Cloudera"Quick"Facts"Founded "2008,"by"former"employees"of"Employees "Over"500"Global024x70Support "FollowQtheQsun"capability;"ProQacGve"&"PredicGve"Support"

Programs"Dedicated"Support"Engineers;"Support"Centers"in"NA,"Europe"&"Asia"

Professional0Services "World"class"services"delivery"teams"worldwide"Mission0Cri?cal "Thousands"of"enterprise"customers"rely"on"Cloudera"

50%"of"the"Fortune"50;"65%"of"the"Fortune"500"Top"Defense"&"Intelligence"Agencies"

The0Largest0Ecosystem "Over"900"Members"of"our"Partner"Program,"ClouderaConnect"Cloudera0University "Over"40,000"people"trained"around"the"world"Open0Source0Leaders "Cloudera"employees"are"founders"of"most"of"the"Apache"

Hadoop"ecosystem"projects,"and"leading"contributors"to"all"of"them"

Page 4: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

4"4

Leading"the"Way"in"Data"Management"Powered"by"Hadoop"20080CLOUDERA0FOUNDED0BY"MIKE"OLSON"AMR"AWADALLAH"&"JEFF"HAMMERBACHER"

20090HADOOP0CREATOR0

DOUG"CUTTING"JOINS"CLOUDERA"

20090CLOUDERA0RELEASES0CDH"THE"FIRST"COMMERCIAL""APACHE"HADOOP"DISTRIBUTION"

20100CLOUDERA0MANAGER:"FIRST"MANAGEMENT"

APPLICATION"FOR"HADOOP"

20110CLOUDERA0REACHES01000PRODUCTION0CUSTOMERS0

20110CLOUDERA0UNIVERSITY0

EXPANDS"TO"140"COUNTRIES"

20120CLOUDERA0ENTERPRISE040THE"STANDARD"FOR"HADOOP"IN"THE"ENTERPRISE"

20120CLOUDERA0CONNECT0

REACHES"300"PARTNERS"

20140THE0ENTERPRISE0DATA0HUB0LAUNCHED"

20130CLOUDERA0IMPALA0CLOUDERA0NAVIGATOR0CLOUDERA0SEARCH""

20130TOM0REILLY0JOINS0AS0CEO0

OVER"800"PARTNERS""IN"CLOUDERA"CONNECT"

CDH Cloudera Manager

CLOUDERA0ENTERPRISE0

40

ASK0BIGGER0QUESTIONS0

ENTERPRISE0DATA0HUB0

Page 5: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

5"5"

Global"Presence"

San"Francisco,"CA"

Chennai,"India"

Tokyo"Palo"Alto,"CA" RTP,"NC"

Boston"New"York"

AusGn,"TX"

San"Francisco,"CA"Studgart"

Support"Center"Support"Presence"

Seadle,"WA"London"

Louisville,"KY"

Melbourne"

Page 6: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

6"

Our0Mission0Help"OrganizaGons"Gain"Value"from"All"Their"Data"

Solve"data"problems."Solve"problems"with"data."

Ask0Bigger0Ques?ons.0

Page 7: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

7"

Our0Approach0Empower"the"DataQDriven"Enterprise"

SoYware0The"Plahorm"for"Big"Data"

Services0

Training0

Page 8: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

8"8"

Page 9: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

9"9"

Page 10: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

10"10"

Page 11: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

11"11"

Page 12: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

12"12"

Page 13: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

13"

Informa?on0Driven0

13"

All"of"these"organizaGons"are"

Page 14: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

14"

Informa?on0Driven0

14"

All"of"these"organizaGons"needed"to"change"to"become"

Page 15: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

15"

Expanding"Data"Requires"A"New"Approach"

©2014"Cloudera,"Inc."All"rights"reserved."15"

1980s0Bring"Data"to"Compute"

Now0Bring"Compute"to"Data"

Rela?ve0size0&0complexity0

Data0Informa?on]centric0

businesses0use0all#data:000

MulGQstructured,""internal"&"external"data""

of"all"types"

Compute0

Compute0

Compute0

Process]centric00businesses0use:0

0

• Structured"data"mainly"•  Internal"data"only"

• “Important”"data"only"""

Compute0

Compute0

Compute0

Data0

Data0

Data0

Data0

Page 16: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

16"

The"Old"Way:"Bringing"Data"to"Compute"

©2014"Cloudera,"Inc."All"rights"reserved."16"

Complex0Architecture0•  Many"specialQpurpose"

systems"•  Moving"data"around"•  No"complete"views"

Missing0Data0•  Leaving"data"behind"•  Risk"and"compliance"•  High"cost"of"storage"

Time0to0Data0•  UpQfront"modeling"•  Transforms"slow"•  Transforms"lose"data"

Cost0of0Analy?cs0•  ExisGng"systems"strained"•  No"agility"•  “BI"backlog”"

4"

1"

2"

3"

SERVERS"MARTS"EDWS" DOCUMENTS" STORAGE" SEARCH" ARCHIVE"

ERP,"CRM,"RDBMS,"MACHINES" FILES,"IMAGES,"VIDEOS,"LOGS,"CLICKSTREAMS" EXTERNAL"DATA"SOURCES"

Page 17: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

17"

From"Hadoop"to"an"Enterprise"Data"Hub"

©2014"Cloudera,"Inc."All"rights"reserved."17"

Open0Source0Scalable0Flexible0Cost]Effec?ve0

✔"

Managed0 ✖"Open0Architecture0 ✖"Secure0and0Governed0 ✖"

✔"

✔"

✔"

3RD"PARTY"APPS"

STORAGE"FOR"ANY"TYPE"OF"DATA"UNIFIED,"ELASTIC,"RESILIENT,"SECURE"

"""""

CLOUDERA’S0ENTERPRISE0DATA0HUB0

BATCH"PROCESSING"

MAPREDUCE0

ANALYTIC"SQL"

IMPALA0

SEARCH"ENGINE"

SOLR0

MACHINE"LEARNING"

SPARK0

STREAM"PROCESSING"SPARK0STREAMING0

WORKLOAD"MANAGEMENT" YARN0

FILESYSTEM"HDFS0

ONLINE"NOSQL"HBASE0

DATA"MAN

AGEMEN

T"CLO

UDERA0N

AVIGATO

R0

SYSTEM"

MAN

AGEMEN

T"CLO

UDERA0M

ANAG

ER0

SENTRY0,"SECURE"

Page 18: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

18"18"

Page 19: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

19"

SERVERS" MARTS" EDWS" DOCUMENTS" STORAGE" SEARCH" ARCHIVE"

ERP,"CRM,"RDBMS,"MACHINES" FILES,"IMAGES,"VIDEOS,"LOGS,"CLICKSTREAMS" ESTERNAL"DATA"SOURCES"

©2014"Cloudera,"Inc."All"rights"reserved."

Diverse0Analy?c0Plaaorm0•  Bring"applicaGons"to"data"•  Combine"different"workloads"on""

common"data"(i.e."SQL"+"Search)"•  True#analy,c#agility#

4"

1"

2"

3" 4"

The"New"Way:"Bringing"Compute"to"Data"

19"

Ac?ve0Compliance0Archive0•  Full"fidelity"original"data"•  Indefinite"Gme,"any"source"•  Lowest#cost#storage#

1"

Persistent0Staging0•  One"source"of"data"for"all"analyGcs"•  Persist"state"of"transformed"data"•  Significantly#faster#&#cheaper#

2"

Self]Service0Exploratory0BI0•  Simple"search"+"BI"tools"•  “Schema"on"read”"agility"•  Reduce#BI#user#backlog#requests#

3"

Page 20: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

20"

Data0Science0Explora?on0ETL0Accelera?on0

Opera?onal0Efficiency0 Informa?on0Advantage0

Cheap0Storage0

Business0""""""""""""IT0

Your"Journey"to"Achieve"Full"PotenGal"

©2014"Cloudera,"Inc."All"Rights"Reserved."

EDW0Op?miza?on0

Consolida?on0360°0View0

Advance0from0Strategy0to0ROI0with0Best0Prac?ces0and0Peak0Performance0

Page 21: Big Data Taiwan 2014 Keynote 2: Hadoop and the Future of Data Management

21"

Thank"you!"[email protected]"[email protected]"

21"