Embed Size (px)
Citation preview
MAKING BIG DATA COME ALIVE
The Path to Operationalized Analytics in the Enterprise
Sandipan Chakraborty Japan Managing Partner, Think Big, A Teradata Company, [email protected]
2
Think Big History
NDA CONFIDENTIAL
1st Solutions provider 100% focused around open source, cloud and the Apache Hadoop ecosystem
• Founded in 2010 • Acquired by Teradata in 2014 • 150+ Successful Programs & 100+ Clients • Vendor-neutral open source integration expertise • Agile team-based development methodology • Global delivery model: onsite, near shore & off shore • Think Big Academy for skills & organizational development
Think Big helps organizations unlock the value of big data through combining data science and engineering services with it’s industry leading Velocity model.
Kafka
© 2016 Think Big, A Teradata Company
3
Foundation for Enterprise Analytics
16/11/14 © 2016 Think Big, a Teradata Company
Analytics Ops
Data Democratization
Industrial Data Lake
4
Industrial Data Lake
16/11/14
DEFINE Analyst
GOVERN Data Steward
DISCOVER Data Scientist
MANAGE Operations
16/11/14
APIs/Core
Metadata Repository
Data Processing
Public Cloud On-premise
5
Industrial Data Lake: Kylo w/Spark & NiFi
Pipeline Data Ingest & Design • UI-guided feed creation • Drag-&-drop pipe design • Data connectors • Data lineage • Data pipeline loading • Data validation • Technical metadata capture
Self Service & Data Wrangling • Visual SQL builder • 100+ transform functions • Data analyst-friendly • Data cleanse • Data protection • Publish and schedule • Powered by Apache Spark
Data Discovery • Data discovery • Google-like searching • Extensible metadata • Data profile • Data sampling
Operations & Dashboard • Dashboard • Health monitoring • Data confidence • SLA enforcement alerts • Performance reports
© 2016 Think Big, A Teradata Company
6
Kylo: Data Democratization
16/11/14 © 2016 Think Big, a Teradata Company
Kylo demo: booth 5
7
Analytics Ops
16/11/14 © 2016 Think Big, a Teradata Company
Constant Monitoring
Test and Deploy-
ment
A/B Testing Automated Training &
Scoring
Application Integration
8
Analytics Ops
16/11/14 © 2016 Think Big, a Teradata Company
Framework Demo: booth 5
9
Data-Driven Enterprise… at Scale!
16/11/14 © 2016 Think Big, a Teradata Company
Analytics Ops
Data Democratization
Industrial Data Lake
10
Think Big Velocity Services Portfolio Think Big, Start Smart, Scale Fast
16/11/14 VELOCITY = SPEED + DIRECTION
© 2016 Think Big, A Teradata Company
Training & Mentoring
Architecture & Roadmap
Data Lake Analytics Ops
Data Science Managed Services
RA
CE
11 11 16/11/14 © 2016 Think Big, A Teradata Company
