The Digital Enterprise Demands a Modern

Integration Approach

Nada daVeiga, Sr. Dir. of Technical SalesTony LaVasseur, Territory Leader

Yesterday’s approach to data and application

integration is a barrier to becoming an agile

connected enterprise…CSV

Forces Decreasing IT

Responsiveness

• “Technical Debt”

• Growing IT Skills Gap

• Outmoded Operating Model

Forces Increasing Business

Needs & Expectations

• Rate of business change

• Growing Consumerism

• Easy access to SaaS

IT

Business

The Digital Divide

Source: PWC

Common Barriers to Big Data Adoption

Common barriers to big data

adoption:

Skills shortages

Integrating multiple data sources

Connecting big data technology

with existing infrastructure

“Survey Analysis: Big Data Investment Grows But

Deployments Remain Scarce in 2014,” Nick Heudecker

& Lisa Kart, Gartner, 2014.

Hybrid cloud and on-premises

application environments:• Create data silos

• Increase integration complexity

Explosion of Big Data brings:• New opportunities for insights

• New data integration and

management challenges

Source: Forrester Research, Inc. All rights reserved.

Why Not Traditional Or Open Source ETL/ESB

Tools?

• Costly hardware/software required

• Inability to handle unstructured data

• Manual processes require expert coders or consultants

• Not designed for cloud applications

• Long lead times to handle new/changed sources

Hybrid Enterprise Demands New Approach

• Investors: Andreessen Horowitz & Ignition Partners, Microsoft

• Customers: Adobe, Acxiom, ADP, AstraZeneca, Blackberry, BMS, Box, Cisco,

CapitalOne, Cognizant, Danone, Fox Sports, GameStop, GE, HP, Humana,

IDG, iRobot, RocketFuel, SANS, Target, Yelp, Uber, Verizon, Xactly, Yahoo!

• Partners: Cloudera, Hortonworks, MapR, Workday, Amazon, Google,

Microsoft, PwC, Accenture, Cognizant, HCL, TCS

The dilemma for enterprise IT organizations is that their legacy integration

technologies were built before the era of big data, social, mobile and cloud

computing and simply can’t keep up.

- Gaurav Dhillon, founder and CEO, SnapLogic

SnapLogic: Connect Faster

SnapLogic helps enterprises

connect data and

applications faster

Anything

Data | Apps | APIs | Things

Anytime

Batch | Streaming | Real-time

Anywhere

On premises | In the cloud

SnapLogic: Connect Faster

Reduce total cost of ownership

Do more, faster

Future-proof IT environment

Support business agility

SnapLogic helps enterprises

connect data and

applications faster

Anything

Data | Apps | APIs | Things

Anytime

Batch | Streaming | Real-time

Anywhere

On premises | In the cloud

SnapLogic in the Modern Data Fabric

Co

nsu

me

Sto

re &

Pro

cess

Sou

rce

z z z z

HANA

Data Warehouses & Data Marts Big Data and Data Lakes

INGEST INGEST

Data Integration and Transformation

On PremApplications

RelationalDatabases

CloudApplications

NoSQLDatabases

WebLogs

Internet of Things

DELIVER DELIVER

SnapLogic Pipeline

Big Data Integration a Differentiator

INGEST PREPARE DELIVER

•

Hadoop + Spark

SnapReduce: “Hadoop for Humans”

This

That

With Cascading, SnapLogic automatically generates complex MapReduce code

reducing development costs & accelerating time to value

Eclipse

(Programmatic)

SnapReduce

(Declarative)

Provision,

Manage &

Monitor

Ambari

Zookeeper

Scheduling

Oozie

Data Workflow,

Lifecycle

Sqoop

Flume

NFS

WebHDFS

300+ Pre-built

YARN : Data Operating System

DATA MANAGEMENT

SECURITYDATA ACCESSDATA

INTEGRATION

Authentication

Authorization

Accounting

Data Protection

Storage: HDFS

Resources: YARN

Access: Hive, …

Pipeline: Falcon

Cluster: Knox

OPERATIONS

Script

Pig

Search

Solr

SQL

Hive/Tez,

HCatalog

NoSQL

HBase

Accumulo

Stream

Storm,

Spark

Cloud/On-prem

Data Access,

Data Prep, API

Delivery

1 ° ° ° ° ° ° ° ° °

° ° ° ° ° ° ° ° ° °

° ° ° ° ° ° ° ° ° °

°

°

N

HDFS (Hadoop Distributed File System)

Batch

Map Reduce

Linux Windows On-Premise Cloud

Snaplogic as a native YARN application

Data Flow

Scheduling

Modern: Elastic Integration Platform

Control PlaneDesigner, Manager, Dashboards

(Multi-tenant cloud service)

Data PlaneSnaplex

Snaps(Buy or Build)

“Cloudplex”

“Groundplex”

“Hadooplex”

“Sparkplex”

Modern Architecture: Hybrid and Elastic

Streams: No data is stored/cached

Secure: 100% standards-based

Elastic: Scales out & handles data and app integration use cases

Metadata

Data

DatabasesOn Prem

Apps

Big Data

Cloud Apps and DataCloud-Based Designer,

Manager, Dashboard

Cloudplex

Groundplex

HadooplexSparkplex

Firewall

Challenges Faced:

• Cloudification of core business processes

• Reduce technical debt from old tech (incl. Tibco,

Informatica)

• Shift toward self-service to support decentralized org

• Hadoop adoption required hand coding MapReduce

Why SnapLogic?

• Ease of use – self-service model enables 300+ users

• Replacing manual coding of MapReduce with

SnapReduce enables re-allocation of resources

• Estimate ROI of $3.5M per year based on time savings

and reduction of technical debt

Challenges Faced:

• Significant cloudification project; existing tools –

including Informatica and MQ Series – not built for the

cloud

• Sought to reduce reliance on third-parties for integration

Why SnapLogic?

• Enterprise standard for Cloud Integration, Batch

Ingestion & Extraction to HDFS, Stream Processing to

HDFS, Data Transformation, & Batch ETL

• SnapLogic is supporting projects related to:

• Cloud Integration – cloud to cloud and cloud to on premise

patterns with Workday, Salesforce, SAP, and others

• Marketing CRM/Digital Marketing - integrations between

Adobe Marketing Cloud, MDM, and other systems

• Big Data Lake – batch and streaming integration patterns

for Hadoop-based Big Data Lake.

My experience with SnapLogic has been very

good. The tool seems very stable, and

extremely capable… more powerful than

Informatica PowerCenter.

Challenges Faced:

• Replacing legacy data warehouse infrastructure

• Wanted to improve data quality and eliminate FTP

and VPN channels

• Growing cloud app adoption

• Hadoop adoption – large Cloudera customer

Why SnapLogic?

• SnapReduce generates Map Reduce without coding

ideal for small IT team

• Broad selection of pre-built SaaS connectors

• Cloudera certification

Unified platform for

app & data integration

• Batch, streaming, real-

time

• High volume, variety,

and velocity big data

Easy to use, intuitive

UX

• Intuitive for “citizen

integrators”

• Powerful enough for

experts without

scripting

Hybrid, elastic

architecture

• Scale-out elastic

architecture

• In the cloud, on

premises or on

Hadoop cluster

Extensive library of

connectors

• Applications, analytics,

big data, social media

• REST, SOAP, JSON,

transform Snaps, and

more

SnapLogic Differentiation

We can do more in two hours with SnapLogic than we could in two days with traditional integration solutions.

SnapLogic: Connect Faster

Thank You