Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native

Big Data Architectures

Tom Cahill, Vice President Worldwide Channels, Jaspersoft

Jaspersoft + Big Data = Fast Insights

©2012 Jaspersoft Corporation. Proprietary and Confidential 2

“Success in the Big

Data era is more than

about size. It’s about

getting insight from

these huge data sets

more quickly”

Doug Henschen

InformationWeek


“Big Data”

Large data sets, growing too big for conventional DBMS

tools

Where? Science (meteorology, genomics, connectomics, complex physics

simulations, biological environmental research)

Industry / government (information-sensing devices, aerial sensory

technologies (remote sensing), software logs, cameras, microphones,

radio-frequency identification readers (RFID), and wireless sensor

networks

Consumers / consumer-related (social networks, social data, internet text

and documents, internet search indexing, call detail records, web logs,

medical records, photography archives, video archives…


Challenges

Managing

capture, storage, search, sharing, analytics and visualization

Validity

relevance, value, interpretation and time

Who

younger, consumer-type decision-makers, self-service

expectations, ubiquity of access (mobile), simplicity of use,

elegance of design


More definitions…

Hadoop (Apache)

A framework to support distributed applications

Enables applications to work with many (many) independent

computers and lots (lots) of data

Derived from Google MapReduce

Free, OS

…with a number of commercial offerings (IBM, Greenplum,

Cloudera etc)

MapReduce

Google patent

Interface “too low-level” for today’s needs in big data…?

Recent Hadoop and HBase developments move the story

forward…


More definitions Contd…

Hbase

Non-relational, distributed database

Adding BigTable capabilities to Hadoop

Also OS

Hive

Data Warehouse built on Hadoop

Originally developed by Facebook; now used by eg Netflix

Included on Amazon Web Services


Jaspersoft – Leading BI for Big Data

Most Comprehensive Big Data support

Partnerships

Access methods

Connectors

Big Data Partnerships

©2012 Jaspersoft Corporation. Proprietary and Confidential

Hadoop NoSQL/NewSQL Analytic DBMS


Big Data Access Methods

Support for batch oriented reporting & analysis HIVE or standard JDBC interface

ETL or ELT out of Hadoop into RDBMS for analysis/reporting

Formatted layout, delivered daily, weekly, monthly, etc.

Support for interactive reporting & analysis Uses native interfaces to HBase, MongoDB, etc.

Ideal for data exploration

Low-latency ‘speed of thought’ queries

Presented via intuitive Ad Hoc Analysis UI for broader appeal & adoption

Unified Analysis Interface supports relational, OLAP, and Big Data source

exploration

Approach Interactive Exploration Direct Batch Reporting Indirect Batch Analysis

Use Case For data analysts and data scientists

who want to discover real-time

patterns as they emerge from their

Big Data content

For executives and operational

managers who want summarized,

pre-built daily reports on Big Data

content

For data analysts and operational

managers who want to analyze historical

trends based upon pre-defined

questions in their Big Data content

Latency Low Medium High

Big Data HBase, NoSQL, Analytic DBMS Hive, NoSQL, Analytic DBMS Hadoop, NoSQL, Analytic DBMS

Connectivity Native Native, SQL ETL

Architecture

3 Approaches to Big Data Analysis


10

BI Platform

BIG

DATA

In-Memory Engine

Native

BI Platform

BIG

DATA

Native SQL

BI Platform

BIG

DATA

OLAP Engine

Data

Mart

ETL

Multi-Dimensional

Analysis

Reports &

Dashboards

Multi-Dimensional

Analysis

Technical Details of Big Data

Connectors – HBase example

Direct, native connectivity to HBase Using a JSON-like query language

Supports all of HBase filter APIs StartRow, EndRow, RowFilter, FamilyFilter, ValueFilter etc.

Can specify exactly the ColumnFamilies and/or Qualifiers returned

Contains a deserialization (SerDe) engine framework Users can plug in their own deserialization .jars

Converts HBase raw bytes into meaningful data types

Optimized performance


Big Data Connectors

Cassandra

CouchDB

EhCache

GemFire

Hadoop Avro

Hadoop HBase

Hadoop Hive

MarkLogic

Membase

MongoDb

Neo4j

Redis

Solr

SpringData – Redis

VoltDb



Trends in Big Data Sources

ABOUT JASPERSOFT


More than 40 global partners including:

Quick Jaspersoft Company Data

Recognized by industry

analysts and journalists: 50%-60% Growth FY’09 – FY’12 Year-over-Year sales growth

Magic Quadrants

http://www.cloudera.com/

http://www.rightscale.com/

http://www.talend.com/

http://www.jaspersoft.com/nw_press_jaspersoft_dukeschoice.html

Jaspersoft Community


Worldwide Adoption

Over 15 million product downloads

Over 14,000 Commercial Customers

Over 1,000 Software Subscribers

175,000 production deployments

250,000 registered community members

Every Minute …

6 product downloads

Every Day …

250 new community members

30,000 users building BI apps

Every Month …

250 New Customers

Jaspersoft Customers


Software & Technology

Financial Services

Public Sector

Telecommunications

Travel & Transportation

Manufacturing

Healthcare/Pharmaceutical

250,000 Community. 175,000 Production Deployments. 14,000 Customers.

http://www.google.com/imgres?imgurl=http://efdni.org/images/bt_logo.jpg&imgrefurl=http://www.efdni.org/&h=1417&w=2991&sz=304&tbnid=RO_caeCCkLDptM:&tbnh=71&tbnw=150&prev=/images?q=bt+logo&usg=__p0s3Y2sX9LrO9QQlqu9KbmIaabw=&ei=tybPSoSnKKS7jAek_-z5Aw&sa=X&oi=image_result&resnum=1&ct=image

Jaspersoft Big Data Customers


Customer Description

Connecting to Hadoop

Using Jaspersoft withMongoDB

connector

Connection to Hapoop Hive

A Modern End-to-End BI Suite

Intuitive, consumer web application look-and-feel

Interactive reports, analysis & dashboards for BI self service

Native and browser-based mobile business intelligence


“New prospects see the dashboards, the drag-and-drop ad hoc query, and aesthetics,

and say: ‘Wow. We didn’t know you guys could do this.’ And it’s getting us new business – lots of it.” Bruce Belvin,

President

A Flexible End-to-End BI Suite

Easy to deploy standalone or embedded

Easy to deploy on-premises or in the cloud

Easy to customize or extend and include any data source


Events (.js)

Presentation (.css)

Structure (.jsp)

Business Logic (.java)

Exte

nsiv

e A

PIs

100% Web-Standards Architecture “It’s all standards-based and we were able to apply the skills we had developed elsewhere. It was very easy for us to absorb the Jaspersoft technology into our system architecture” Jeremy

Walters, Director, Systems Development

An Affordable End-to-End BI Suite

Affordable commercial open source subscription

Fast, low-cost implementations

Cost-effective support, commercial or community


“Because we wanted to be able to grow and change as our needs evolved, we chose what we felt was the more ‘future-proof’ platform. That and a very low cost of ownership made our choice fairly easy.” John Sweet-

Escott, Project Director

Source: Third Nature, ”Lowering the Cost of Business Intelligence

with Open Source” 2011

Try Out Jaspersoft Today

Download Download 30-day Evaluation of Jaspersoft BI

Enterprise at Jaspersoft.com

Go to Jaspersoft.com/getting-started for setup tips

On-Demand Trial Try our Live Online version – NO INSTALLATION!

Go to Jaspersoft.com/jaspersoft-live-trial

Use for 7-days

© 2012 Jaspersoft Corporation.

Q & A

[email protected]

© 2012 Jaspersoft Corporation.

@Jaspersoft

France: + 33 9 70 44 40 19

openbookonbi.blogspot.com – Brian Gentile CEO

mailto:[email protected]



Thank You

Documents

Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native