30
Get the Inside Story on MongoDB BI Connectors Sumit Sarkar Chief Data Evangelist Progress DataDirect Gene Arnold Senior Sales Engineer TIBCO Jaspersoft

Webinar on MongoDB BI Connectors

Embed Size (px)

Citation preview

Page 1: Webinar on MongoDB BI Connectors

Get the Inside Story on MongoDB BI

Connectors

Sumit Sarkar

Chief Data Evangelist

Progress DataDirect

Gene Arnold

Senior Sales Engineer

TIBCO Jaspersoft

Page 2: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.2

Audio Bridge Options & Question Submission

Page 3: Webinar on MongoDB BI Connectors

Get the Inside Story on MongoDB BI

Connectors

Sumit Sarkar

Chief Data Evangelist

Progress DataDirect

Gene Arnold

Senior Sales Engineer

TIBCO Jaspersoft

Page 4: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.4

Agenda

What to consider for BI with MongoDB?

When to utilize MongoDB's Connector for BI versus

Progress DataDirect's solution

How TIBCO Jaspersoft selected a MongoDB

connector for their Embedded BI platform

Page 5: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.5

Page 6: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.6

What to consider for BI with MongoDB?

Page 7: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.7

What is MongoDB?

MongoDB is an open source, document-oriented NoSQL

database designed with both scalability and developer

agility in mind. Instead of storing your data in tables and

rows as you would with a relational database, in

MongoDB you store JSON-like documents with dynamic

schemas.

Page 8: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.8

Why do we need a BI connector for MongoDB?

MongoDB is a NoSQL database making it scalable and

flexible for building applications, but the BI ecosytem

expects SQL.

MongoDB document structures can include deeply

nested data that do not have equivalents in the

relational model

MongoDB native queries have limited support for SQL

JOINs across different collections.

Page 9: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.9

MongoDB Survey: How complex are documents?

Page 10: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.10

MongoDB Survey: Depth of arrays/document nesting?

Page 11: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.11

You’re doing something right when you need BI Connectivity

Business Intelligence Data Integration

ODBC/JDBC

Page 12: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.12

BI Connectors for MongoDB vs RDBMS

Important to run performance stress tests on BI servers for workloads

Different BI tools require specific properties such as max varchar sizes

on string data types, or field names that start with underscore.

Must sample data to generate schema on read – need to configure this

value “ColumnDiscoverySampleSize”

Flexible data model where data types can vary row to row and case

sensitive naming collisions can occur during normalization

Page 13: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.13

When to utilize MongoDB'sConnector for BI versus Progress DataDirect's solution

Page 14: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.14

MongoDB 3.2 Connector for BI (released Q4 2015)

Visualize and explore multi-dimensional

documents using SQL-based BI tools. The

connector does the following:

• Provides the BI tool with the schema of the

MongoDB collection to be visualized

• Translates SQL statements issued by the BI tool

into equivalent MongoDB queries that are sent to

MongoDB for processing

• Converts the results into the tabular format

expected by the BI tool, which can then visualize

the data based on user requirements

Page 15: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.15

Location & Flow of Data

MongoD

B BI

Connecto

r

Mapping meta-data Application data

{name:

“Andrew”,

address:

{street:…

}}

DocumentTableAnalytics & visualization

Page 16: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.16

DataDirect MongoDB ODBC and JDBC drivers (released Q1 2014)

First Reliable MongoDB Connector (Unlimited

Normalization) and only one certified by MongoDB, Inc.

Picked up latest MongoDB features such as

WiredTiger Engine Support, Aggregate Framework,

Security such as SSL

Support across Windows, Linux, AIX, Solaris, HP-UX

Page 17: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.17

Progress DataDirect & Flow of Data

Application dataAnalytics & visualization

Page 18: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.18

How Normalization works from Progress DataDirect?

Table Name: users_list

_id userid first

name

last

name

nick

name

gender time

zone

post

code

country height height

unit

… da50… Burris Harmon Yesenia Male PT 94110 US 70 inches

steps_id count_generated_id Hour steps

da50… {…} 16 2792

da50.. {…} 17 2078

Table Name: steps_count

_id userid date

… da50… 10-29-2014

Table Name: steps

Page 19: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.19

CASE STUDY

CHALLENGE

MongoDB became a production database in Killik & Co’s

infrastructure, and the team began to move many processes from

SQL to MongoDB. Various departments began asking for data for

reporting purposes, which necessitated real-time connectivity

between SQL Server and MongoDB.

The SOLUTION

Using Progress DataDirect Connect for ODBC, Killik & Co will can

expose the data in the MongoDB database as normalized relational

tables, enabling the team to query, sort and aggregate data from

both systems to gain a far more comprehensive view of its

customers

Page 20: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.20

Geek Bit - End to End

{

"_id": "c792351c-05b3-4794-b9e3-9cddccc1fb0f",

"audit": {

"created": "2014-09-03T18:06:27+01:00",

"userCreated": "Cater, Simon"

},

"data": {

"code": "G1234567G",

"name": "Dr S A Cater",

"type": "MPG",

"properties": {

"objective": "Killik Growth",

"reportTitle": "Dr S A Cater",

"modelResult": {

"rules": "Passed",

"guidelines": "Passed",

"lastRun": "2015-10-29T06:40:55+00:00",

"lastPassed": "2015-10-29T06:40:55+00:00"

},

"equityTarget": "85",

"nonEquityTarget": "15"

},

"scope": {

"clientReportScope": "CATER1,CATER2,-A123511:Managed Portfolio"

}

},

"owner": "Ipswich"

}

{

"_id": "c792351c-05b3-4794-b9e3-9cddccc1fb0f",

"audit": {

"created": "2014-09-03T18:06:27+01:00",

"userCreated": "Cater, Simon"

},

"data": {

"code": "G1234567G",

"name": "Dr S A Cater",

"type": "MPG",

"properties": {

"objective": "Killik Growth",

"reportTitle": "Dr S A Cater",

"modelResult": {

"rules": "Passed",

"guidelines": "Passed",

"lastRun": "2015-10-29T06:40:55+00:00",

"lastPassed": "2015-10-29T06:40:55+00:00"

},

"equityTarget": "85",

"nonEquityTarget": "15"

},

"scope": {

"clientReportScope": "CATER1,CATER2,-A123511:Managed Portfolio"

}

},

"owner": "Ipswich"

}

Page 21: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.21

MongoDB BI Connector from Progress DataDirect vs MongoDB

MongoDB (Q4 2015) Progress DataDirect (Q1 2014)

Supported Versions MongoDB Enterprise Advanced 3.2 Supported with v2.2, 2.4, 2.6, 3.0,3.2

Free Software Foundation's GNU AGPL v3.0

MongoDB Professioal

MongoDB Enterprise Advanced

Known Workloads Data Visualization (extract) Data Visualization (extract)

Connect-Live

Operational BI

Data Federation

Deployment BI Desktop and/or Application Server

BI Connector on Linux Server Node(s)

BI Desktop and/or Application Server

Interface Postgres xDBC ANSI SQL MongoDB xDBC ANSI SQL

Fully Embeddable n/a Yes

Certification MongoDB MongoDB

DataDirect OVS/JVS (includes ISV suites)

Open source No No

Client Support Postgres open source community Commercial (includes TSANet Multi Vendor

Support)

Page 22: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.22

Try it out

https://www.progress.com/odbc/mongodb

https://www.progress.com/jdbc/mongodb

https://www.mongodb.com/products/bi-connector

https://www.tableau.com/support/drivers

https://odbc.postgresql.org/

https://jdbc.postgresql.org/

Page 23: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.23

Embedded Reports, Dashboards and Analyticswith TIBCO Japersoft & Progress

Page 24: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.24

What is Embedded BI w/ TIBCO Jaspersoft?

The Old Way

Your apps

Analytics

Consumer

The Right Way

Put answers

in context

Increase

adoption of BI

Give consumers

actionable data

Embedded BI with TIBCO Jaspersoft

Page 25: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.25

Where are the the Opportunities of Embedded BI w/ MongoDB?

Opportunity #2

Make your app competitive by

providing visualization and

reporting capabilities

demanded by end users

Opportunity #4

Save capital and use a

solution designed for modern

architectures

Spend more time developing

your core product and less

time handling report requests

Opportunity #1

Reduce time spent maintaining

home grown BI technologies

and deliver greater value with

a best-in-class solution

Opportunity #3

Page 26: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.26

TIBCO Jaspersoft’s Journey with MongoDB

Native MongoDBDriver

ETL

In-Memory

Virtualization

Embedded

Progress

Driver

• Reports

created by

IT/Dev

• Requires

knowledge of

MongoDB

native query

language

• Extract data

from

MongoDB

• Good to

blend with

other data but

not using

power of

MongoDB

• Allows

blending data

and end user

driven reports

& analytics

• Slow, hard to

model data

• Full reporting,

dashboards,

analytics driven

by end users

• Easy metadata

• Use full power

of MongoDB

with complex

schemas

2015201320122011

Page 27: Webinar on MongoDB BI Connectors

Demonstration

User Self-ServiceDashboardsReports

Metadata Layer

Driver Layer

Data Layer

Page 28: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.28

Attend a Weekly Demo

Watch a Webinar

Attend a live Event

Download Trial or Launch on AWS

Interested in TIBCO Jaspersoft?

Visit us at

www.jaspersoft.com

Our users LOVE Jaspersoft ad hoc reporting and

the performance of the system built on MongoDB

and Redshift

- Russ Davis, Founder and CEO

Page 29: Webinar on MongoDB BI Connectors

© 2015 Progress Software Corporation. All rights reserved.29

Welcome MongoDB connectivity to the DataDirect family

Big Data/NoSQL

Apache Hadoop Hive

Cloudera

Hortonworks

Pivotal HD

MapR

EMR

Pivotal HAWQ

Cloudera Impala

MongoDB

Spark SQL

Cassandra (preview)

SAP HANA (ODBC preview)

Data Warehouses

Amazon Redshift

SAP Sybase IQ

Teradata

Pivotal Greenplum

Relational

Oracle DB

Microsoft SQL Server

IBM DB2

MySQL

PostgreSQL

IBM Informix

SAP Sybase

Pervasive SQL

Progress OpenEdge

Progress Rollbase

SaaS/Cloud

Salesforce.com

Database.com

FinancialForce

Veeva CRM

ServiceMAX

Any Force.com App

Hubspot

Marketo

Microsoft Dynamics CRM

Microsoft SQL Azure

Oracle Eloqua

Oracle Service Cloud

Google Analytics

EDI/XML/Text

EDIFACT

EDIG@S

EANCOM

X12

IATA

Healthcare EDI: X12, HIPAA,

ICD-10, HL7

Custom EDI

Flat files: CSV, TSV, dBase,

Clipper, Foxpro, Paradox

Text Files

Any

SDK

SequeLink Socket Server

Customer Engineering

Page 30: Webinar on MongoDB BI Connectors

Q&A

Sumit Sarkar

Chief Data Evangelist

Progress DataDirect

Gene Arnold

Senior Sales Engineer

TIBCO Jaspersoft