24
SmartData Fabric ® security-centric distributed virtual data, master data and graph data management, and analytics Tableau running against Hive-MapR through SmartData Fabric ® on Azure Demo November 2019 Revision 1.1 Copyright 2019 WhamTech, Inc. 1

Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau running against Hive-MapR through

SmartData Fabric® on Azure Demo

November 2019

Revision 1.1 Copyright 2019 WhamTech, Inc. 1

Page 2: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Customer Challenges SmartData Fabric® (SDF) Solution

Establish indexed adapters and federation servers

for Hive-MapR using Hive ODBC driver, and for

other data sources, running SDF in the Cloud

(Hybrid Cloud 2.0) and/or on-prem (Hybrid Cloud

1.0). Read, Transform and Index (RTI) relevant

data, map to Logical Data Views and run MDM.

Run Tableau in both “Live Query” and “Data

Extract” modes for comparison – allow the option

of both.

Configure a number of different user and role

(RBAC) profiles with various RLS, CLS and Data

Source Level Security (DSLS).

Revision 1.1 Copyright 2019 WhamTech, Inc. 2

Tableau running against Hive-MapR through SmartData

Fabric® on Azure

Hive-MapR is slow performing complex queries,

similar to other Big Data systems. Standardized on

Tableau and wants to run it on Hive-MapR on

Azure in combination with on-prem data sources in

a true, integrated VDW.

To avoid data copying and improve performance,

wants to run Tableau in “Live Query” mode and not

“Data Extract” mode, regardless of data source.

Wants AD/LDAP-based SSO with complete access

and data security that Hive-MapR and other data

sources cannot provide.

Page 3: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Install MapR ODBC driver

Revision 1.1 Copyright 2019 WhamTech, Inc. 3

Page 4: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Hive DSN connection

Revision 1.1 Copyright 2019 WhamTech, Inc. 4

Page 5: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

EIQ Adapter index (aka EIQ Index) initial build on Hive

Revision 1.1 Copyright 2019 WhamTech, Inc. 5

Page 6: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Registering Hive as a Data Source (DS)

Revision 1.1 Copyright 2019 WhamTech, Inc. 6

Page 7: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Pairing Hive DS with Hive EIQ Index as Hive Virtual DS (VDS)

Revision 1.1 Copyright 2019 WhamTech, Inc. 7

Page 8: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Hive EIQ Index mapping to SuperSchema/Logical Data View

Revision 1.1 Copyright 2019 WhamTech, Inc. 8

Page 9: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Configuring and testing EIQ Adapter to Hive ODBC as HIVEDB_VDS_DSN

Revision 1.1 Copyright 2019 WhamTech, Inc. 9

Page 10: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Configuring Tableau to EIQ Adapter through HIVEDB_VDS_DSN

Revision 1.1 Copyright 2019 WhamTech, Inc. 10

Page 11: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau using Live Connection to Hive VDS

Revision 1.1 Copyright 2019 WhamTech, Inc. 11

Page 12: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Results of Live Query on Hive VDS EIQ Indexes and subsequent

results read from Hive

Revision 1.1 Copyright 2019 WhamTech, Inc. 12

Page 13: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau using Extract Connection to Hive VDS

Revision 1.1 Copyright 2019 WhamTech, Inc. 13

Page 14: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Revision 1.1 Copyright 2019 WhamTech, Inc. 14

Results of Extract Query on Hive VDS EIQ Indexes and

subsequent results read from Hive

Page 15: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Disputed Amount

Revision 1.1 Copyright 2019 WhamTech, Inc. 15

Page 16: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: State Wise Amounts Limits

Revision 1.1 Copyright 2019 WhamTech, Inc. 16

Page 17: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Line graph

Revision 1.1 Copyright 2019 WhamTech, Inc. 17

Page 18: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Map view

Revision 1.1 Copyright 2019 WhamTech, Inc. 18

Page 19: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Other views

Revision 1.1 Copyright 2019 WhamTech, Inc. 19

Page 20: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Pivot view

Revision 1.1 Copyright 2019 WhamTech, Inc. 20

Page 21: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: State wise amount limits dashboard

Revision 1.1 Copyright 2019 WhamTech, Inc. 21

Page 22: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Disputed amount dashboard

Revision 1.1 Copyright 2019 WhamTech, Inc. 22

Page 23: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

Tableau report: Summary dashboard

Revision 1.1 Copyright 2019 WhamTech, Inc. 23

Page 24: Tableau running against Hive-MapR through SmartData Fabric on …€¦ · Hive-MapR is slow performing complex queries, similar to other Big Data systems. Standardized on Tableau

SmartData Fabric® security-centric distributed virtual data, master data and graph data management, and analytics

The End

Revision 1.1 Copyright 2019 WhamTech, Inc. 24