HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Trafodion Transactional SQL-on-HBaseTrafodion Technology Look

www.trafodion.org

HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2

Trafodion – Software architecture (3 layers)

JDBC ODBC

User and ISV Operational Applications

Driver

Client

SQL

Storage Engine

*ESP

CMP Master

ESPDTM

WMS

Compiler and Optimizer Workload Management

SQL ParallelismDistributed Transaction

Management

. . . .

FutureDatabase Connectivity

HBase

Relational Schema

Trafodion Tables

HDFS

Data Store Integratio

nHBase

Native HBase Tables KVS,

Columnar via HBase API +

coprocessors

Hive

Direct HDFS access to Hive tables using

HCatalog

*Executor Server Process

HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3

Optimized for varying operational workloads• Optimized performance and efficiency

– OLT optimization for directed keyed access

– ESPs for parallel SQL operations– Multi-layered ESP for complex plans– Data Flow pipeline parallel architecture– Reusable Masters and ESPs for efficiency

• Cached SQL plans eliminates recompilation

• Sophisticated Optimizer– Leverages Equal Height Histograms– Pushes down

• Filters e.g. row selection (start-stop key)

• Coprocessors e.g. aggregates

• Multi-Dimensional Access (MDAM)

– Secondary index access

• Service persistence (via Zookeeper) and automatic query resubmission

Node 1 Node 2 Node n

Client Application

HDFS

HBase HBase HBaseFILTERS

HDFS HDFS HDFS HDFS

Ethernet

COPROCESSORS

Master

ESP ESP ESP ESP ESP

ESP ESP ESP ESP ESP

Master

Type 2 and Type 4 ODBC/JDBC driver

HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4

Trafodion – Differences with HBase

Trafodion + HBase

Data abstraction

Relational schema

Physical Layout Single column family with space-saving column encoding

Column values Explicitly defined and enforced data types

ACID Guarantee

Transactions across multiple SQL statements, tables, and rows

Language API SQL (Trafodian invokes native HBase API)

Row Key Index Composite (multi-column) row key

Secondary Indexes

Arbitrary secondary key columns

Salting Allows specification of salt key-prefix for load balancing

HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5

Comprehensive DDL, DML, TCL, and utility support • ANSI Core SQL 99 complaint + other SQL 99 and SQL 2003 support with

Trafodion extensions• Full featured DDL - CREATE/DROP/ALTER statements for tables, views,

indexes, constraints– Comprehensive data type support - numeric, character, varchar, date, time, interval– Unicode encoding including UTF8, UCS2, and ISO8859-1for user data; UTF8 for

metadata

• Full featured DML – SELECT, INSERT, UPDATE, DELETE, UPSERT and MERGE statements– JOIN (INNER, LEFT/RIGHT/FULL OUTER), UNION, WHERE, GROUP BY, HAVING, ORDER

BY, SAMPLING, etc.– Correlated and nested sub-queries– Cursor support (non-holdable)– Extensive SQL function support - aggregate, date/time, character, mathematical,

OLAP, sequence, etc.

• Utilities – Update Statistics, Explain, Control Query Shape, Command Line Interface

• Transaction Control – BEGIN WORK, COMMIT WORK, ROLLBACK WORK, SET TRANSACTION

• Work-in-progress: Stability, Performance, Triggers, Referential Integrity, C++ UDFs, Java Stored Procedures, Bulk Loader, node/system failure Transaction Recovery, Grant/Revoke, …

HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6

See for yourself…Come discover and develop on

Trafodion

www.trafodion.org