Twister Data Framework

OverviewOverview

Twister Data Framework: A Complete Toolkit for Data Integration

Twister Data Framework’s

Twister Data Integrator Elements

Twister Designer• Development Environment• Ad-hoc ETL

Twister Controller• Central Administration• Monitoring• Job Scheduling• Control Web Services

Twister Nodes• Grid Computing Environment• Data Processing• Data Web Services

Twister Designer

Palette of components for drag-and-drop programming

Component API for extensions

Data flows can branch and merge

Joins

Twister Data Integrator Foundation• Powerful ETL functionality, with extended features:

– Designed for a services (SOA) environment – Handling streaming data as well as bulk data processing for near real

time data delivery– Processing both structured and unstructured text requires application

integration– Support for broad data types and foreign languages – Leverages the power of many machines to process data in parallel on a

grid, thus allowing significant scalability– Strong emphasis on security

Handling user credentials, managing log files, maintaining data lineage & data pedigree, cross-domain support

•Twister solutions are component-based and modular, thus highly reusable and portable

Twister Data Integrator Components

• 90+ Out-of-the-Box Components

‒ e.g. Aggregator, Broadcast, Cartesian Join, Checksum File, Conditional Join, Database Lookup

• 15+ COTS Software Integration Components

Twister Data Framework’s

Twister Data Server

Twister Data Server• Data Source Registry• Balancing via Server Farming