11
Scale-out Searchable Storage for the Cloud Age Tony Barbagallo Caringo

Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Scale-out Searchable Storage for the Cloud Age

Tony Barbagallo Caringo

Page 2: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Endless Capacity Accessible Anywhere Always Available

Expectations of File Storage Have Changed

What I Want – When I Want It!

Page 3: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Organization & Analytics at Scale

Scale-out Searchable Storage

Secure Multi-Tenant Cloud Storage services

Data Management Platform

Offload Legacy Storage

Multi-tenancy Public or Private

Metering and Quotas Access Controls

Multi-protocol Access

Metadata stored with Files Integrated Search

Content Portal Collections

Big Data Enabled No File System Limits

Transparent File Access No Application Changes

Streamline Backups Data is Continuously

Protected

Page 4: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Architecture Overview

Page 5: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Flexible Deployment

Storage nodes perform all functions

Fast proactive recovery

Darkive™ adaptive power conservation

Continuous Protection

Patented EC & replicated files on the same node

Feeds and subclusters for replication and DR

Complete Software Appliance

No file system, RAID, LUNs or DBMS required

Runs from RAM; 95% capacity for files

Scale-out Storage Platform Technical Overview

Page 6: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Swarm Search Infrastructure

• Client Applications — send SCSP+ commands and

receive information to/from the Swarm cluster.

• Swarm Cluster — Connects to the

Elasticsearch(ES) servers through a Search Feed.

• Search Feed — Transmits the metadata from the

storage cluster to the ES servers and the search queries and replies.

• Elasticsearch servers — Index the metadata and service

search requests.

Client Apps

Elasticsearch Cluster

Swarm Storage Cluster

Page 7: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Swarm Search

• Actionable insight — Targeted analysis

• Dynamic organization of content — Classification, key words, descriptive content — Multiple ways to track content

• No separate “Big Data” project required — Self-contained within the storage system

Find the Needle in a Very Large Haystack

List domain objects within a cluster: GET http://CLUSTER/?domains&format=json

List buckets within a domain: GET http://CLUSTER/?format=json

List objects within a bucket: GET http://CLUSTER/mybucket?format=xml

Search for objects with metadata matching: GET http://CLUSTER/?format=json&content type=image/jpeg

Page 8: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Collections – Organization and Search at Scale

Page 9: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Multi-tenant Management

• Secure — Connects to LDAP, Active

Directory, Linux PAM — Token-based authentication

• Robust system administration — RESTful API & via web portal — Flexible naming scheme, no

bucket limits — Use your domain

• Interoperable — HTTP, S3, HDFS,

NFS, SMB

Page 10: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Limitless Storage at a Fraction of the Cost

Universal Access

Analysis at Scale

Ad Hoc Search & Query

Complete Software Appliance

Flexible Deployment

Enterprise Support

Continuous Protection

Data Service Enablement

Infrastructure Management

Page 11: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)

2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Thank You facebook.com/caringostorage

www.caringo.com

@caringostorage

linkedin.com