35
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Jim Scharf, General Manager April 19, 2017 Amazon DynamoDB DynamoDB Just Got Faster: Deep Dive on DAX and More

SRV415 NEW LAUNCH! DynamoDB just got faster: Deep Dive on DAX and more

Embed Size (px)

Citation preview

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Jim Scharf, General Manager

April 19, 2017

Amazon DynamoDB DynamoDB Just Got Faster: Deep Dive on DAX and

More

Amazon DynamoDB

Fast and flexible NoSQL database service for any scale

Amazon DynamoDB Journey

Oct ‘07: Dynamo paper published

Jan ‘12: DynamoDB

Launch

Today: DynamoDB

Accelerator (DAX) and

VPC Endpoints for DynamoDB

New!

DynamoDB Customers

Scalability Performance Security Availability Manageability Developer Platform

Scalability

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Performance

Scalability Performance Security Availability & Data Protection Manageability Development Platform

DynamoDB: consistent performance at scale Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

DAX Demo

Scalability Performance Security Availability & Data Protection Manageability Development Platform

• Fully managed: handle all of the upgrades, patching,

and software management

• Flexible: Configure DAX for one table or many

• Highly available: fault tolerant, replication across multi-AZs within a region

• Scalable: scales-out to any workload with up to 10 read replicas

• Manageability: fully integrated AWS service: Amazon CloudWatch, Tagging for DynamoDB, AWS Console

• Security: Amazon VPC, AWS IAM, AWS CloudTrail, AWS Organizations

Features DynamoDB Accelerator (DAX)

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Repeated users are now being handled by the DAX cache without making the more expensive (in both latency & cost)

call to DynamoDB Shahar Kobrinky

VP of Architecture and Scale at Eyeview

“ ”

DAX represents a big opportunity for us to find the optimal balance between infrastructure cost and

system performance

Brandon O’Brien Principle Software Engineer, Expedia, Inc.

“ ”

DynamoDB Accelerator (DAX)

Scalability Performance Security Availability & Data Protection Manageability Development Platform

The AWS team has taken a best-practice architectural pattern and turned it into something repeatable and

valuable for its customers Glenn Nethercutt

Chief Architect, Genesys

“ ”

The ability to supercharge DynamoDB with DAX is something we're looking forward to

Pat Malatack General Manager of Twilio Messaging

“ ”

DynamoDB Accelerator (DAX)

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Key Benefits

• Fast performance: Microseconds response times at millions of reads/sec from single DAX cluster

• Ease of use: DynamoDB API compatible - requires minimal code change for existing applications, simplifying developer experience

• Lower costs: Reduce provisioned read capacity for DynamoDB tables for tables with hot data

DynamoDB Accelerator (DAX) In public preview

Security

Scalability Performance Security Availability & Data Protection Manageability Development Platform

VPC

EC2 instances Internet gateway DynamoDB

Scalability Performance Security Availability & Data Protection Manageability Development Platform

VPC

EC2 instances VPC

endpoint DynamoDB

Scalability Performance Security Availability & Data Protection Manageability Development Platform

VPC Endpoints for DynamoDB (VPC-E)

Scalability Performance Security Availability & Data Protection Manageability Development Platform

VPC Endpoints for DynamoDB (VPC-E) Use an IAM policy to restrict an IAM user, group, or role to a particular VPC-E for DynamoDB tables

Scalability Performance Security Availability & Data Protection Manageability Development Platform

• VPC: Access DynamoDB via secure Amazon VPC endpoint

• Access Control: restrict table access for each VPC endpoint with a unique IAM role and permissions

Features

Key Benefits • Turn off access from public Internet

gateways enhancing privacy and security

• Fast, secure data transfer between Amazon VPC and DynamoDB

VPC Endpoints for DynamoDB (VPC-E) In public preview

Availability & Data Protection

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

• Available in 16 regions worldwide • Built-in replication across 3 Availability Zones

Manageability

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Time-to-Live (TTL)

• Automatic: Deletes items from a table based on expiration timestamp

• Customizable: User-defined TTL attribute in epoch time format

• Audit Log: TTL activity recorded in DynamoDB Streams

Features

Key Benefits

• Reduce costs: Delete items no longer needed

• Performance: Optimize application performance by controlling table size growth

• Extensible: Trigger custom workflows with DynamoDB Streams and Lambda

Generally Available

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Time-to-live (TTL)

Reduced their costs by over $200K per year, while also simplifying their application logic.

TUNE purged 85 terabytes of stale

data

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Tagging

• Track costs: AWS bills broken down by tags in detailed monthly bills and Cost Explorer

• Flexible: Add customizable tags to both tables and indexes

Features

Key Benefits

• Transparency: know exactly how much your DynamoDB tables and indexes cost

• Consistent: report of spend across AWS services

Generally Available

Scalability Performance Security Availability & Data Protection Manageability Development Platform

DynamoDB

?

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Generally Available AWS Data Migration Service (DMS)

Developer Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability & Data Protection Manageability Development Platform

RFID

RFID

RFID Chips

DynamoDB DynamoDB Streams US East (N. Virginia)

Real-time notification using DynamoDB Triggers

Text Search

RFID

TitanDB

Graph models for patterns and

relationships

Document/Key-value store with support for online indexing

Connect to EMR / Redshift for further analysis

Scalability Performance Security Availability & Data Protection Manageability Development Platform

Scalability Performance Security Availability Manageability Developer Platform • Millions of

reads/sec from single DAX cluster

• Unlimited items and storage

• Consistent, single digit millisecond latency

• Optimized for analytics workloads with native indexing

• Microsecond response times with DynamoDB Accelerator (DAX)*

• Control user access at items and attributes level

• SOC, PCI, ISO, FedRAMP (Mod & High), HIPAA BAA

• Monitor with CloudWatch metrics & logging with CloudTrail

• Client-side encryption library

• Secure, private VPC endpoints*

• Designed for 99.99% high availability (HA)

• Built-in replication across 3 zones

• Fully-managed

• Perpetual free tier

• Pay-as-you-grow for capacity and storage independently

• Track table level spending with Tagging

• Purge data automatically (Time To Live)

• DMS connector for DynamoDB

• Event-driven programming with Triggers & Lambda

• Advanced analytics with EMR & Amazon Redshift

• Full-text query support with Amazon Elasticsearch Service

• Real-time stream processing with Amazon Kinesis

Scalability Performance Security Availability & Data Protection Manageability Development Platform

DynamoDB Accelerator (DAX) in public preview today • https://pages.awscloud.com/amazon-dynamodb-accelerator-preview-form.html

VPC-E in public preview today • https://pages.awscloud.com/VPCEndpointsPreview.html

Tagging generally available now • Get started by enabling Tagging in the DynamoDB console

TTL generally available now • Get started by enabling TTL in the DynamoDB console

AWS Database Migration Service (DMS) • DynamoDB support generally available now • https://aws.amazon.com/dms

Go Code!

Thank you!