View
626
Download
2
Category
Tags:
Preview:
DESCRIPTION
About AWS services for SQL Server Professionals - EC2, RDS, DynamoDB, MapReduce and more. Also covers pricing - understanding on-demand, reserved and spot instances
Citation preview
AWS for the SQL Server Pro
@LynnLangit
Nov 2013
Data Expertise / Lynn Langit
Practicing Architect• Cloud Deployments (Azure, AWS, Google)
Technical author / trainer• Google Cloud Developer Series• SQL Server 2012 Developer Series • Cloudera Certified Developer• 2 books on SQL Server BI
Industry awards• Microsoft – MVP for SQL Server • Google – GDE for Cloud Platform• 10Gen – Master for MongoDB
Former MSFT FTE• 4 years
What and Why AWS?
AWS Amazon’s cloud
Large Set of services• Compute• Data• More
Market leader• In market
longest• Usually
cheapest • Most often used
in production
Amazon Web Services
5
How to Work with AWS
• Web Console
• Command Line Tools
• AWS SDK and IDE Tools
EC2 – Virtual Machines (AMIs)
EC2 – VMs (AMIs) from AWS Marketplace
8 April 2013
Demo - EC2Virtual Machines
Understanding EC2 storage options
S3 -- Storage
S3 – bucket properties
12 April 2013
Demo – S3 Storage
Glacier -- storage & archiving
14 April 2013
Demo – GlacierArchival Storage
RDS – partially managed SQL Server and more…
16 April 2013
Demo – RDSSQL Server as a service
RDS vs. EC2 for SQL Server
• Provisioned IO – performance guarantees
• Scheduled backups • Point in time restores• Scheduled
maintenance windows• Full use of all SQL
tools, SSMS, Profiler, DTA, etc…
• Supports Availability Groups (requires 2012 Enterprise)
• Cross-regional snapshots
Why RDS costs more
Redshift – Warehouse as a Service
19 April 2013
Demo – RedshiftData Warehousing as a Service
DynamoDBfor fast NoSQL with SSDs
21 April 2013
Demo – DynamoDB
NoSQL on SSD
Elastic MapReducefor easy Hadoop
23 April 2013
Demo – MapReduceHadoop on AWS
Data Pipelines – automated data transfer
25 April 2013
Demo – Data Pipeline
Build data flows on AWS
Elastic Beanstalkfor application scalability
27 April 2013
Demo – BeanstalkPaaS on AWS
28
AWS SDK for Visual Studio
29 April 2013
Demo – AWS SDKAdd-in for Visual Studio and .NET
Cloud Database Services by Vendor
AWS Google MicrosoftVirtual Machines EC2 w/SQL Server GCE – Linux only Azure VM – W/SQL
Server
Cloud RDBMS RDS - SQL ServerRedshift -Postgres
mySQLMariaDB
SQL Azure
NoSQL bucketsKey-Value stores
S3, EBS, Glacier, DynamoDB
Cloud Storage HR Datastore on GAE
Azure Blobs Azure Tables
Pipelines Data Pipelines Via APIs only SSIS (on-premises)
Streaming Machine Learning
Custom EC2 Prospective Search &Prediction API
StreamInsight
Document MongoDB on EC2 None MongoDB on Windows Azure
Hadoop MapReduce or Dremel
MapReduce on EC2 using S3
Big Query HDInsight (HDFS) on Azure
Data sets & other
EBS volumes w/datasets
FreebaseTranslation APIFull-text search
Azure Marketplace
Costs - Free Tier – EC2
Costs - Free Tier SQL and Dynamo
How much does it cost?
Creative Financing
• Use what you need and no more, i.e. instance size, storage size…
• Watch for price drops – RDS price decrease this week
Regular Pricing
• Pause EC2 instances to reduce compute charges• Delete EC2 instances to reduce storage charges
Smart EC2 Instance Usage
• Set pricing alerts• Use spot pricing• Re-selling compute / storage
Vanity Pricing
35
Example: EC2 Spot Pricing
36
Example: EC2 Reserved Pricing
37
Tip: Use Pricing Calculators
Example – from RightScale ‘PlanForCloud’
Conclusions
EC2 for testing, training and production (IaaS)
S3 for archiving R/W
Glacier for archiving W fast & cheap, R slow & expensive
RDS for HA SQL Server
Redshift for Data Warehousing on demand
DynamoDB for fast NoSQL – on SSDs
Elastic Map Reduce for easy Hadoop MapReduce
www.TeachingKidsProgramming.org• Free Courseware (Java, SmallBasic or C# / Pluralsight)• Do a Recipe Teach a Kid (Ages 10 ++)• Dec 2013 – Code.org – ‘Hour of Code’ education
partner
• recipes)
Keep Learning
Twitter: @LynnLangitYouTube:http://www.youtube.com/user/SoCalDevGal
Hire me• To help build your BI/Big Data
solution• To teach your team next gen BI• To learn more about using NoSQL
solutions
Recommended