Upload
new-relic
View
271
Download
2
Embed Size (px)
Citation preview
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
UNDERSTANDING THE DYNAMIC NATURE OF CLOUD COMPUTING
MONITORING PERFORMANCE OF
ENTERPRISE APPLICATIONS ON AWS
Lee Atchison ∙ Senior Director Strategic Architecture at New Relic, Inc. / Las Vegas, NV, 2017
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Does this sound familiar?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
©2008–17 New Relic, Inc. All rights reserved#FutureStack
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
You had power most of the time.
Why are you complaining?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Keeping Your Enterprise Apps Running…
At Scale
Visibility…
… into your app
performance
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
… overheard OPs conversation...
Does this sound like something you’ve
heard recently…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“We were wondering how
changing a setting on our
MySQL database might
impact our performance…
The Conversation…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Conversation…
… but we were worried
that the change may
cause our production
database to fail…”
“We were wondering how
changing a setting on our
MySQL database might
impact our performance…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The “Scary” Overheard Conversation…
“… Since we didn’t want to bring
down production, we decided to
make the change to our backup
(replica) database instead…
UnderConstruction
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The “Scary” Overheard Conversation…
… After all, it wasn’t
being used for anything
at the moment.”
UnderConstruction
“… Since we didn’t want to bring
down production, we decided to
make the change to our backup
(replica) database instead…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The “Scary” Overheard Conversation…
UnderConstruction
X
Until, of course, the backup was needed…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The “Scary” Overheard Conversation…
This was a true story
UnderConstruction
!!!!X
X
Until, of course, the backup was needed…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Availability can be more subtle, for example…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
300ms
1.5s
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 17Confidential ©2008-15 New Relic, Inc. All rights reserved.
.9s
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 18
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Data from Monitoring Your AppDwarfs the Data Inside the App
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
User Experience
Business Outcome
Servers
Apps
Big Data Problem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High
Expectations
Blame
Game
Intensity
Rises
The problem
must be
someone
else’s fault
Without Visibility - Panic
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What Happened?
You can’t know what happened if you
can’t visualize what your app is doing.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise ApplicationsNeed Data at Every Level
Typical Server / Amazon EC2 Instance
• Application & Application Microservices
• Server OS
• Hardware (virtual)
Amazon EC2 Instance
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application &
Application
Microservices
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Instance
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application &
Application
Microservices
Low Level Monitoring
Amazon CloudWatch
AWS CONSOLE
Amazon CloudWatch
Monitors
• Amazon EC2 instance
• Virtualization
• Hardware
• [CPU / Disk /
Networking]
Doesn’t know about:
• Server OS
• Memory / Filesystem
• Processes
• Configuration
• Application
–Latency
–Error rates
–App insights
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Instance
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application &
Application
Microservices
DASHBOARDS
New RelicApplicationMonitoring
New Relic Infrastructure
Monitoring
Amazon CloudWatch
AWS CONSOLE
Monitors (Server)
• How O.S. is performing
• Configuration Changes
• Processes
• Hardware
Monitors (Application)
• App health
• App performance
• Microservices
Doesn’t know
• Virtualization
Infrastructure / Application Monitoring
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Instance
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application &
Application
Microservices
Full Stack Monitoring
New RelicApplicationMonitoring
New Relic Infrastructure
Monitoring
Amazon CloudWatch
AWS CONSOLE
Integrations
New Relic
Monitors
Amazon
CloudWatch
Monitors
DASHBOARDS
AWS / Amazon CloudWatch
• Visibility into virtualization
• CPU / Disk / Networking
• 14 AWS Services
APM
• CPU / Disk / Networking
• Memory / Filesystem
• Processes
• Infrastructure components
• Configuration inventory
• Application / Microservices:
–Latency
–Error rates
–App insights
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why Measurement Matters
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Visibility…
… into your app
performance
Dynamic Cloud…
... tools to make
availability happen.
How Do You Keep Your Enterprise
Apps Running?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using the Cloud in Enterprise Applications
Better Data Center Dynamic Environment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Better Data Center
Better Data Center Dynamic Environment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud as a “Better Data Center”
Resources are
allocated to uses, just
like in a data center
Provisioning
process
is faster
Lifetime of
components is
relatively long
Capacity planning is
still important and
still applies
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why Use a “Better Data Center”?
Add new
capacity
Capacity where
you need it
Faster Redundant Compliant
Improve application availability
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud
Better Data Center Dynamic Environment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud as a “Dynamic Tool for Dynamic Apps”
Use only
the resources
you need
Allocate / de-allocate
resources on the fly
Resource allocation is
an integral part of your
application architecture
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud
Resources are: Application in charge:
Allocated Application is aware of and is controlling traditional OPs resources
Consumed De-allocated
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Usage Example…
Docker Container Age(Count vs. Hours)
1 Hour
200 days 833 days
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Usage Example…
Docker Container Age(by Minute and Hour)
1,200,000
11% under one minute
Container age (minutes)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud Technologies
Dynamic Cloud is about scaling and availability
Amazon EC2 Auto Scaling
Mobile / IoT Dynamic routing
Load balancing
Queues and notifications
Docker
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud Enables Better
Applications Faster
Traditional
Data Center
Cloud
Data Center
Dynamic
Cloud
Better Best
The way you’ve done things in the pastwon’t work in the future.
Good
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud
Server running
application / processes
Process running
a command
Function performing
a task or operation
Amazon EC2 Docker AWS Lambda
Things happen faster because of…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Microcomputing & AWS Lambda
• Highly dynamic
• Incredibly scalable
• No infrastructure to provision
• Massively shared infrastructure
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud
Dynamic Cloud
Easier Scaling
Faster Change
Faster Response
Higher Availability
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How Do I Track What the Dynamic Cloud
Is Doing for Me (or to Me)?Dynamic Cloud Has Unique Monitoring Requirements…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is a Dynamic Cloud Application?
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Provisioning
Application & Application
Microservices
Application & Application
Microservices
BrowserMobile
Responsible for the parts
you care about
• Application & Application
Microservices
Let Cloud manage rest
• Infrastructure
• Allocation/Provisioning
• Scaling
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Provisioning
Application & Application
Microservices
Application & Application
Microservices
BrowserMobile
Monitoring Dynamic Cloud Applications
AWS CONSOLE
Amazon CloudWatch
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Provisioning
Application & Application
Microservices
Application & Application
Microservices
BrowserMobile
AWS InfrastructureApplication Performance
Amazon CloudWatch
New RelicApplicationMonitoring
New Relic Infrastructure
Monitoring
DASHBOARDS
Integrations
AWS CONSOLE
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Provisioning
Application & Application
Microservices
Application & Application
Microservices
BrowserMobile
Amazon CloudWatch
New RelicApplicationMonitoring
New Relic Infrastructure
Monitoring
DASHBOARDS
AWS InfrastructureApplication Performance
Amazon
CloudWatch &
AWS Monitors
Integrations
AWS CONSOLE
New Relic
Monitors
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Provisioning
Application & Application
Microservices
Application & Application
Microservices
BrowserMobile
How Do You Monitor This?
?How do you
monitor this?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Where Did It Go? It Was Just Here!!
The thing you monitored 10 minutes ago…
... doesn’t exist anymore!?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring the Dynamic Cloud
Monitor the Cloud
Components themselves
Monitor the lifecycle of
the Cloud Components
Very different than monitoring traditional Data Center components
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Changing World
Ops
Previous – STATIC World
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Changing World
Dev
Now – DYNAMIC World
Ops
Ops
Previous – STATIC World
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Changing World of Enterprise Applications
Dev
Now – DYNAMIC World
Ops
We know:
• Change is inevitable
We must:
• Embrace and drive change
Enabling:
• Quicker growth
• More reliable growth
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic Cloud…
... tools to make
availability happen.
Migration…
... how do I get my
app to the cloud?
Your Enterprise Apps and the Cloud
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High
Expectations
Blame
Game
Intensity
Rises
The problem
must be the
cloud’s fault
Pressure to
Declare Victory
in the Migration
The Politics of Migration
Show me the
new apps!!?
Promised Performance Gains?
Cost Controls?
Optimize Costs?
Why is it taking so long?
Migration failure…
This problem is easy to avoid...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
OpsUse the Cloud
Does not have to be painful…
• Move in a controlled way
• Learn as you go
• Measure everything
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
Standard steps
most companies
follow
Progressions in Cloud Adoption… The Controlled Way
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Progressions in Cloud Adoption
Experiment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT Cloud Adoption StrategyProgressions in
Cloud Adoption
What is this cloud thing?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment:
• Non-evasive, safe technologies
• Amazon S3
• Perhaps: Amazon CloudFront,
Amazon Simple Queue Services (SQS),
Amazon Simple Email Service (SES)
• Security: Easy as one-offs
• No “Policies” implemented yet
• “Just seeing what this is all about”
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Progressions in Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT Cloud Adoption StrategyProgressions in
Cloud Adoption
Can we trust the cloud?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud Policies:
• IAM (Credentials)
• VPC (Secure network)
• AWS Direct Connect
(just another data center)
• Cloud policies begin to be formed
• All parts of the company are
now involved
• Critical evolution point
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Progressions in Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT Cloud Adoption StrategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enable Servers, Enable Saas:
• Amazon EC2
–Basic “data center migration”
–Just another server type available
• Multiple AZs/Regions
–Part of multi-datacenter resiliency strategy
• Independently: SaaS usage increases
–Non-critical or internal uses first
The cloud seems to work pretty well…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Progressions in Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT Cloud Adoption StrategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enable Value-added Services:
• Managed Databases
–RDS, Aurora
• Other Managed Services
–Elastic Beanstalk, Amazon SES, Amazon SQS, ElasticSearch
Dynamic Cloud becomes a thing…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Progressions in Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT Cloud Adoption StrategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enable Unique Services
• High-value, Cloud-specific services
–AWS Lambda, Kinesis
–DynamoDB
–SWF, Elastic Transcode
–Redshift
• Point of commitment…
–… dependent on cloud
Dynamic Cloud is deeply ingrained…
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
Progressions in Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT Cloud Adoption StrategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Mandate Cloud Usage Usage
• Cloud as data center replacement
• Company is now “all in” with cloud
Why do we need our own data centers?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
Progressions in Cloud Adoption
Different Companies
Different Speed
Different Needs
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud Adoption Strategies
• Experiment
• Cloud Policies
• Enable Servers, Enable SaaS
• Enable Value-Added Services
• Enable Unique Services
• Mandate Cloud Usage
• Experiment / Peripheral Usage
• Cloud Servers
• Managed Components
• Unique Components
• Application Cloud Committed
Enterprise ITCloud Adoption Strategy
ApplicationCloud Adoption Strategy
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application
Adoption
Corporate
Adoption Cloud Adoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Policies
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed
CriticalApplications
NewApplications
Non-Critical/Internal
Applications
Step #1
Step #2
Step #4
First Steps
ApplicationRe-Writes
Step #3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment Servers Managed
Components
Unique
Components
Committed
First Steps
CriticalApplications
NewApplications
Non-Critical/Internal
Applications
Step #1
Step #2
Step #4
ApplicationRe-Writes
Step #3
RDSAmazon SES
IAMVPC
Non-IntegralSaaS
Amazon EC2
AWS LambdaKinesis
S3
IntegralSaaS
Cloud Adoption
Application
Adoption
Corporate
Adoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Policies
Experiment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adoption Sweet Spot
First Steps
Application
Adoption
Corporate
Adoption
Cloud Adoption
Center of Gravity
Experiment Servers Managed
Components
Unique
Components
Committed
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Policies
Experiment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
IntegralSaaS
RDSAmazon SES
AWS LambdaKinesis
Application
Adoption
Corporate
Adoption
Amazon S3
IAMVPC
Non-IntegralSaaS
Amazon EC2
Cloud Adoption
Center of Gravity
Adoption Sweet SpotMandate
Committed
Experiment
Allow Value-Added
Allow SaaS
Allow Servers
Policies
Experiment
Servers Managed
Components
Unique
Components
Committed
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How to be successful…
… migrating Enterprise apps to the cloud
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adoption Success Strategies
Understand your culture
Create aSolid Plan
Drive cultural change
Monitor your adoption
Understand your needs
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitor Your Adoption
Before Migration
Baseline application(servers, databases, caches, applications,
microservices)
Determine your steady state
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitor Your Adoption
During Migration
Incorporate cloud’s internal monitoring
Continue application monitoring
Understand and solve all deviations from steady state…
Performance Post Migration
& During Optimization
Pre-Migration Feasibility &
Benchmarking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Continue Monitoring…
Infrastructure is now out of your control
Understand application
impact
Ongoing application & infrastructure monitoring is
essential
Monitor Your Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
All Phases
Before Your Migration
Establish Your Steady State
During Your Migration
Understand and solve all deviations from
steady state…
After Your Migration
Ongoing application & infrastructure monitoring
is essential
Monitor Your Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Keeping Your App Running…At Scale
8
3
Dynamic Cloud…
... tools to make
availability happen.
Migration…
... how do I get my
app to the cloud?
Visibility…
… into your app
performance
Monitor your application and infrastructure
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring Just the Server
Worked When Rate of Change Was Low…
Amazon EC2 Instance
Server OS
Server (Virtual)Hardware
Application &Application Microservices
AWS CONSOLE
Amazon CloudWatch
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dev
Ops
Dynamic World
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (Virtual)Hardware
Application & Application
Microservices
Provisioning
Application & Application
Microservices
Application & Application
Microservices
BrowserMobile
Full Stack Monitoring – Full App Visibility
New RelicApplicationMonitoring
New Relic Infrastructure
Monitoring
DASHBOARDS
You need:
• Top to bottom monitoring…
• Visibility into your application operation
• Dynamic infrastructure control…
©2008–17 New Relic, Inc. All rights reserved#FutureStack
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The World is ChangingDynamic Cloud Enables Better Applications Faster
Traditional
Data Center
Cloud
Data Center
Dynamic
Cloud
Better Best
The way you’ve done things in the pastwon’t work in the future.
Good
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fireside Chat
Mark Kelly
Director of Cloud and Infrastructure
Services Architecture
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
THANK YOUVisit New Relic at booth #2412