23
We Built this City (Although not this one in particular…) Greg Brail, Gary Forrest, and Paul Kim

We built this city: Behind the scenes of Apigee Edge

  • Upload
    apigee

  • View
    622

  • Download
    4

Embed Size (px)

DESCRIPTION

Check out these slides from I Love APIs 2014 to learn how architects and engineers are building products at Apigee, and how we incorporate open source technology for enterprise grade apps: Cassandra, Postgres, Netty, Jersey, jQuery, Bootstrap, Tomcat, Puppet, Hadoop, Couchbase and more.

Citation preview

Page 1: We built this city: Behind the scenes of Apigee Edge

We Built this City(Although not this one in particular…)Greg Brail, Gary Forrest, and Paul Kim

Page 2: We built this city: Behind the scenes of Apigee Edge

2

Overview

• A little bit about architecture• How we monitor at Apigee• Some real data

Page 3: We built this city: Behind the scenes of Apigee Edge

A Little Bit About Architecture

Page 4: We built this city: Behind the scenes of Apigee Edge

4

We try to stick to our principleswithin reason

Page 5: We built this city: Behind the scenes of Apigee Edge

5

Principle: Eventual Consistency

Consistency

Availability

Partition Tolerance

RDBM

SCassandra

Zookeeper

Page 6: We built this city: Behind the scenes of Apigee Edge

6

Eventual Consistency Leads to…

• Better availability– Support for multiple regions and data centers– No downtime due to hardware or network failures– No downtime to replace a component

• Better scalability– Add nodes without downtime– Scale horizontally

Page 7: We built this city: Behind the scenes of Apigee Edge

7

Single- versus Multi-Tenant

Tenant A

Tenant B

Tenant C

Tenant A

Tenant B

Tenant C

Single Tenant Multitenant

Page 8: We built this city: Behind the scenes of Apigee Edge

8

A Little of Each

Tenant A

Tenant B

Tenant C

Tenant A

Tenant B

Tenant C

Tenant D

Tenant E

Tenant D

Tenant E

Tenant A

Tenant B

Tenant C

Tenant D

Tenant E

Inbound Routing API Call Processing Data Storage

Page 9: We built this city: Behind the scenes of Apigee Edge

9

Everything Should Have an API

Page 10: We built this city: Behind the scenes of Apigee Edge

10

Everything Gets Deployed to the Cloud;Most Things Get Deployed On-Premises

Page 11: We built this city: Behind the scenes of Apigee Edge

How We Monitor at Apigee

Page 12: We built this city: Behind the scenes of Apigee Edge

12

Traditional Monitoring – information silos

AlertsCustom Checks

* Product names for illustrative purposes only. No endorsement by Apigee is intended or implied.

Page 13: We built this city: Behind the scenes of Apigee Edge

A different approach – standard alerts

13

standard alert

Custom Checks

Event Processor

* Product names for illustrative purposes only. No endorsement by Apigee is intended or implied.

Page 14: We built this city: Behind the scenes of Apigee Edge

A different approach – standard alerts

14

standard alert

Problem Details Host, service,

metricActions-to-take Graph Playbook Escalation contact

Custom Checks

Event Processor

* Product names for illustrative purposes only. No endorsement by Apigee is intended or implied.

Page 15: We built this city: Behind the scenes of Apigee Edge

15

Monitoring ArchitectureSystem Being

Monitored

Event Stream Processing

Server(Real Time Alerting)

Notification IM chat, ticketing system,

email groups, phone

Monitoring Agent

Visualization

Queryable Metrics (CloudWatch, API,

Logs)

MonitoringAgents

api-curl-agent

cloud-lb-metrics

Page 16: We built this city: Behind the scenes of Apigee Edge

16

Support Ticket History

Page 17: We built this city: Behind the scenes of Apigee Edge

17

P1 Incidents Caught by Monitoring

Page 18: We built this city: Behind the scenes of Apigee Edge

Some Real Data

Page 19: We built this city: Behind the scenes of Apigee Edge

19

Sports News API

08/29 08/30 08/31 09/01 09/02 09/03 09/04

When did the 2014 NFL season start?

Page 20: We built this city: Behind the scenes of Apigee Edge

20

Online Ticket Business

Traffic spikes before events

Page 21: We built this city: Behind the scenes of Apigee Edge

21

US Retailer

Labor Day Weekend

Daytime spikes and higher on weekends

Page 22: We built this city: Behind the scenes of Apigee Edge

22

Mobile Application Monitoring5-day traffic view 12-hour traffic view

Page 23: We built this city: Behind the scenes of Apigee Edge

Thank you