17
How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF WEBINAR SERIES Neeraj Poddar Platform Lead

How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and CortexCNCF WEBINAR SERIES

Neeraj PoddarPlatform Lead

Page 2: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation2

Service A

Container 1

Microservices Without a Service Mesh

Flask

OpenTracing Flask

Kingpin

Lemur

Open SSL 110d

Python

Service B

Container 1

http.createServer

Jaeger

Zoologist

Express

Open SSL 102l

Node.js

Service C

Container 1

Spring

OpenTracing Spring

Disco-java

Ribbon

Open SSL 110f

Java

Page 3: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation3

Service A

Container 1

Microservices With a Service Mesh

Flask

Service Mesh

Python

Service B

Container 1

http.createServer

Service Mesh

Node.js

Service C

Container 1

Spring

Service Mesh

Java

Page 4: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation4

Service Mesh Architectures

Page 5: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation5

Service B Service C

Container 2 Container 2

Service A

Container 2

Container 1

Microservices with Istio

Flask

Python

Container 1

http.createServer

Node.js

Container 1

Spring

Java

Istio Control Plane

Config data to EnvoysPolicy,quota,telemetry

TLS certs to Envoys Monitors K8s for new pods to inject Envoy

EnvoyEnvoyEnvoy

Mixer Citadel Sidecar InjectorPilot

Page 6: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation6

Istio Features

A bundling of capabilities

• Service discovery• Load balancing• Advanced traffic management• Enhanced security• Policy• Tracing• Metrics

Page 7: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation7

Benefits of Tracing

Service dependency analysis

Track requests across multiple microservices

Identify performance bottlenecks

Page 8: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation8

Tracing with Istio

• Automatic tracing of all network requests• Context handling• Asynchronous span reporting

– Start and end times

– Source & destination service– HTTP headers

• Application header propagation• Multiple backend integrations

– Zipkin– Jaeger

Distributed Tracing with Istio in AWSTracing gRPC with Istio

Page 9: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation9

Jaeger

• OpenTracing compatible API• Flexible & scalable architecture• Multiple storage backends

– Cassandra– Elasticsearch

• Advanced sampling• Accepts Zipkin spans• CNCF project & active OS community

• Great UI

Page 10: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation10

Jaeger UI

• Jaeger has gained the most traction and is what we use– CNCF project– Thriving community– Great UI

Page 11: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation11

Benefits of Metrics

Monitoring & alerting

Debugging & fault analysis

Historical view

Page 12: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation12

Metrics with Istio

• Envoy stats– Request Pending– Connection bytes buffered– SSL failures

• Mixer service stats– Request latency– Request counts

• Custom metrics• Telemetry monitoring options

– StatsD– Stackdriver– Prometheus

Envoy Sta ts O verv iew

Page 13: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation13

Prometheus

• Pull model• Flexible query API• Efficient storage• Dashboard integrations

– Grafana• Exporters

– Prom etheus In teg ra tions

• CNCF project & strong OS community

Page 14: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation14

Enhancing Prometheus with Cortex

• Long term durable storage– AWS DynamoDB– Bigtable– Cassandra

• Scalable Prometheus query API• Multi-tenancy• Easy to manage• Intent to add as CNCF project

Page 15: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

© 2018 Cloud Native Computing Foundation15

More on Getting the Most from Istio

Istio 0.8 Release• Stability & Scalability • Envoy v2• Istio v1alpha3

We are active users of Istio and are happy to talk in greater depthPlease feel free to reach out: • [email protected]• http://aspenmesh.io/blog

v0.8 release

Page 16: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

Questions

Page 17: How to Gain Insights from Istio by Leveraging Tools Like Jaeger, … · 2020. 8. 31. · How to Gain Insights from Istio by Leveraging Tools Like Jaeger, Prometheus and Cortex CNCF

Thank You