Delivering Transformative Reactive systems on OpenShiftOpenShift Commons Briefing

21 March 2019

Karl WehdenVP of Product Strategy

Who is Lightbend?• Lightbend is the company behind open source

application frameworks Akka, Play & Lagom and the Scala programming language

• Lightbend Platform builds on these open source projects to create an application development platform and runtime for building modern, microservices-based distributed and real-time streaming applications

• Deployed on OpenShift

2

Lightbend Platform

3

Distributed Systems Architecture

Event-drivenReactive Microservices

Real-time Streaming & Machine Learning

End-to-End Monitoring & Management

Security & Risk Mitigation

Cloud native, data-centric application architecture

Lightbend Platform

4

The complete architecture for building and running applications optimized for a hybrid cloud infrastructure

What do we use this for?

Development of Stateful microservices

Development of streaming pipelines

Combining the two of these

Sample use case - hand-coded and operated

● Lots of Moving Parts

● Manually managed Kafka topics, serialization

● Schema?

● Hand-crafted and deployed Akka-based REST microservice

● Manual deploymentCluster

Why Lightbend Pipelines?

Developing streaming applications involves a lot of complexity

• Managing and composing applications• Dealing with multiple frameworks• Managing state within pipelines• Evolving applications• Serving Machine Learning models• Exposing streaming pipelines as (micro)service

Concepts

Streamlets: implement the actual stream processing logic.

Streamlets have different shapes, including ingress, egress, fan-in, fan-out, processors, and views.

Each Streamlet is strongly typed with inlet and outlet schemas

A Blueprint comprises a set of composed streamlets. An Application Blueprint can then be deployed.

{ Schema } Ingress

Streamlets

Egress

Cluster

Developer Experience - Workflow

Source Code (Streamlets)

Blueprint

Docker Image

Runtime

Code, Compose, Build (local) Push Images

Kubernetes Deploy

2

3

1

Demo 1• Lightbend Platform Demo: Streaming Options Risk

• Shows:• Example of stream data processing • Example of applied rulesets based on derived metrics

• Operator based deployment of Pipelines

• Runtime environment includes:• Lightbend Platform• Lightbend Pipelines• OpenShift• drools rules engine

11

Why Akka Streams?

Akka Streams is a DSL on top of Akka.

Akka uses the actor model to create stateful services. Actors are: • Message driven, stateful building blocks• Messages are passed asynchronously• Actors may create other actors• Actors form supervision hierarchies• Actors are lightweight and do not hold threads

12

Demo 2• Lightbend Platform Demo: Observable Stateful Services

• Shows:• Deployment of Stateful apps in a stateless manner

• The behavior of Reactive Applications on kubernetes

• Failure and recovery visualization

• Runtime environment includes:• Akka / Java• OpenShift

13

Direction of Travel

14

Delivery Code driven development

Configuration driven development

Visual configuration and development

Operations DevOps driven management

Deployment automation Auto architecture driven deployment

Lightbend PipelinesOrchestrate and Operate Multi-Stage, Multi-Component Fast Data Pipelines and Microservices

Features

1. Develop, compose, and operate streaming apps

2. Choose streaming engine that works for you

3. Automated provisioning and management

4. Expose streaming data pipelines as microservices

5. Support collaborative multi-team development

Benefits

1. Ingest, transform, analyze, serve data in real time

2. Focus on business logic - avoid boilerplate code

3. Transform legacy systems into fast data apps

Interested in trying it?https://www.lightbend.com/lightbend-pipelines-demo

Thank You

Interested in trying it?https://www.lightbend.com/lightbend-pipelines-demo

Karl@Lightbend.com@kfwehden