Dutch Oracle Architects Platform - Reviewing Oracle OpenWorld 2017 and New Trends in Architecture

Reviewing Oracle OpenWorld 2017 and the new architecture trends

Dutch Oracle Architects Platform

AMIS Oracle OpenWorld 2017 Review – October 20171

Tuesday 28th November, Nieuwegein, The Netherlands

Overview

• The Only Way is Up – High and Low [PaaS]

• Microservices, DevOps & Cloud Native

• The Road to the Cloud

• Hybrid: Security, H/A, Ops

• Integration

• Application Development

• Data [Store] Proliferation and Commoditization

Gartner Hype Cycle for emerging technologies – July 2017

3

Gartner – Strategic Technology Trends 2018

Titel van de presentatie 4

Our world is changing rapidly

Oracle OpenWorld 2017 Review - Wrapup 5

Architecture Evolution• Stateless

• Event driven

• Horizontally Scalable

• CQRS & Event Sourcing

• Streaming

• Reactive

• Container

• Cloud Native

• Microservice

• Orchestration &

Choreography

• API

• Service Mesh

• Mash Up

• SaaS Enablement

• Serverless

• Fault Injection Testing

6

Technology & Products to watch out for• Container

• Kafka

• Kubernetes

• Docker

• Cassandra

(DataStax)

• Istio

• GPU

• Ansible

• Terraform

• Vagrant

• Sonar Qube

• Jenkins

• Quay (CoreOS)

• Kibana

• Travis CI

7

• CI/CD (Pipelines)

• Go

• Rust

• Ruby

• Python

• R

• HTTP/2

• Cloud Foundry

• Prometheus

• Vizceral

• Grafana

• Zipkin

• Elastic Stack

• Hadoop

• Spark

• Helm

• Hyperledger

• Git

• PDB

• ORDS

• TypeScript

• Graph QL

• NoSQL

• Slack

• Pagerduty

• OAuth

• Redis

• Alexa

• Tensor Flow

• DL4J

• Caffe

• Keras

• AI

• ML

• NLP

• Voice

Recognition

• Intelligent Bots

• BYOL

• TCO

• FaaS

• CDN

• IoT

• Blockchain

• CNCF

• Polyglot

• Java

The Only Way is Up

It’s not if, it’s when

It’s not later, it’s sooner

Titel van de presentatie8

Smart Business

• Organizations should only invest in things that

• Allow them to create business value

• Set them apart from the competiton

• Are close to their core expertise

• Are a unique risk

• For most organizations these things do not include

• Managing computers, investing in hardware

• Managing operating systems or databases

• Building custom software

In X Years’ Time

• No organization can justify to have and manage their own IT

means

• To invest capital in infrastructure & platform licenses

• To employ staff to run infrastructure, platforms (and create

custom software for non-unique functionality)

• To not leverage commodity IT with superior quality and

economies of scale based pricing

The only way is up

• From buy (for peak load) [software & hardware)

to usage based rent

• From on premises to cloud

• From infra and platform

to SaaS (standard applications)

• From pay based on IT metrics

to pay per Business measure IaaS

PaaS

SaaS

On Premises

Oracle’s Cloud Strategy


SaaS

High PaaS

Low PaaS

IaaS

CX ERPSales HCM

Management

CloudAnalytics

Cloud Integration

Cloud

IoT

Apps &

Cloud

Block

Chain

Big

Data &

AI

Developer

Cloud

Mobile &

IB CloudCASB &

IDCS

Managed

Kubernetes

Container

Cloud

Managed

Serverless Event

Hub Data

HubMySQL

ACC NoSQL

Autonomous

Database (DWH,

OLTP, IoT,…)

ComputeNetworking

Storage

MessagingCDN

DNSLB

Integration

Platform

Cloud

API Platform

Cloud

EPM Supply

Chain

Industry

specificSaaS

Analytics

DaaS

Obvious Deficiencies in Oracle Cloud

• BYOL

• Truly managed services with high availability and real SLAs

• Clear insight in costs (especially before finalizing the solution)

• Free tier

• Stepless pay per use

• Monetization (aka bill on behalf)

• Full automation – APIs/scripting

• Cross cloud monitoring & alerting

• Integration between cloud services

• Obvious Generic Cloud Platform capabilities

• Great User Experience in Cloud Ops

13

Future Observations

• Each organization works with

hybrid multi-vendor cloud

• Many niche SaaS solutions used in any organization

• Data proliferation across clouds & across types of data store

• PaaS services increasingly similar across cloud vendors

• Some key challenges:

• Designing multi-service & multi-cloud solutions (and exit

plans)

• Integrating PaaS services and SaaS functions

• Monitoring & Ops across clouds and services

• Security

Microservices, DevOps & Cloud Native

plus: Serverless

The Application Platform of the future


What is IT all about?

Application

Production Runtime


Application

Production Runtime

Platform


Application

Production Runtime

Platform

Operations

Monitoring &

Management

One team has Agile responsibilitythrough full lifecyle

Application

Production Runtime

Platform

Operations

Monitoring &

ManagementApplication

Preparation Runtime

Platform

Development

CD

Agile Design,

Build, Test


Application

Production Runtime

Platform

Monitoring &

ManagementApplication

Preparation Runtime

Platform

CD

Agile Design,

Build, Test


Application

Platform

Application

Platform

DevOps team owns and runs one (or more) products

Application

Platform

Generic Infrastructure Platform for running DevOps Products

Floorspace, Power,

Cooling, Storage,

Compute

Monitoring, Management,

Cache, Authentication,

RDBMS, Event Hub

Application

Platform

Application

Platform

Application

Platform

Application

Platform

Multiple products from multiple teams run on a shared generic infrastructure

Application

Platform


Floorspace, Power,

Cooling, Storage,

Compute

Monitoring, Management,

Cache, Authentication,

RDBMS, Event Hub

App plus platform under DevOps == Microservice


µ µ µ µ µ

App plus platform under DevOps == Microservice• Stateless

• Horizontally scalable

• Mutually Independent

• upgrade, patch, relocate

• Can expose Public API (HTTP/REST)

and/or UI

• Communicate with each other through events

• Have their own bounded data context

• Do not rely on other microservices [for the data they need]

• Serverless – do not require allocated server, can be fired up


µ µ µ µ µ

Once upon a time –a container based microservice

Container and Cloud Native & Serverless 26

µ

http requests

Where is the container running?

• Any Docker Host – on premises or cloud based VM - or a Container Cloud Service

• For example: Oracle Container Cloud Service


µ

How did the container start running in the runtime? • Through a CI/CD Pipeline

• Build process

• Take a Basic runtime image – e.g. Linux plus Some Language VM

• Add application code

• Add runtime agents and tooling

• Add platform/runtime configuration

• Then Build the Image

• Test the Image

• Tag and Push Image to Registry

• Deploy the image plus applicable configuration to a specific destination

container runtime environment

• The CI/CD Process is managed manually or triggered by development

event


µ

Wercker: Build, Test, Push and Deploy Pipelines for Containers


µµ

µ

Where is the container image stored after build – prior to deploy?• Somewhere in a registry

• That is secure (because runtime artefacts)

• Low latency to container runtime

• Scalable

• Smart (no duplicate images and image layers)


New component in container native platform:Oracle Container Registry Cloud Service


µ


• docker run -d -it –-name ORA12201_1

–P container-registry.oracle.com/database/enterprise:12.2.0.1


How is availability - scaling, patching, fail-over, load balancing – taken care of?• Mapping of distributed physical resources to microservices and containers

• Container Management Platform

• Does deployment, scaling, (rolling) upgrades

• Also load balancing and routing

• Injection of run time settings

• Kubernetes!


Oracle Container Engine Cloud ==Managed Kubernetes Service


Container Registry, CI/CD Pipelines and Engine


µ

µµ

µ

µ

Container Native MicroservicesRuntime Platform

Managed Kubernetes

Open Service BrokerEvent ManagementAPI Registry

Foo2

IST

IO

Developer

Cloud

Cache

RDBMSLDAP/IdM NoSQL

Billing

EngineBlock

Storage

Voice

Recognition

µ

Operations for container native runtime platformFrom ‘service mess’ to Service Mesh

• Support insight in and control over [micro]service interaction

• Service discovery, intelligent routing, staged rollouts

• Load balancing, rate limiting, circuit breaker, time out & retries

• Access policies, auditing

• Monitoring & error analysis


µ

µ

µ

µ

µ

µ

µ


Oracle Container Native Microservices Architecture

Managed Kubernetes


Foo2

IST

IO

Dia

gn

ostics/M

on

ito

rin

g

IST

IO

Developer

Cloud

Prometheus

ISTIO

µ

CacheRDBMS

LDAP/IdM NoSQL

Billing

Engine

Block Storage

Voice

Recognition

Cloud Native & Vendor Neutral

• Cloud Native Computing Foundation - CNCF

• Oracle is a platinum member since July 2017

• Cloud Native: container packaged, dynamically managed, microservices oriented

• Open technology for running container based workloads in a cross cloud vendor neutral

way


“Carry water and

chop wood”

(that is how Oracle will approach

open source projects

and developer communities)


Container Native at Oracle - Low PaaS


Stack for Full Life Cycle of Containers (and Microservices)


Serverless


µ

Open Source ServerlessFunction Platform• Functions can be implemented in any

language

• Java, Go, PHP, JavaScript/Node,

Python, Ruby

• Functions run in their own container

• Functions can be accessed via HTTP calls

• Routing, load balancing, running is

taken care of by Fn Server platform

• Platform runs locally, on prem & in cloud

• Fn Flow orchestrates workflows across

multiple functions

• Workflow described in Java

• Includes business logic (conditional,

parallel execution, exceptions)


µ

Managed Serverless Platform on Oracle Public Cloud


µ

The application platform foundationof tomorrow – according to Oracle


Long and Winding?

Migration strategies, HA, Monitoring, security, Costs and more.

Road to the Cloud


Six Oracle Journeys to the cloud

OK, Cloud... But, How? Scenario's & Connectivity 49

Actions that contribute:

• Implement / migrate to the latest versions/patches

• ODA (or other Engineered Systems) for standardization of DB’s & VM’s

• Centralize management of IT landscape

• Automate deployments of platforms (e.g. Puppet, etc.)



Journey 3: MAA extended with hybrid cloud solutions

Many way’s to move&improve workloads:

New hybrid solutions in Maximum Availability Architecture

• Oracle Database HA Hybrid solutions

• Prod on prem, Oracle DB backup CS to backup in cloud

• Prod on prem, Oracle Dataguard for DR in cloud

(active DG far sync for long distance)

• Prod on prem, Oracle Golden

Gate CS for DR in cloud




Possible hesitations for the journey

• Security

• Centralized management

• Data security

• Posession of on-premises licenses

• No exit strategy on product use

• Availability / SLA


Security@OOW2017

Requirements for a secure cloud:

• Zero-trust design

• Must prove legitimacy

• Cloud provider cannot access, modify or delete your data

Oracle cloud security guiding principles

Need better security? Move to the cloud! 54

Security@OOW2017: Identity SOC – Security Operation Center

• SIEM (Security Information and Event Management)

gather all relevant information from log data, threat intelligence, etc.

• CASB (Cloud Access Security Broker)

What is happening (per identity/asset) in other clouds/systems?

• UEBA (User & Entity Behavior Analytics)

Combine and analyze to detect suspicious behavior and risks


Security@OOW2017: Identity SOC

• Base is IDM (IDentity Management)

• Uses Analytics and Machine Learning

• Cross-cloud & Hybrid cloud solution (multiple cloud vendors & on-premise)


Security@OOW2017: OMC

Part of Oracle Management Cloud


Security@OOW2017: OMC

• Unified Monitoring of entire (multiple) Cloud & On-Premise Stack

• Log Analytics

• IT Analytics

• New: Integration with Enterprise Manager

• Centralized Log Search

• Operations and performance analytics

• Dashboards

• (planned) Federation monitoring (Single Pane-of-glass,

configuration compliance, consolidation of jobs

and deployment)


Security@OOW2017: Preview Data Security CS


Oracle Open World 2017 Review 60

Possible hesitation: on-premises licenses


Possible hesitations: pay per product

Universal Credits

• Universal access to all current and future

IaaS & PaaS services

• Monthly or annual dollar volume commitment

determines discount

• Flexibility to upgrade, expand or move

services across datacenters.

Public Cloud / Cloud@Customer


Possible Hesitations: Availability

Techniques Autonomous

Database:

• Active Data Guard

• Redefinition

• Flashback

• Real Application Cluster

SLA : 99.995 %

• < 2,5 minutes downtime a month

• Includes patching, upgrades, bugs, regional outages

• Minimal brownout for maintenance


How much? https://cloud.oracle.com/en_US/cost-estimator


Oracle vs Amazon AWS - strategy

The Only Way is Up ?


Question:

Why not ?

Current

Situation

<slide to

position

2019>

Current

Situation

<slide to

current

position>

66Oracle CVC visit – Henk Steendam- Sr Architect- IT services 21/11/2017

On-premise to Cloud – Oracle’s viewM

atu

rity

/Ca

pa

bili

ty

time

Cloud-native

Proposition

On-Premise

Product

Generic picture

Questions to be answered:

1) Where does Oracle position itself now

2) Where does Oracle position itself in

2019

3) Which developments are in progress

for the on-premise product

(roadmaps)

4) Which developments are expected for

the on-premise product

5) What would be the right time to switch

6) What are the migration possibilities to

switch (wizard?)

7) Usage of product by Oracle itself

1 2

3 4

5

6

Real Case scenario – down to earth…

- Small Oracle Environment, < 15 production databases

- Hardware beyond end-of-life

- Windows 2003 /Oracle db 10 / Oracle SOA Suite 10.1 /Forms6i – cl. server

- Geographically configured RAC

- No Life Cycle Management, no cloud experience, immature IT

Management decision:

- Short term (months): risc mitigation for the hardware

- Long term: no more owner of datacenter, cost reduction, if cloud then

Azure.

- RTO / RPO 4 hours

Questions:

- Short term: cloud or not

- HA solutionTitel van de presentatie 67

Integration

On Premises Cloud[s]


Typical Integration Requirements

SaaS X

PaaS X

SaaS Y

Custom

App B

On Premises

3rd Parties/Public Internet

B2B Partner

Gov Agency

ERPCustom App A

Data

Warehouse

Workflow

Mobile App

for service

engineers

APIs

Workflow

Mobile App

for service

engineers

Data Warehouse

Addressing IntegrationChallenge with Oracle PaaS

SaaS X

PaaS X

SaaS Y

Custom App B

On Premises

3rd Parties/Public Internet

B2B Partner

Gov Agency

ERPCustom App A

API

Platform

SOA

Messaging

Integration

Cloud

Event Hub

Application

CC

Container

Cloud

Functions

IOT

ICS Agent

SOA Suite

Data Integration

Platform Cloud

GG Agent

OMC

ManagementSelf Service

Integration

MCS

Big Data

Compute

Oracle Cloud Platform for IntegrationIntegration Cloud plus API Platform



Core Integration


Integration Patterns


Connectivity – Adapters plus Agents


Converter Tool from On Premises [OSB &] SOA Suite to Integration Cloud

• Converter tool can provide a head start to go to Integration Cloud

• Imports a SOA composite model and related artifacts and creates

Integration and Process Project Models and associated connections etc.

• Placeholders for manual

modeling of alternatives

where conversion not feasible

• Scope

• SOA Suite

• OSB?

• Status

• Early days

• Timeline


Upcoming innovations


Process

• Robotic Process Automation

• Turn simple human workflows into APIs that trigger ‘robotized UI actions’

• AuraPlayer did something similar for Oracle Forms based Uis

• Best Next Action

• Visual and Standards based Business Rules:Decision Modeling (DMN

and FEEL)

• Expose Decision Rules as REST Service

• AI powered predictive workflow intelligence

• Adaptive Case Management aka Dynamic Processes

• CMMN based visual modeling

• AI integration

• Build task UI using Visual Builder Cloud


API Platform Cloud

• Design

• Mock

• Implement

• “Decorate” with policies

• Route, authorize, validate, rate limit, …

• Monetize?

• Gateway rollout

• Publication

• Runtime Management & Monitoring

• Analysis

• Governance

• Note: new partnerships:

• API Fortress

• APIMATIC


Self Service Integration

• Hook Social Media and SaaS

• Into PaaS and SaaS

• By Business End User

• Through recipes

• Similar to IFTTT

• And WebHooks

• Connects to Oracle PaaS:

• ICS, PCS, BIC, C&E C

• And Oracle SaaS

• Eloqua, Sales Cloud, Service Cloud,

Responsys


Data Integration Platform Cloud


Data Integration Platform Cloud


Data Integration Platform Cloud - Vision


Application Development

Oracle’s Vision on Business Applications

User Interface & SaaS Enablement 85


http://tinyurl.com/dayofux

https://www.youtube.com/watch?v=NMm_cIHeEZ0&feature=youtu.be

https://www.youtube.com/watch?v=NMm_cIHeEZ0&feature=youtu.be

Ever expanding SaaS portfolio


Smart, Multichannel Human-System Interfaces


UI Implementation with Oracle PaaS

SaaS X

PaaS X

SaaS Y

Custom App B

On Premises

3rd Parties/Public InternetB2B Partner Portal

WebShop &

Customer Service

Web & ChatBot

ERPCustom App A

Mobile App

for service

engineers

UI for Planning Staff

Workflow

API

Data

Visualization

Intelligent

Bots

APEX

on

DBaaSVisual

Builder

PCS

Mobile

ADF on

JCS

JET on

ACCS

Form, ADF,

APEX, JET

Conversations

/Social

Network

MAX

Content &

Experience

Analytics

Most striking

• JET

• JET 4.0 (New custom element syntax, CDN, CLI, improved UI components)

• Upcoming RDK from OAUX team

• Visual Builder Cloud

• MAX

• Offline

• Mobile Cloud


• RDK from OAUX team for Conversational UI

• ADF

• APEX

• Forms

• SQLcl (& SQL Developer)

Java

• Java 9

• Fast, scalable, tailormade runtime

• Modularity

• Asynch, Reactive

• Java EE 8

• EE4J

• Java by far largest platform/language

• the switch from <...> to Java

• Graal VM

• Polyglot & Java on Java

• Twitter


Developer Cloud

• Organize the work

• Plan, track, document

• Manage the software artefacts

• Git, Branch/Merge/Pull Request

• Browser based code review [and edit]

• Build, Test and Deliver

• Docker, SQLcl, Maven, Ant

• WebLogic, ADF, SOA Suite, Jdeveloper libraries & deployment

• Provision, configure and operate cloud environments

through psm [PaaS Service Manager] and Stack Manager


News for Database Developers

• ORDS

• REST SQL, REST for OPS, REST Driver, Swagger Support

• Oracle Database 18c XE – (almost) all options incl 4 PDBs

• 12 GB storage (and compression), 2 GB SGA, 2 CPU

• Database Free Cloud Service (1 GB storage)

• Polyglot Database (powered by Graal VM)

• Expose JavaScript NPM modules as PL/SQL functions(Download: http://www.oracle.com/technetwork/database/multilingual-engine/overview/index.html)


http://www.oracle.com/technetwork/database/multilingual-engine/overview/index.html

Data [Store] Proliferation and Commoditization

Data everywhere, plethora of data stores


When things were simple…

95

RDBMS

SQL

ACID

Data

files

Log

FilesBackup

BackupBackup

SAN

Then Stuff Happened

96

Middle Tier:

Java EE (Stateful) application

Client Tier:

BrowserClient Tier:

Browser

Client Tier:

Browser

Mobile App

(offline)

Mobile App

(offline)

Mobile App

(offline)

Data

Warehouse

XML,

JSON

Content

Management

Big Data

Fast Data

API

APIAPI

µ λ

SQL is not good at anything

• But it sucks at nothing

97

Datastore proliferationFrom one brand SQL to pluriform SQL & No(n)SQL

RDBMS

SQL

ACID

99

Differentiation (not all data are created equal)• Value

• TCDO

• Availability

• Freshness

• ACIDity & Consistency

• Integrity

• Location

• Security

• Volality & Speed

• Performance

• Origin & Ownership

• Retention

• Usage

100

Rise of CQRS - Command and Query Responsibility Segragation• Data manipulation and retrieval in separate places

• (physical data proliferation)

• For performance and scalability, lower license fees and TCO

Active Data Guard

Standby

CQRS –Common concept in Oracle Database

SAN

Middleware Middleware Middleware

TT

MVMV

id

x

id

x

IMDB

RAC RAC

Shard

(12c R2)

Shard

(12c R2)

SAN

SAN

dbf

SGA

Event SourcingState is Sum of Changes

103

Event Log in Event Sourcing

104

• Primary Data Source is ledger of change events

• Not a store of the current state

• However: optionally use snapshots of baseline (state up until time)

• Entity Event Store replaces Table

• Offers a simple API for creating and retrieving events

• ‘Entity Change Event’ Producer (to which consumers can subscribe)

• To correct a mistake:

• Do not remove the event! (it happened, it may already have been

distributed)

• Instead, create a compensating event (and then it unhappened)

• Microservices are stateless & horizontally scalable

• Microservices are isolated & independent

• Where is their data?

• What about lookup data?

• Data not owned by the microservice –

but still required by it to perform its role => bounded context

Data in microservices

µ

Cache

RDBMSDocument

StoreNoSQL

Generic Platform for running microservices

Event Hub

Big Data

Block

Storage

LDAP

Microservices State

• Micoservice needs to be able to run independently

• It needs to contain & own all data required to run

• It cannot depend on other microservices

API

Customer

APIUI

OrderCustomerModified event

Bounded context in microservices

What to do next/first?

• Microservices &

Serverless

• Docker

• Kubernetes

• Istio

• Java

• Node/ES6

• Python

• REST/JSON

• Kafka

• Hadoop/Spark

• Fn & FnFlowOracle OpenWorld 2017 Review - Wrapup 108

• Integration Cloud

• IoT

• Management Cloud

• Oracle Cloud Infrastructure

• API Platform & Apiary

• Wercker CI/CD, Container

Engine & Managed Serverless


• Oracle JET

• Database 18c

• SQL

• Networking

See you next year…!

Oracle OpenWorld 2017 Review - Wrapup109

Software

Dutch Oracle Architects Platform - Reviewing Oracle OpenWorld 2017 and New Trends in Architecture