WTUI6 - Business Monitoring and Analytics in IBM Integration Bus

Business Monitoring and Analytics in IBM Integration Bus

John Wesley, IIB Industry Packs Team

© 2014 IBM Corporaton

Please NoteIBM’s statements regarding its plans, directons, and intent are subject to change or withdrawal without notce at IBM’s sole discreton. Informaton regarding potental future products is intended to outline our general product directon and it should not be relied on in making a purchasing decision.

The informaton mentoned regarding potental future products is not a commitment, promise, or legal obligaton to deliver any material, code or functonality. Informaton about potental future products may not be incorporated into any contract. The development, release, and tming of any future features or functonality described for our products remains at our sole discreton

Performance is based on measurements and projectons using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including consideratons such as the amount of multprogramming in the user’s job stream, the I/O confguraton, the storage confguraton, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

2

Agenda

The Predictive Enterprise• Business Monitoring in Integration Bus• Record and Replay• Using Business Rules and ODM• Business Monitoring futures

© 2014 IBM Corporaton 3

Business Monitoring

Business applicatons rely on informaton exchange Applicaton to applicaton Web to Order system

Business data passes through IIB IBM Integraton Bus has full visibility of data content in all

formats Can emit events that include the data payload as well as

the transacton status


Business Monitoring is not Technical Monitoring Business Monitoring

Things that are valuable to the business

• Key performance indicators

• Transactons / Sales

Technical Monitoring Stll valuable to the business but more infrastructure

based

• Load / throughput rates / messages per second


The Predictive Enterprise

What is the Predictve Enterprise Comparing what is happening right now with past

experience to predict the future. Pro-actvely make changes to the business based on

forecastng Antcipate changes before they occur Build insights based on stored and real tme data


MQTT

EMR patient records

Ward monitor

Patient dashboard

ClinicianMedical device

I/P HL7 MQTT MQTT

PredictingAnalytics Engine

DecidingRules Engine

Medical device

MQTT

Bed Mgmt

MQ

IntegratingIntegration Bus


A Healthcare Example

Patient dashboard

MQTT

EMR patient records

Ward monitor


I/P HL7 MQTT MQTT



Medical device

MQTT

Bed Mgmt

MQ




Patient dashboard

MQTT

EMR patient records

Ward monitor


I/P HL7 MQTT MQTT



Medical device

MQTT

Bed Mgmt

MQ




IIB in the Predictive Enterprise


EventsMobile CloudMainframe FilesProcesses Sensors PartnersDataApps Services

100101001101011101101

Access relevant real-time and historic informationAccess relevant real-time and historic information

Sense what’s happening across business

Generate model Proactively optimizeAnticipate outcome

IBM SPSS Modeller

IBM Operatonal DecisionManagment

IBM Integraton Bus

IBM MQ Messaging

IBM SPSS Scoring Server

Business Monitoring in IIB

Events are published to an MQ topic Allows multple subscribers Permits levels of informaton granularity from Message

Flow up to Domain

Event format is XML Uses a published schema designed to be compatble with

Common Base Event (CBE) Allows entre message to be captured and stored for audit

purposes


Business Monitoring outside of IIB

Events can be sent to monitoring tools Integrates other tools; e.g. IBM Business Monitor, BMC

Middleware Management A message driven bean is provided with the monitoring

sample The bean is hosted on WebSphere Applicaton Server and

wraps the IIB event with a Common Base Event wrapper. Submits event to the CEI server


Business Monitoring Events in IIB

Message Flow events Transacton events (input nodes only)

Transacton Start Transacton End Transacton Rollback

Terminal Events Any terminal in the fow can be an event source

All events are optonal and confgurable Events can contain data from the message


Monitoring Event Configuration

Events can be confgured in two ways Message Flow editor

Simple to use Monitoring panel available on all nodes. Can export this to a monitoring profle

Command line Using a monitoring profle confgurable service Allows events to be customized without re-deploying the

message fow.


Configuring a Monitoring Event






Monitoring Event Contents

Event ApplicatonData

User specifed simple or complex data BitstreamData

Payload of the message EventPointData

Broker Executon group Message fow Node


Monitoring Event Contents


Monitoring Summary

PubSub based with granular topic strucure Confgured at development tme or runtme Includes all the data


Record and Replay

Built in functonality to record and replay in-fight data Universal support for File, Messaging, Web Services, ERP

and other data Browser based tooling for ease of access Multple data formats; binary, text, XML Sensitve informaton can be encrypted as necessary Messages replayed via MQ queue


Record and Replay Lifecycle


HTTP/REST

ODBCData source

Record and Replay Internals

Built on Business Monitoring Event emission can be confgured at design tme or

operatonally Customizable payload allows for capture of entre bit-

streams or only required elements

Defned by a Confgurable Service Uses IIB server (executon group) for processing Subscribes to the monitoring topic


Record and Replay - Recording Data


Record and Replay - Querying

Web Browser based– Sophistcated fltering of events

Fully secured using HTTPS Public REST API available


Record and Replay - Replaying

Driven from the Web UI Messages can be submited to MQ queue for

reprocessing or retransmission Destnatons predefned by DataDestnaton confgurable

service User selects message and target destnaton for redelivery


“Deliver MSGID ‘x’ to destination ‘MYDEST’WMB

HTTP/ REST

Record and Replay - Replaying

Replay to the same or diferent node Entry points can be defned operatonally

Replay scenarios may require a diferent path Message fows may need to be authored diferently


Record and Replay - Scaling

Supports full multplicity of all components Multple recorders, re-players, viewers Minimal performance impact


Broker 1

Broker 2

Broker nViewingBroker

RecordingBroker

REST

Events

Record and Replay - Correlation

Business monitoring can emit correlaton identfers Correlaton identfer can be specifed Data Viewer can display correlators Fields can be renamed for ease of understanding


Record and Replay - Customisation

Views can be customized Column names changed to suit the business Performed from the Web UI Customizaton is persisted


Record and Replay - Tuning

Recorder designed for high throughput Split the topic namespace to spread load Each DataCaptureStore has a thread pool Can re-assign capture sources to diferent stores and

diferent servers

All required confgurable service are dynamic


Record and Replay - REST

Web Interface uses the REST API


V8 / V9 Broker

Web User

GET /admin/eg/MYEGNAME

POST /admin/messages/MYDATASOURCE/MSGID

http/s port

Record and Replay Summary

Builds on Monitoring Can be used for audit, logging and error

handling Allows data to be correlated Web based UI for querying and replaying


Using Business Rules and ODM

Business Rules Business rules provide a natural language means of

automatng frequently occurring decisions

Operatonal Decision Manager Provides a runtme for natural language based business

rules


Business Rules in IIB

Represented by Decision Services Rules can be authored in the Integraton Toolkit or ODM

tooling environment Uses xsd schema or simple xsd types to confgure the

decision service parameters Natural language editor equipped with context sensitve

help to construct rules Schema feld names pulled in as variables that can be

manipulated by rules


Decision Service by Example














Business Rules Summary

Represented by Decision Services Easily authored in the Integraton Toolkit Just a node in the fow Can be paired with the Route node for simple

routng to subfows


Summary so far...

The Predictve Enterprise– What is it?

Business Monitoring in IIB– Nodes, Events, Data, Data, Data

Record and Replay– Hmm why didn't that work?

Rules and ODM– Write programs that make decisions using words!


IBM Integration Bus v10 Open Beta

Business Transacton Monitoring


What happened to order number 1234?

Which order requests have not completed in

the last 24 hour?

How many orders took longer than 2 minutes

to complete?

What orders for more than £1000 did I get in the last

5 minutes?

Business Transaction Monitoring

What is a Business Transacton?– A set of fows seen as a unit of functon from the business

perspectve

– Examples

• Customer Order

– Flows: ValidateOrder, CustomerType, GoldCustomer, Regular Customer, Purchase complete

• Stock Check

– Flows: VerifyStock, InitateRefll, OrderReceived, UpdateInventory






Which order requests have failed?



Where did order 007 get stuck?

BTM Internals – Setup

Monitor a group of fows as a common integraton soluton– Group events from a single request (e.g. custom order)

– Report the results of a BT as a unit

Builds on existng correlators for monitoring events– Local ID links events from the fow invocaton

– Parent ID links events from fow to parent

– Global ID links events between fows


BTM Internals – Correlation


BTM Internals – Workflow


*Monitoring events defined in IIB toolkit or by applying flow monitoring profiles

Create Business Transaction Definition

Define a business transaction recorder policy and attach it to a Server

Runtime records and correlates

Flows

run

Business user checks transactions IT personnel investigates problems

Business Txns And Events table

BTM Internals – Create


BTM Internals – Save


BTM Internals – Add flows or Apps


BTM Internals – Add event definitions


BTM Internals – Define start and end


BTM Internals – Done



Analytcs Node– Uses R

– Scalar variable types: double, integer, character (string), logical (boolean)

– Data frames can be considered like database tables, consistng of typed and labeled columns with unlimited rows

– Xpath support for selectng input and output trees




Score

In Summary then....

IIB current monitoring solutons

– IBM Business Monitor Integraton

– Record and Replay

IIB Decision making capabilites

– ODM

IIB Future monitoring solutons

– Business Transacton Monitoring

IIB Future Analytcs

– R node© 2014 IBM Corporaton 61

The End

Thank you all for coming

Questons?


© 2014 IBM Corporaton

For Additonal Informaton IBM Training

htp://www.ibm.com/training

IBM WebSpherehtp://www-01.ibm.com/sofware/be/websphere/

IBM developerWorkswww.ibm.com/developerworks/websphere/websphere2.html

WebSphere forums and communitywww.ibm.com/developerworks/websphere/community/

63

http://www.ibm.com/training

http://www-01.ibm.com/software/be/websphere/



http://www.ibm.com/developerworks/websphere/websphere2.html

http://www.ibm.com/developerworks/websphere/community/

http://www.ibm.com/developerworks/websphere/community/

Technology

WTUI6 - Business Monitoring and Analytics in IBM Integration Bus