Immediate and Streaming: Analytics for Today's Digital Enterprise

Kim MacPherson, Director of Analytics Engineering, Data and Analytics Group, Cisco

Immediate and StreamingAnalytics for Today’s Digital Enterprise

2© 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential

Data

Effectively capturing, storing,

and analyzing data generated

by connected “things” (e.g.,

machines, devices, equipment)

Things

Connecting the right “things”

(e.g., machines, devices, equipment)

to capture useful data

Process

Updating our business and operational

processes to

benefit from IoT solutions

People

Enabling workers to effectively

use IoT solutions through means

such as training and providing

user-friendly systems

1230 Respondents

Source: Cisco Consulting Services Global IoT Study, 2014

20%

27%

13%

40%

Getting insight from Data is the Biggest Challenge


Unstructured DataStructured Data Data Streaming at the Edge

Traditional

Data Warehouse Big Data Store

A New Approach is Needed to Reach and Analyze That Data

REAL-TIMELONG-TERMSHORT-TERM

Make a Decision NOWMake a Decision TodayPlan for a Business Decision


“Most data will be

processed at the edge”(mobile devices, appliances, routers)

Digital Enterprises See an Explosion of Data at the Edge

37%

Widely Distributed, Streaming, Short Shelf Life, Too Big to Move

Three years from now, where will most data generated by IoT solutions be processed?


Our Data & Analytics Focus Areas

Network

Collaboration

VideoStreamingLocation / Mobility

Asset Utilization

Analytics

CapabilitiesData Relationships

Digital Experiences

Edge & IoT / IoE

Edge Analytics Context & InsightsData Access


Cisco’s Data & AnalyticsAutomate Processes & Aggregate, Analyze Hyper-Distributed Data

Data Access & Management

Data Preparation

DataVirtualization

Real-time Streaming at the Edge

Connected Streaming Analytics

LocationAnalytics

Service Provider Analytics

Analytics to Support Vertical Industries

Tidal EnterpriseScheduler

ServiceGrid Asset Management

CollaborationAnalytics

Network Analytics

Contact Center

Analytics

Compliance / ConfigurationManagement

Analytics to Support Architectures

Energy & Asset Optimization

Process Integration & Workflow Automation

EnergyManagement


What is Cisco Connected Streaming Analytics?

Provides real-time insights with

Big Data views to support

actionable events and dynamic

dashboards to help you get more

value out of your data.

Banner Text Goes Here

Act intelligently

Offers the framework and

interfaces for use case

development across a wide

variety of business and network

management functions and

industries.


Scalable

Streaming query processing

supports active, continuous

monitoring of live data. Get

instantaneous real-time analysis

and action, and efficient use of

compute resources.


Integrated

An analytics platform delivering predictive, actionable insights in high velocity streams of live data

from multiple sources, enabling real-time governance and immediate actions. It adapts to

customer environments and use cases for a wide range of industries and business applications.


Cisco Connected Streaming Analytics Offers

Seamless persistent data

management for historical

reporting, big data integration

Ultra-fast performance, real-time analytics

for multiple data sources

Flexible data integration framework including

infrastructure-ready adapters

Customizable live dashboards and reporting framework that let

you look at data your way

Reliability with high availability, failover, and online backup and

restore

A variety of deployment architectures for cloud, data

center and fog


Value of Real-Time Connected Streaming Analytics

Make it actionable in real time

Make it scale without sacrificing latency

Integrate advanced predictive analytics and machine learning

Transparently combine both live and historic data

Make your data work for you

Enabling closed-loop use cases:

Collect AnalyzeAlert and

storeAdjustUsage data


Analytics Model Comparison

Database Waiting for QueriesStore raw data for further mining.

Traditional Analytics ModelStore first, and query later.

Usage Data• Mine (fetch)

• Analyze

• Report

Next Generation Analytics

Applies predicates, aggregations, and joins with metadata tables,contextual data to identify and match trends.

Usage Data

!

Generate an

Actionable

Event

sent to the Policy System,

Management System, etc.

to allow immediate control

Querybase Waiting for Data Store raw data or filtered data for further mining.

• Mine (fetch)

• Analyze

• Report


Connected Streaming Analytics Capabilities

Live Data ExpertiseDecouple “Data Processing” from “Result Consumption”

Aggregation engine for pre-computation and reporting

Massive data reduction; sessionization

Delayed Consumption

Heavy lifting in real time Pre-aggregated results on demand

High-cardinality analytics: Internet-scale dimensions

• Compressed bitmap aggregates for uniques

• Per-actor analysis

Alerts

Predictive

Pattern Detection

Immediate Consumption

True real-time streaming analytics

Location

Deviations based on history, thresholds and cohort analysis

Dynamic model scoring, classification and categorizing

Finding patterns and detecting complex events

High-performance spatial indexing


Analytics for Streaming & Historical Data

Multiple Data Sources Customizable

visualizationsPrebuilt Adapters Available &

Framework to easily create

other adapters

Business Data

Operations Data

Infrastructure Data

Sensor Data

Intelligent Actions /

Events

XML, alarms …

01010

101010

01011

Continuous & Interactive Query Processing

over Streaming & Historical Data


Use Cases


IoE Enterprise use Case: Oil & Gas

Edge Location

Regional

Processing PlatformsFog Processing

Sensors & Edge

Processing

Data Center

HeadquartersIT Central

Data Platform and Applications

Deployed in Customer Data Center

or Regional Center

Edge Analytics with CSA

Deployed on Cisco Devices


IoE Enterprise Use Case: Manufacturing

Robots & Machines

Plant AreasFog Node

Real-Time Dashboards

Alerting

Sensors

Devices

Edge Analytics

HPC & DV

Data Mining & Modeling

Inter-Cloud Data Lake

FactoryFog Aggregation Nodes

Factory History & Trends

Reports & Dashboards

Acoustic

Temperature

Edge Analytics with CSA

Data Platform and Applications

Deployed on Cisco Devices

Deployed in Customer Data Center

or Factory


c c

Service Provider DNA: Where is my IP traffic?

Analytics App

Network Analytics Service

Map analytics task

(network.scope=all,

rc=a.b.c.d,

flow-expiry=5sec,

duration=5sec)



Analytics App


Map analytics task

(network.scope=all,

rc=a.b.c.d,

flow-expiry=5sec,

duration=5sec)Only nodes that see

matching flows

report data



Analytics App


Less waste, shorter control cycles greater network value

Results in seconds

Lower network load

Less mgmt overhead

Map analytics task

(network.scope=all,

rc=a.b.c.d,

flow-expiry=5sec,

duration=5sec)Only nodes that see

matching flows

report data


Use Case –Mobility KPI Dashboard

• Unique and new clients trend

analysis by date, week or month

• Real-time active session information

in real-time to identify network

usage pattern or manage

promotional programs

• Authenticated vs. unauthenticated

associations to identify potential

customers

• At-a-glance information on total data

usage to identify network anomaly

or usage spikes

• Drill down for further analysis

Connected Analytics for Mobility

(CAM)


Horizontally & hierarchically scalable yet embeddable

Integrate predictive analytics and machine learning

Immediate Insight: True real-time at the edge or in the data center

Data acquisition & mediation from the infrastructure or IOT

Blends live & historical sources from Big Data ecosystem

Open APIs and highly customizable: SQL, R, JDBC etc.

Streaming Analytics Advantage


Make More Informed Decisions in Real Time

Gain Instant,

Actionable Insight

See your business status

as it occurs

and act immediately.


Agile

Data Access

Real-time

Streaming at

the EdgeLeverage

Existing

Infrastructure

Deep Domain

Infrastructure

Expertise Intercloud

Integration of

Public/Private

Cloud

Broad

Ecosystem

of Partners

Technology

Immediate and Streaming: Analytics for Today's Digital Enterprise