Cognitive Computing: Challenges and opportunities in Building an Artificial Intelligence platform for Business

@pieroleo

IBM Cognitive ComputingChallenges and opportunities in Building an Artificial Intelligence platform for

Business

Pietro LeoExecutive Architect - IBM Italy CTO for Big Data Analytics & WatsonIBM Academy of Technology LeadershipHead of IBM Italy Center of Advanced Studies

2

PROLOGUE

@pieroleo

@pieroleo

WISDOM

KNOWLEDGEDATA

INFORMATION

@pieroleo

@pieroleo

DATA

INFORMATION

KNOWLEDGE

WISDOM "Olli"

Co-creative communityDesign3D-printedCloud + IoT30 Transportation Sensors + New onesArtificial Intelligence forSelf-Drive Vehicle (outside)Inside vehicle AI

ConversationRecommenderVideo RecognitionPersonalization

…

@pieroleo

DATA

INFORMATION

KNOWLEDGE

WISDOMSo, we need WISDOM, to Augment, individualand collective, Intelligence

8

THE TECHAGE

@pieroleo

@pieroleo

630

539

446

389

357

363

as of 12 October 2016

@pieroleo

http://www.grushgamer.com/

In 2015 63% of CEOs will increase investment in digital, it is a matter of survive

Investment in private Fintechcompanies increase 10x in past 5 years: 19B

Credits: http://www.arkive.org/whale-shark/rhincodon-typus/

What is Fintech?

14

Fintech are « UNBUNDLING » tranditional banks

« UNBUNDLING » is general phenomena that is impacting every sectors or corporations

Source: https://www.cbinsights.com/blog/smart-home-market-map-company-list/

SMART HOMES

« UNBUNDLING » logistics

Source: https://www.cbinsights.com/blog/startups-unbundling-fedex/

The biggest taxi company do not own cars

Uber vs Taxi Drivers

Uber vs Uber Drivers

Uber vs …..

The largest accommodation company owns no real estates

Marriott CIO acknowledgedAirbnbas a new competitor

The largest media company owns not content

25

What is the behind?Digital Business + Digital Intelligence

26

You shared your position with me and can guess your mobility need. I can take you where you need to be

Just enjoy your new experience. Stay safe as in your home

I know what is needed for you, even before you order it

Please, come with me and stay by me.I know your content I can take care of all your digital life

27

AI (business)springDigital Business + Digital Intelligence

Artificial Intelligence patents have more than tripled in 10 years

Venture Scanner are tracking 1481 ArtificialIntelligence companies with a combinedfundingamount of $8.8 Billion

Venture Scanner AI segments

Source: Venture Scanner

78% of Executives say business will manage people along side machines

34

How is that possible?

35

Image source: http://personalexcellence.co/blog/ideal-‐beauty/

City

Lifestyle

ZIPcode

Costal vs Inland Marital status

Generation

Location

Family Size

Gender

Income Level

Competitors

Age

Loyalty & CardActivity

Revenue Size

Life Stages

Eductation

Legal status

Sector

Industry

36


City

Lifestyle

ZIPcode


Generation

Location

Family Size

Gender

Income Level

Competitors

Age


Revenue Size

Life Stages

Eductation

Legal status

Sector

Industry

SubscriptionsDate on Site

Wish List

Size of Network

Check-ins

App usage duration

Number of Apps on Device

Deposits/Withdrawals

Device UsagePurchase History

FollowingFollowers

Likes

Number of Hashtags used

History of Hashtags

Search Strings entered

Sequence of visits

Time/Day log in

Time spent on site

Time spent on page

Frequency of Search

Videos Viewed

Photos liked

37


City

Lifestyle

ZIPcode


Generation

Location

Family Size

Gender

Income Level

Competitors

Age


Revenue Size

Life Stages

Eductation

Legal status

Sector

Industry

SubscriptionsDate on Site

Wish List

Size of Network

Check-ins

App usage duration

Number of Apps on Device

Deposits/Withdrawals

Device UsagePurchase History

FollowingFollowers

Likes

Number of Hashtags used

History of Hashtags

Search Strings entered

Sequence of visits

Time/Day log in

Time spent on site

Time spent on page

Frequency of Search

Videos Viewed

Photos liked

Sentiment

Tone

Euphemisms

Hedonism

Extroversion

Face Recognition

Openess

Colloquialism

Reasoning Strategies

Language Modeling

DialogIntent

Latent Semantic Analysis

Phonemes

Ontology Analysis

Linguistics Image Tags

Question Analysis

Self-transcendent

Affective Status

Source: http://www.bloomberg.com/video/meet-the-world-s-most-connected-man-Vs~LzkbkR7yhjza~7nji1g.html

Meet theWorld's Most Connected Man

Rapid growth of exogenous data is transforming healthcare

6 Terabytes

60%Exogenous Factors

1100 TerabytesVolume, Variety, Velocity, Veracity:Educational records, Employment Status, Social Security Accounts, Mental Health Records, Caseworker Files, Fitbits, Home Monitoring Systems, and more…

0.4 TerabytesElectronic Medical / Health Records, Physician Management Systems, Claims Systems and more…

30%Genomics Factors

10%Clinical Factors

IBM Watson Health // SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93

Data Generated per Life

Leveraging Exogenous Data for Chronic Care

60%Exogenous Factors

30%Genomics Factors

10%Clinical Factors

SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93

Glucose Monitoring

Calorie Intake

Stress LevelsPhysical Activity

Other vital signs Social Interaction

Affinity (retail)

Sleep Pattern

Medtronic gets FDA nod for artificial pancreas system, preps to launch Watson-powered Sugar.IQ app

43

What is happening?

44

THE WISDOMAGE

45

Automating the

World

Understanding the

World

Main Technology Shift

H-FactorProgram Train/Data Scientist

Knowledge Workers Learning Workers

46

BIG DATA

DATA

WISDOM

Knowledge

Information

Technology is no more supporting every kind of

private and public organizations, it is becoming

part of them.

Machine IntelligenceIs becoming the key

ingredient.

AnalyticsCloud Computing

Data Science

Mobile

Social

Digitalization

Technology

Business

Robotics

Artificial Intelligence

Business & Tech NexusThings

Toward a Precise Decision Making to reduce the wasteful spend as well as the risk in every industry

.

Information Technology challenge is now about the

possibility to expand our WISDOM options

Watson

48

Analytic Systems use statistical techniques for detecting patterns or detect trends within data, yield an understanding of historical or current state from which to draw conclusions

Text Mining is a class of functions for parsing and identifying significant words in language (NLP) as well as understand the semantic of a textual content

Cognitive Systems leverage machine learning to predict meaning in features of human language (spoken, written, visual) and related forms of human reasoning

Multi-Media Mining is a a class of function for analyzing visual content such as images or videos

Speech Mining is a class of functions for analyzing audio signals including speech to such as ability Cognitive Solutions

leverage a combination of cognitive system reasoningstrategies and other analytic and classical computing techniques to solve for a complex problem -> Amplify Human WISDOM in a specific domain

XXX Mining is class of large specialized functions for analyzing “digital representation” in a specific domain à e.g., Bioinformatics, Financial Analytics, etc.

Capitalize on Digital Data

Machine Learning is a class of statistical techniques that use training data to recognize the correlation between a set of feature patterns and outcomes.

It includes also Deep Learning that is a rapidly maturing space, based on neural network techniques, that are taught to find their own features

Emerging Patterns for Artificial Intelligence adoption in Business World

WISDOM

Opportunity for decision-making

support2025

Cognitive opens new opportunities on top of traditional IT

Traditional globalIT spend

Source: IBM analysis presented to the Investor Briefings

~$2T

~$1.2T

Top outcomes from cognitive initiatives vary by industry

Finance49% Increased market agility46% Improved customer service43% Increased customer

engagement43% Improved productivity &

efficiency42% Improved security & compliance, reduced risk

Retail56% Personalized customer / user

experience56% Increased customer engagement56% Improved decision making & planning 56% Reduced costs55% Improved customer service

Health66% Accelerated innovation of

new products / services66% Improved productivity &

efficiency64% Improved security & compliance,

reduced risk62% Reduced costs59% Improved customer service

Manufacturing64% Improved decision making

& planning 58% Improved productivity &

efficiency54% Improved security & compliance, reduced risk52% Improved customer service49% Enhanced the learning experience

Government/Education54% Personalized customer / user experience50% Improved customer service37% Improved decision making & planning 36% Improved productivity & efficiency33% Increased customer engagement

Professional Services40% Reduced costs36% Personalized customer/user

experience36% Improved customer service36% Expanded ecosystem34% Accelerated innovation of new

products / services

% achieving outcome with cognitive

Source: An IBM study of over 600 early cognitive adopters - 2016 Full report: http://www.ibm.com/cognitive/advantage-reports/

2011 2015

2016 - AlphaGO=4 Lee Se-Dol=1

1997 - IBM=2.5 Kasparov=2.5

1997

AlphaGO uses self-trained net to evaluate positions and moves on 30M historical games

DeepBlue uses a hard-coded objective function written by a human coupled with High Performance Computing

2016

10

10170

1040

Applying or having wisdom in real world is not only an AI game

COMPUTING & MATH WISDOM

IBM Watson – Jeopardy!

SEMANTICS

@pieroleo

52

53

Build a platform for Cognitive Business? Why?

@pieroleo

Who: Current top players competitive directions and approaches

Personalized Service /Content Aggregation

Industry-oriented / Professions SpecificOutcomes via cognitive Solutions

Core Business Cognitive /Enhance Experiences

IBM

API SERVICES /PLATFORM

AWS

Microsoft

Goggle

Amazon (Alexa)

Facebook

Ecosystemand Partners

Industry Solutions

ClientSolutions& products

IBM ProvidedData Publically

SourcedData

PartnerProvidedData

PrivateClientData

IBM Watson Innovation platform for Cognitive Business

Watson HealthWatson Financial ServiceWatson Internet of Things

Hybrid Watson Frameworks

WatsonServices - API

Data

Knowledge

Wisdom


Industry Solutions

ClientSolutions


SourcedData

PartnerProvidedData

PrivateClientData


Health

Financial

Cross

Public FilingsPatentsMedical JournalsU.S. Geological Survey…

AppleTwitterQuest Diagnostics…

MedtronicUnder ArmourJohnson & JohnsonThomson Reuters…



WatsonServices

Comms Industrial Distribution Financial Public ServicesHealth

Fraud AnalysisCorp Intelligence

Claims ProcessingDigital Agent

Call Center Advisor

Public SafetyNational SecurityShopping Advisor

Sales AutomationSupply & Logistics

Omni-Channel Ops

Product SafetyField Service MgtGeology Advisor

Digital AgentTheme Park ExpCall Center Ops

CIO DashboardCorp Intelligence

M&A Advisor Cyber Security

Life SciencesOncology

Clinical Trial Matching

@pieroleo

1-800 Flowers

Live at: https://www.1800flowers.com/gwyn-1800flowers?flws_rd=1 Live at: https://www.thenorthface.com/xps

GWYN (Gifts When You Need), a Watson-powered personal concierge designed to help customers find the perfect gift

The North Face

A personal Shop Assistant that can drive you to select the most appropriate Jacket

Virtual Agents: Sales Assistants

@pieroleo

@pieroleo

June 2016 59

@pieroleo

• Will deliver personalized content through the dashboard and other digital channels supported by the OnStar Go ecosystem to make the most of time spent in the car.

• iHeartRadio will use Watson Personality Insights to curate personalized experiences that leverage on-air personalities and local content from radio stations across the U.S.

• The platform employs Watson Tradeoff Analytics to give a traveling foodie dining recommendations from celebrity chefs when driving in a new city.

Cognitive Automation

@pieroleo

61

Cognitive Virtual Agent + Robotic Automation = IntelligentAutomation

61


Industry Solutions

ClientSolutions


SourcedData

PartnerProvidedData

PrivateClientData




WatsonServices

Data

Knowledge

Wisdom

@pieroleo

VisualRecognition

Speech toText

Personality

Insights

LanguageTranslatio

n

WatsonServices are a set of building blocks that can be mixed to build cognitive applications.They run on a Platform.

IBM Cognitive Services –BlueMix - Platform

Text tospeech

@pieroleo

Anaphoric Co-referencingColloquialism ProcessingContent Management -- VersioningConvolutional Neural NetworksCurationDeep LearningDialog FramingEllipsesEmbedded Table ProcessingEnsembles and FusionEntity ResolutionFactoid Answering

Feature Engineering

Feature NormalizationFocus and Spurious Phrase ResolutionHTML Page AnalysisImage ManagementInformation RetrievalKnowledge (Property) GraphsKnowledge AnsweringKnowledge Extraction AnnotatorsKnowledge Validation and ExtrapolationLanguage ModelingLatent Semantic Analysis

Learn To RankLinguistic AnalysisLogical Reasoning AnalysisLogistical RegressionMachine LearningMulti-Dimensional ClusteringMultilingual trainingn-Gram Analysis (word combinations and distance)Ontology AnalysisPareto AnalysisPassage AnsweringPDF ConversionPhoneme Aggregation

Question AnalysisQuestion-answering Reasoning StrategiesRecursive Neural NetworksRules ProcessingScalable SearchSimilarity AnalyticsStatistical Language ParsingSupport Vector MachinesSyllable AnalysisTable AnsweringVisual AnalysisVisual RenderingVoice Synthesis

These APIs are underpinned by 50 technologies:

2011

2015Source: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/services-catalog.html

@pieroleo

IBM Cognitive Services1. Watson APIs are

continuously. 2. They are

complemented with tens of other APIs in other domains, all running on ONE platform.

3. They can mashed up to build an infinite number of cognitive assistants.

2011

2016Pipeline

@pieroleo

Gain insight into how and why people think, act, and feel the way they do. This service applies linguistic analytics and personality theory to infer attributes from a person's unstructured text

PersonalityInsights

@pieroleo

New programming environments on clouds are providing a fast and easy access to IBM Watson APIs and more …

67

@pieroleo

68

What types of cognitive systems?

@pieroleo

69

8,361 Teams joined to propose and generate ideas

And over 2.700 passed feasibility reviews

275,000 IBMers all around the world who engaged in the Cognitive Build.

• Imagine a digital cognitive system to help you do something important in your personal or professional lives

• Team to design it and advocate for it, and then everyone votes

• Winners: reduce waste and human suffering, screen for health issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices

@pieroleo

Types of Cognitive Systems

70

Tool AssistantTools Collaborator

Coach Mediator

Source: Analysis of top 400 ieas by J. Spoorer, Don Norman and Paul Maglio


Industry Solutions

ClientSolutions


SourcedData

PartnerProvidedData

PrivateClientData




WatsonServices

Data

Knowledge

Wisdom

@pieroleo

IBM Cloud Computing Platform

Cognitive Systems & Apps

Watson Ecosystem

Watson

@pieroleo

Source: http://www.equals3.ai/meetlucy

@pieroleo

@pieroleo

@pieroleo

Source: https://ibmtjbot.github.io/

I'm an open source projectdesigned to help you accessWatson Services in a fun way.

You can 3D print me or laser cut me, then use one of myrecipes to bring me to life!

https://www.ibm.com/watson/developercloud/project-intu.html


Industry Solutions

ClientSolutions


SourcedData

PartnerProvidedData

PrivateClientData




WatsonServices - API

Data

Knowledge

Wisdom

Leveraging the Explosion of Data in Medicine – An Impossible Task Without Analytics and New advanced Artificial Intelligence Computing Models

1000

Facts p

er Decision

10

100

1990 2000 2010 2020

Human Cognitive Capacity

Electronic Health Records (Clinical Data)

Internet of Things (Exogenous Data)

The Human Genome (Genomic Data)

Capturing the Value of Data: Big Changes Ahead

Medical error—the third leading cause of death in the US

Source: BMJ 2016;; 353 doi: http://dx.doi.org/10.1136/bmj.i2139 (Published 03 May 2016) Cite this as: BMJ 2016;;353:i2139


Industry Solutions

ClientSolutions


SourcedData

PartnerProvidedData

PrivateClientData

An example of industrial-oriented platform: Watson Health


Data

Knowledge

Wisdom

Public FilingsPatents

Medical Journals

AppleTwitterQuest Diagnostics

MedtronicUnder ArmourJohnson & JohnsonTEVA

@pieroleo

80

Watson Health is bringing unique insights to the marketplace to help reduce costs, improve outcomes and help increase value.

DataStandards based, extremely scalable,

open repository of data on all dimensions of

healthcare and research

Insights as a service

Knowledge and actionable information through

advanced analytics and cognitive capabilities

SolutionsIBM and an ecosystem of partners help improve the overall experience and increase the quality

of outcomes

Watson HealthData – Insights – Solutions

@pieroleo

81

Our approach

@pieroleo

Watson Health’s aim is to create an open industry platform utilizing keycapabilities and partnerships to help improve Healthcare

Watson Cloud

PARTNERSHIPS

@pieroleo

83

Our approach

@pieroleo

Watson for Genomics

Business Challenge: • As the cost of Next Generation Sequencing decreases, there will be an increase in tumor genome sequencing resulting in massive quantities of genetic data to analyze

• Currently, it takes an average of 4-6 weeks to analyze and interpret genetic data manually • Complexity of matching genetic mutations of individual’s tumor with molecular targeted therapies using multiple data sources

Watson Solution: • Empowers Physicians to Make the Most of Genomic Data and Assisting Them to Provide Comprehensive and Up-to-date Cancer Patient-Care

1. Leverages whole genome, whole exome, or large panels variant sequences from patient tumor biopsies 2. Identifies gene level variants using several industry standard databases, as well as relevant literature 3. Provides actionable list of gene variants and the therapies that target them, either directly or indirectly

Use Cases:• Assist Molecular Pathologists in reviewing the 100s to 1000s of gene level variants, and associating each with the likelihood its driving cancer developing in that individual patient

• Once the driver alterations have been approved by the pathologist, WGA assists the Medical Oncologist with recommending an approved, investigational, or off-labeled targeted therapy

84

@pieroleo

Watson Genomics from Quest Diagnostics®

Watson Genomics from Quest Diagnostics is a solution that can help patients along their cancer journey.

1. Quest Diagnostics sequences and analyzes a tumor’s genomic makeup to find specific mutations

2. Watson then compares those mutations against relevant medical literature, clinical studies, pharmacopeia and carefully annotated rules created by leading oncologists.

3. A Quest Diagnostics pathologist will review and validate the results and prepare a report to send back to the patient’s treating physician

http://www.ibm.com/watson/health/oncology/genomics/

@pieroleo

86

Watson for OncologyTrained by Memorial Sloan Kettering

Business Challenge: • Ability to assess quickly the best treatments for an individual patient based on latest evidence and clinical guidelinesWatson Solution: • A tool to assist physicians make personalized treatment decisions

− Analyzes patient data against thousands of historical cases and trained through thousands of Memorial Sloan Kettering MD and analyst hours

− Suggestions to help inform oncologists’ decisions based on over 290 medical journals, over 200 textbooks, and 12M pages of text− Evolves with the fast-changing field− Currently supports first line treatment (Breast, Lung, Colorectal cancers)

86© 2015 International Business Machines Corporation

@pieroleo

87

Our approach

@pieroleo

88

The Medical Sieve §Build a fast anomaly detection engine

– Quickly filters irrelevant images– Highlights disease-depicting regions– Flags coincidental diagnosis

§ Intended as a radiology assistant – Clinicians still do the diagnosis– Machine reduces workload – Machine performs triage/decision support

Given history of the patient and images of a study

Is there an anomalous image here?If so, where is the anomaly ?Describe the anomaly

The Medical Sieve

@pieroleo

90

CLOSING

@pieroleo

Scientific Method

Visualization

Domain Expertise TOM

Hacker Mindset

MathData Engineering

Advanced Computing

StatisticsData Scientist

A Data Scientist§ Explores and examines data from multiple disparate sources

§ Sifts through all incoming data with the goal of discovering a previouslyhidden insight

§Has strong business acumen, coupled with the ability to communicate findings to bothbusiness and IT leaders in a way thatcan influence how an organizationapproaches a business challenge

§Represents an evolution from the business or data analyst role

§Has a solid foundation typically in computer science and applications, modeling, statistics, analytics and math.

The role of a Data Scientist

@pieroleo

Chief ArtificialIntelligence Officer

Chief Data Scientist

Chief InformationOfficer

Chief DataOfficer

https://www.partnershiponai.org/

@pieroleo

Source: https://www.whitehouse.gov/sites/default/files/whitehouse_files/microsites/ostp/NSTC/preparing_for_the_future_of_ai.pdf

1 Private and public institutions are encouraged to examine whether and how they can responsibly leverage AI and machine learning in ways that will benefit society.

2 Federal agencies should prioritize open training data and open data standards in AI.

3 The Federal Government should explore ways to improve the capacity of key agencies to apply AI to their missions.

@pieroleo

http://www.onthehub.com/ibm/ https://developer.ibm.com/academic/

@pieroleo

@pieroleo

www.linkedin.com/in/pieroleo

Pietro LeoExecutive Architect -ÿ IBM Italy CTO for Big Data Analytics & WatsonIBM Academy of Technology LeadershipHead of IBM Italy Center of Advanced Studies

Grazie!

Data & Analytics

Cognitive Computing: Challenges and opportunities in Building an Artificial Intelligence platform for Business