View
488
Download
0
Category
Preview:
Citation preview
@pieroleo
IBM Cognitive ComputingChallenges and opportunities in Building an Artificial Intelligence platform for
Business
Pietro LeoExecutive Architect - IBM Italy CTO for Big Data Analytics & WatsonIBM Academy of Technology LeadershipHead of IBM Italy Center of Advanced Studies
2
PROLOGUE
@pieroleo
@pieroleo
WISDOM
KNOWLEDGEDATA
INFORMATION
@pieroleo
@pieroleo
DATA
INFORMATION
KNOWLEDGE
WISDOM "Olli"
Co-creative communityDesign3D-printedCloud + IoT30 Transportation Sensors + New onesArtificial Intelligence forSelf-Drive Vehicle (outside)Inside vehicle AI
ConversationRecommenderVideo RecognitionPersonalization
…
@pieroleo
DATA
INFORMATION
KNOWLEDGE
WISDOMSo, we need WISDOM, to Augment, individualand collective, Intelligence
8
THE TECHAGE
@pieroleo
@pieroleo
630
539
446
389
357
363
as of 12 October 2016
@pieroleo
http://www.grushgamer.com/
In 2015 63% of CEOs will increase investment in digital, it is a matter of survive
Investment in private Fintechcompanies increase 10x in past 5 years: 19B
Credits: http://www.arkive.org/whale-shark/rhincodon-typus/
What is Fintech?
14
Fintech are « UNBUNDLING » tranditional banks
« UNBUNDLING » is general phenomena that is impacting every sectors or corporations
Source: https://www.cbinsights.com/blog/smart-home-market-map-company-list/
SMART HOMES
« UNBUNDLING » logistics
Source: https://www.cbinsights.com/blog/startups-unbundling-fedex/
The biggest taxi company do not own cars
Uber vs Taxi Drivers
Uber vs Uber Drivers
Uber vs …..
The largest accommodation company owns no real estates
Marriott CIO acknowledgedAirbnbas a new competitor
The largest media company owns not content
25
What is the behind?Digital Business + Digital Intelligence
26
You shared your position with me and can guess your mobility need. I can take you where you need to be
Just enjoy your new experience. Stay safe as in your home
I know what is needed for you, even before you order it
Please, come with me and stay by me.I know your content I can take care of all your digital life
27
AI (business)springDigital Business + Digital Intelligence
Artificial Intelligence patents have more than tripled in 10 years
Venture Scanner are tracking 1481 ArtificialIntelligence companies with a combinedfundingamount of $8.8 Billion
Venture Scanner AI segments
Source: Venture Scanner
78% of Executives say business will manage people along side machines
34
How is that possible?
35
Image source: http://personalexcellence.co/blog/ideal-‐beauty/
City
Lifestyle
ZIPcode
Costal vs Inland Marital status
Generation
Location
Family Size
Gender
Income Level
Competitors
Age
Loyalty & CardActivity
Revenue Size
Life Stages
Eductation
Legal status
Sector
Industry
36
Image source: http://personalexcellence.co/blog/ideal-‐beauty/
City
Lifestyle
ZIPcode
Costal vs Inland Marital status
Generation
Location
Family Size
Gender
Income Level
Competitors
Age
Loyalty & CardActivity
Revenue Size
Life Stages
Eductation
Legal status
Sector
Industry
SubscriptionsDate on Site
Wish List
Size of Network
Check-ins
App usage duration
Number of Apps on Device
Deposits/Withdrawals
Device UsagePurchase History
FollowingFollowers
Likes
Number of Hashtags used
History of Hashtags
Search Strings entered
Sequence of visits
Time/Day log in
Time spent on site
Time spent on page
Frequency of Search
Videos Viewed
Photos liked
37
Image source: http://personalexcellence.co/blog/ideal-‐beauty/
City
Lifestyle
ZIPcode
Costal vs Inland Marital status
Generation
Location
Family Size
Gender
Income Level
Competitors
Age
Loyalty & CardActivity
Revenue Size
Life Stages
Eductation
Legal status
Sector
Industry
SubscriptionsDate on Site
Wish List
Size of Network
Check-ins
App usage duration
Number of Apps on Device
Deposits/Withdrawals
Device UsagePurchase History
FollowingFollowers
Likes
Number of Hashtags used
History of Hashtags
Search Strings entered
Sequence of visits
Time/Day log in
Time spent on site
Time spent on page
Frequency of Search
Videos Viewed
Photos liked
Sentiment
Tone
Euphemisms
Hedonism
Extroversion
Face Recognition
Openess
Colloquialism
Reasoning Strategies
Language Modeling
DialogIntent
Latent Semantic Analysis
Phonemes
Ontology Analysis
Linguistics Image Tags
Question Analysis
Self-transcendent
Affective Status
Source: http://www.bloomberg.com/video/meet-the-world-s-most-connected-man-Vs~LzkbkR7yhjza~7nji1g.html
Meet theWorld's Most Connected Man
Rapid growth of exogenous data is transforming healthcare
6 Terabytes
60%Exogenous Factors
1100 TerabytesVolume, Variety, Velocity, Veracity:Educational records, Employment Status, Social Security Accounts, Mental Health Records, Caseworker Files, Fitbits, Home Monitoring Systems, and more…
0.4 TerabytesElectronic Medical / Health Records, Physician Management Systems, Claims Systems and more…
30%Genomics Factors
10%Clinical Factors
IBM Watson Health // SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93
Data Generated per Life
Leveraging Exogenous Data for Chronic Care
60%Exogenous Factors
30%Genomics Factors
10%Clinical Factors
SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93
Glucose Monitoring
Calorie Intake
Stress LevelsPhysical Activity
Other vital signs Social Interaction
Affinity (retail)
Sleep Pattern
Medtronic gets FDA nod for artificial pancreas system, preps to launch Watson-powered Sugar.IQ app
43
What is happening?
44
THE WISDOMAGE
45
Automating the
World
Understanding the
World
Main Technology Shift
H-FactorProgram Train/Data Scientist
Knowledge Workers Learning Workers
46
BIG DATA
DATA
WISDOM
Knowledge
Information
Technology is no more supporting every kind of
private and public organizations, it is becoming
part of them.
Machine IntelligenceIs becoming the key
ingredient.
AnalyticsCloud Computing
Data Science
Mobile
Social
Digitalization
Technology
Business
Robotics
Artificial Intelligence
Business & Tech NexusThings
Toward a Precise Decision Making to reduce the wasteful spend as well as the risk in every industry
.
Information Technology challenge is now about the
possibility to expand our WISDOM options
Watson
48
Analytic Systems use statistical techniques for detecting patterns or detect trends within data, yield an understanding of historical or current state from which to draw conclusions
Text Mining is a class of functions for parsing and identifying significant words in language (NLP) as well as understand the semantic of a textual content
Cognitive Systems leverage machine learning to predict meaning in features of human language (spoken, written, visual) and related forms of human reasoning
Multi-Media Mining is a a class of function for analyzing visual content such as images or videos
Speech Mining is a class of functions for analyzing audio signals including speech to such as ability Cognitive Solutions
leverage a combination of cognitive system reasoningstrategies and other analytic and classical computing techniques to solve for a complex problem -> Amplify Human WISDOM in a specific domain
XXX Mining is class of large specialized functions for analyzing “digital representation” in a specific domain à e.g., Bioinformatics, Financial Analytics, etc.
Capitalize on Digital Data
Machine Learning is a class of statistical techniques that use training data to recognize the correlation between a set of feature patterns and outcomes.
It includes also Deep Learning that is a rapidly maturing space, based on neural network techniques, that are taught to find their own features
Emerging Patterns for Artificial Intelligence adoption in Business World
WISDOM
Opportunity for decision-making
support2025
Cognitive opens new opportunities on top of traditional IT
Traditional globalIT spend
Source: IBM analysis presented to the Investor Briefings
~$2T
~$1.2T
Top outcomes from cognitive initiatives vary by industry
Finance49% Increased market agility46% Improved customer service43% Increased customer
engagement43% Improved productivity &
efficiency42% Improved security & compliance, reduced risk
Retail56% Personalized customer / user
experience56% Increased customer engagement56% Improved decision making & planning 56% Reduced costs55% Improved customer service
Health66% Accelerated innovation of
new products / services66% Improved productivity &
efficiency64% Improved security & compliance,
reduced risk62% Reduced costs59% Improved customer service
Manufacturing64% Improved decision making
& planning 58% Improved productivity &
efficiency54% Improved security & compliance, reduced risk52% Improved customer service49% Enhanced the learning experience
Government/Education54% Personalized customer / user experience50% Improved customer service37% Improved decision making & planning 36% Improved productivity & efficiency33% Increased customer engagement
Professional Services40% Reduced costs36% Personalized customer/user
experience36% Improved customer service36% Expanded ecosystem34% Accelerated innovation of new
products / services
% achieving outcome with cognitive
Source: An IBM study of over 600 early cognitive adopters - 2016 Full report: http://www.ibm.com/cognitive/advantage-reports/
2011 2015
2016 - AlphaGO=4 Lee Se-Dol=1
1997 - IBM=2.5 Kasparov=2.5
1997
AlphaGO uses self-trained net to evaluate positions and moves on 30M historical games
DeepBlue uses a hard-coded objective function written by a human coupled with High Performance Computing
2016
10
10170
1040
Applying or having wisdom in real world is not only an AI game
COMPUTING & MATH WISDOM
IBM Watson – Jeopardy!
SEMANTICS
@pieroleo
52
53
Build a platform for Cognitive Business? Why?
@pieroleo
Who: Current top players competitive directions and approaches
Personalized Service /Content Aggregation
Industry-oriented / Professions SpecificOutcomes via cognitive Solutions
Core Business Cognitive /Enhance Experiences
IBM
API SERVICES /PLATFORM
AWS
Microsoft
Goggle
Amazon (Alexa)
Ecosystemand Partners
Industry Solutions
ClientSolutions& products
IBM ProvidedData Publically
SourcedData
PartnerProvidedData
PrivateClientData
IBM Watson Innovation platform for Cognitive Business
Watson HealthWatson Financial ServiceWatson Internet of Things
Hybrid Watson Frameworks
WatsonServices - API
Data
Knowledge
Wisdom
Ecosystemand Partners
Industry Solutions
ClientSolutions
IBM ProvidedData Publically
SourcedData
PartnerProvidedData
PrivateClientData
IBM Watson Innovation platform for Cognitive Business
Health
Financial
Cross
Public FilingsPatentsMedical JournalsU.S. Geological Survey…
AppleTwitterQuest Diagnostics…
MedtronicUnder ArmourJohnson & JohnsonThomson Reuters…
Watson HealthWatson Financial ServiceWatson Internet of Things
Hybrid Watson Frameworks
WatsonServices
Comms Industrial Distribution Financial Public ServicesHealth
Fraud AnalysisCorp Intelligence
Claims ProcessingDigital Agent
Call Center Advisor
Public SafetyNational SecurityShopping Advisor
Sales AutomationSupply & Logistics
Omni-Channel Ops
Product SafetyField Service MgtGeology Advisor
Digital AgentTheme Park ExpCall Center Ops
CIO DashboardCorp Intelligence
M&A Advisor Cyber Security
Life SciencesOncology
Clinical Trial Matching
@pieroleo
1-800 Flowers
Live at: https://www.1800flowers.com/gwyn-1800flowers?flws_rd=1 Live at: https://www.thenorthface.com/xps
GWYN (Gifts When You Need), a Watson-powered personal concierge designed to help customers find the perfect gift
The North Face
A personal Shop Assistant that can drive you to select the most appropriate Jacket
Virtual Agents: Sales Assistants
@pieroleo
@pieroleo
June 2016 59
@pieroleo
• Will deliver personalized content through the dashboard and other digital channels supported by the OnStar Go ecosystem to make the most of time spent in the car.
• iHeartRadio will use Watson Personality Insights to curate personalized experiences that leverage on-air personalities and local content from radio stations across the U.S.
• The platform employs Watson Tradeoff Analytics to give a traveling foodie dining recommendations from celebrity chefs when driving in a new city.
Cognitive Automation
@pieroleo
61
Cognitive Virtual Agent + Robotic Automation = IntelligentAutomation
61
Ecosystemand Partners
Industry Solutions
ClientSolutions
IBM ProvidedData Publically
SourcedData
PartnerProvidedData
PrivateClientData
IBM Watson Innovation platform for Cognitive Business
Watson HealthWatson Financial ServiceWatson Internet of Things
Hybrid Watson Frameworks
WatsonServices
Data
Knowledge
Wisdom
@pieroleo
VisualRecognition
Speech toText
Personality
Insights
LanguageTranslatio
n
WatsonServices are a set of building blocks that can be mixed to build cognitive applications.They run on a Platform.
IBM Cognitive Services –BlueMix - Platform
Text tospeech
@pieroleo
Anaphoric Co-referencingColloquialism ProcessingContent Management -- VersioningConvolutional Neural NetworksCurationDeep LearningDialog FramingEllipsesEmbedded Table ProcessingEnsembles and FusionEntity ResolutionFactoid Answering
Feature Engineering
Feature NormalizationFocus and Spurious Phrase ResolutionHTML Page AnalysisImage ManagementInformation RetrievalKnowledge (Property) GraphsKnowledge AnsweringKnowledge Extraction AnnotatorsKnowledge Validation and ExtrapolationLanguage ModelingLatent Semantic Analysis
Learn To RankLinguistic AnalysisLogical Reasoning AnalysisLogistical RegressionMachine LearningMulti-Dimensional ClusteringMultilingual trainingn-Gram Analysis (word combinations and distance)Ontology AnalysisPareto AnalysisPassage AnsweringPDF ConversionPhoneme Aggregation
Question AnalysisQuestion-answering Reasoning StrategiesRecursive Neural NetworksRules ProcessingScalable SearchSimilarity AnalyticsStatistical Language ParsingSupport Vector MachinesSyllable AnalysisTable AnsweringVisual AnalysisVisual RenderingVoice Synthesis
These APIs are underpinned by 50 technologies:
2011
2015Source: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/services-catalog.html
@pieroleo
IBM Cognitive Services1. Watson APIs are
continuously. 2. They are
complemented with tens of other APIs in other domains, all running on ONE platform.
3. They can mashed up to build an infinite number of cognitive assistants.
2011
2016Pipeline
@pieroleo
Gain insight into how and why people think, act, and feel the way they do. This service applies linguistic analytics and personality theory to infer attributes from a person's unstructured text
PersonalityInsights
@pieroleo
New programming environments on clouds are providing a fast and easy access to IBM Watson APIs and more …
67
@pieroleo
68
What types of cognitive systems?
@pieroleo
69
8,361 Teams joined to propose and generate ideas
And over 2.700 passed feasibility reviews
275,000 IBMers all around the world who engaged in the Cognitive Build.
• Imagine a digital cognitive system to help you do something important in your personal or professional lives
• Team to design it and advocate for it, and then everyone votes
• Winners: reduce waste and human suffering, screen for health issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices
@pieroleo
Types of Cognitive Systems
70
Tool AssistantTools Collaborator
Coach Mediator
Source: Analysis of top 400 ieas by J. Spoorer, Don Norman and Paul Maglio
Ecosystemand Partners
Industry Solutions
ClientSolutions
IBM ProvidedData Publically
SourcedData
PartnerProvidedData
PrivateClientData
IBM Watson Innovation platform for Cognitive Business
Watson HealthWatson Financial ServiceWatson Internet of Things
Hybrid Watson Frameworks
WatsonServices
Data
Knowledge
Wisdom
@pieroleo
IBM Cloud Computing Platform
Cognitive Systems & Apps
Watson Ecosystem
Watson
@pieroleo
Source: http://www.equals3.ai/meetlucy
@pieroleo
@pieroleo
@pieroleo
Source: https://ibmtjbot.github.io/
I'm an open source projectdesigned to help you accessWatson Services in a fun way.
You can 3D print me or laser cut me, then use one of myrecipes to bring me to life!
https://www.ibm.com/watson/developercloud/project-intu.html
Ecosystemand Partners
Industry Solutions
ClientSolutions
IBM ProvidedData Publically
SourcedData
PartnerProvidedData
PrivateClientData
IBM Watson Innovation platform for Cognitive Business
Watson HealthWatson Financial ServiceWatson Internet of Things
Hybrid Watson Frameworks
WatsonServices - API
Data
Knowledge
Wisdom
Leveraging the Explosion of Data in Medicine – An Impossible Task Without Analytics and New advanced Artificial Intelligence Computing Models
1000
Facts p
er Decision
10
100
1990 2000 2010 2020
Human Cognitive Capacity
Electronic Health Records (Clinical Data)
Internet of Things (Exogenous Data)
The Human Genome (Genomic Data)
Capturing the Value of Data: Big Changes Ahead
Medical error—the third leading cause of death in the US
Source: BMJ 2016;; 353 doi: http://dx.doi.org/10.1136/bmj.i2139 (Published 03 May 2016) Cite this as: BMJ 2016;;353:i2139
Ecosystemand Partners
Industry Solutions
ClientSolutions
IBM ProvidedData Publically
SourcedData
PartnerProvidedData
PrivateClientData
An example of industrial-oriented platform: Watson Health
Watson HealthWatson Financial ServiceWatson Internet of Things
Data
Knowledge
Wisdom
Public FilingsPatents
Medical Journals
AppleTwitterQuest Diagnostics
MedtronicUnder ArmourJohnson & JohnsonTEVA
@pieroleo
80
Watson Health is bringing unique insights to the marketplace to help reduce costs, improve outcomes and help increase value.
DataStandards based, extremely scalable,
open repository of data on all dimensions of
healthcare and research
Insights as a service
Knowledge and actionable information through
advanced analytics and cognitive capabilities
SolutionsIBM and an ecosystem of partners help improve the overall experience and increase the quality
of outcomes
Watson HealthData – Insights – Solutions
@pieroleo
81
Our approach
@pieroleo
Watson Health’s aim is to create an open industry platform utilizing keycapabilities and partnerships to help improve Healthcare
Watson Cloud
PARTNERSHIPS
@pieroleo
83
Our approach
@pieroleo
Watson for Genomics
Business Challenge: • As the cost of Next Generation Sequencing decreases, there will be an increase in tumor genome sequencing resulting in massive quantities of genetic data to analyze
• Currently, it takes an average of 4-6 weeks to analyze and interpret genetic data manually • Complexity of matching genetic mutations of individual’s tumor with molecular targeted therapies using multiple data sources
Watson Solution: • Empowers Physicians to Make the Most of Genomic Data and Assisting Them to Provide Comprehensive and Up-to-date Cancer Patient-Care
1. Leverages whole genome, whole exome, or large panels variant sequences from patient tumor biopsies 2. Identifies gene level variants using several industry standard databases, as well as relevant literature 3. Provides actionable list of gene variants and the therapies that target them, either directly or indirectly
Use Cases:• Assist Molecular Pathologists in reviewing the 100s to 1000s of gene level variants, and associating each with the likelihood its driving cancer developing in that individual patient
• Once the driver alterations have been approved by the pathologist, WGA assists the Medical Oncologist with recommending an approved, investigational, or off-labeled targeted therapy
84
@pieroleo
Watson Genomics from Quest Diagnostics®
Watson Genomics from Quest Diagnostics is a solution that can help patients along their cancer journey.
1. Quest Diagnostics sequences and analyzes a tumor’s genomic makeup to find specific mutations
2. Watson then compares those mutations against relevant medical literature, clinical studies, pharmacopeia and carefully annotated rules created by leading oncologists.
3. A Quest Diagnostics pathologist will review and validate the results and prepare a report to send back to the patient’s treating physician
http://www.ibm.com/watson/health/oncology/genomics/
@pieroleo
86
Watson for OncologyTrained by Memorial Sloan Kettering
Business Challenge: • Ability to assess quickly the best treatments for an individual patient based on latest evidence and clinical guidelinesWatson Solution: • A tool to assist physicians make personalized treatment decisions
− Analyzes patient data against thousands of historical cases and trained through thousands of Memorial Sloan Kettering MD and analyst hours
− Suggestions to help inform oncologists’ decisions based on over 290 medical journals, over 200 textbooks, and 12M pages of text− Evolves with the fast-changing field− Currently supports first line treatment (Breast, Lung, Colorectal cancers)
86© 2015 International Business Machines Corporation
@pieroleo
87
Our approach
@pieroleo
88
The Medical Sieve §Build a fast anomaly detection engine
– Quickly filters irrelevant images– Highlights disease-depicting regions– Flags coincidental diagnosis
§ Intended as a radiology assistant – Clinicians still do the diagnosis– Machine reduces workload – Machine performs triage/decision support
Given history of the patient and images of a study
Is there an anomalous image here?If so, where is the anomaly ?Describe the anomaly
The Medical Sieve
@pieroleo
90
CLOSING
@pieroleo
Scientific Method
Visualization
Domain Expertise TOM
Hacker Mindset
MathData Engineering
Advanced Computing
StatisticsData Scientist
A Data Scientist§ Explores and examines data from multiple disparate sources
§ Sifts through all incoming data with the goal of discovering a previouslyhidden insight
§Has strong business acumen, coupled with the ability to communicate findings to bothbusiness and IT leaders in a way thatcan influence how an organizationapproaches a business challenge
§Represents an evolution from the business or data analyst role
§Has a solid foundation typically in computer science and applications, modeling, statistics, analytics and math.
The role of a Data Scientist
@pieroleo
Chief ArtificialIntelligence Officer
Chief Data Scientist
Chief InformationOfficer
Chief DataOfficer
https://www.partnershiponai.org/
@pieroleo
Source: https://www.whitehouse.gov/sites/default/files/whitehouse_files/microsites/ostp/NSTC/preparing_for_the_future_of_ai.pdf
1 Private and public institutions are encouraged to examine whether and how they can responsibly leverage AI and machine learning in ways that will benefit society.
2 Federal agencies should prioritize open training data and open data standards in AI.
3 The Federal Government should explore ways to improve the capacity of key agencies to apply AI to their missions.
@pieroleo
http://www.onthehub.com/ibm/ https://developer.ibm.com/academic/
@pieroleo
@pieroleo
www.linkedin.com/in/pieroleo
Pietro LeoExecutive Architect -ÿ IBM Italy CTO for Big Data Analytics & WatsonIBM Academy of Technology LeadershipHead of IBM Italy Center of Advanced Studies
Grazie!
Recommended