Upload
phamngoc
View
224
Download
3
Embed Size (px)
Citation preview
© 2016 IBM Corporation
Sunny Prakash
Data Scientist /Spark Evangelist
IBM Cognitive Studio
IBM Big Data Analytics & Watson for Fintech
© 2016 IBM Corporation3
The Big Data Opportunity
Variety:
Velocity:
Volume:
Manage the complexity
of multiple relational and
non-relational data types
and schemas
Streaming data and
large- volume data
movement
Scale from terabytes to
zettabytes
© 2016 IBM Corporation4
Hadoop Pioneered by Google and Yahoo!
Open source project
Written in Java
Optimized to handle:
Massive amounts of data through parallelism
A variety of data (structured,unstructured, semi-structured)
Uses inexpensive commodity hardware
Reliability provided through data replication
Great performance for extreme volumes of data
Batch oriented
Large streaming, or sequential processes
Data can be appended but not updated
Generate business intelligence related reports
Not for OLTP, OLAP, or DSS
Not intended to be a replacement to traditional RDMS
© 2016 IBM Corporation5
Text Analytics
POSIX Distributed
Filesystem
Multi-workload,
multi-tenant
scheduling
IBM BigInsights
Enterprise
Management
Machine
Learning
Big R
IBM Open Platform with Apache HadoopHDFS, YARN, MapReduce, Ambari, Flume, HBase, Hive, Kafka,
Oozie, Pig, Slider, Solr, Spark, Sqoop, Zookeeper
IBM
BigInsights
Data
Scientist
IBM
BigInsights
AnalystBig SQL
BigSheets
Big SQL
BigSheets
IBM BigInsights – Our Hadoop On Premise Offering
Free Quick Start (non
production):
• IBM Open Platform
• BigInsights Analyst, Data
Scientist features
• Community support
. . .
© 2016 IBM Corporation6
BigInsights for Apache Hadoop on Bluemix Compute
Infrastructure and Services
© 2016 IBM Corporation7
Watson Data Platform
Experience Watson Data Platform with a tool designed for your role
© 2016 IBM Corporation10
Watson AlchemyLanguage
AlchemyLanguage is a collection of APIs that offer text analysis through natural language
processing. This set of APIs can analyze text to help you understand its concepts, entities,
keywords, sentiment, and more. Additionally, you can create a custom model for some APIs
to get specific results that are tailored to your domain
AlchemyAPI is trained on billions of webpages and can detect and extract information such
as concepts, entities, sentiment, and keywords.
Tutorial Link :- https://www.ibm.com/watson/developercloud/alchemy-language.html
Demo Link :- https://conversation-demo.mybluemix.net/
© 2016 IBM Corporation11
IBM Watson News Explorer
News Explorer is a Bluemix-hosted web application that uses Watson’s AlchemyData News
API to allow users to explore a large collection of news stories by surfacing the topics,
people, companies, organizations, and locations mentioned in those article
Tutorial Link :- https://developer.ibm.com/watson/blog/2015/07/20/presenting-watson-news-
explorer/
Demo Link :- http://news-explorer.mysbluemix.net/
© 2016 IBM Corporation12
Watson Conversation service
The IBM Watson Conversation service allows you to understand what users are saying and
respond with natural language.
IT combines a number of cognitive techniques to help you build and train a bot - defining
intents and entities and crafting dialog to simulate conversation. The system can then be
further refined with supplementary technologies to make the system more human-like or to
give it a higher chance of returning the right answer. Watson Conversation allows you to
deploy a range of bots via many channels, from simple, narrowly focused Bots to much
more sophisticated, full-blown virtual agents across mobile devices, messaging platforms
like Slack, or even through a physical robot
Tutorial Link :- https://www.ibm.com/watson/developercloud/conversation.html
Demo Link :- https://conversation-demo.mybluemix.net/
© 2016 IBM Corporation13
Visual Recognition Service
Visual Recognition uses deep learning algorithms to analyze images that can give you
insights into your visual content. You can organize image libraries, understand an individual
image, and create custom classifiers for specific results that are tailored to your needs.
Tutorial Link :- http://www.ibm.com/watson/developercloud/visual-recognition.html
Demo Link :- http://visual-recognition-demo.mybluemix.net/
© 2016 IBM Corporation14
Tone Analyzer
The IBM Watson Tone Analyzer Service uses linguistic analysis to detect three types of
tones from text: emotion, social tendencies, and language style. Emotions identified include
things like anger, fear, joy, sadness, and disgust. Identified social tendencies include things
from the Big Five personality traits used by some psychologists. These include openness,
conscientiousness, extroversion, agreeableness, and emotional range. Identified language
styles include confident, analytical, and tentative.
Tutorial Link :- http://www.ibm.com/watson/developercloud/tone-analyzer.html
Demo Link :- https://tone-analyzer-demo.mybluemix.net/
© 2016 IBM Corporation15
Tradeoff Analytics
The IBM Watson Tradeoff Analytics service helps people make better choices when faced
with multiple, often conflicting, goals and alternatives. By using mathematical filtering
techniques to identify the best candidate options based on different criteria, the service can
help users explore the tradeoffs between options to make complex decisions. The service
combines smart visualization and analytical recommendations for easy and intuitive
exploration of tradeoffs.
Tutorial Link :- http://www.ibm.com/watson/developercloud/doc/tradeoff-analytics/
Demo Link :- https://tradeoff-analytics-demo.mybluemix.net/