32
Vinnie Saini Cloud Solution Architect Big Data & AI [email protected]

Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Vinnie Saini

Cloud Solution Architect

Big Data & AI

[email protected]

Page 2: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

cloud

data

intelligence

Page 3: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Data + Intelligence + Cloud

Page 4: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Flexible Infrastructure support for analytics

Rich data sources to enrich predictions

Best of MS Research & open source

Most comprehensive Data Science capabilities

Easy to consume Artificial Intelligence

Extensible Applications

Page 5: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Flexibility

Pro

duct

ivity

Page 6: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Flexibility

Pro

duct

ivity

Page 7: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 8: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 9: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 10: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Image Moderation

Text Moderation

Video Moderation

• moderate images for adult and racy content• Implement optical character recognition (OCR) and face detection.• Creating and managing your custom lists

• Moderate text for profanity in more than 100 languages• Auto-Correction• Creating and managing your custom lists of terms

• Powered by the adult content classifier running within the Azure Media Services• Currently in private preview and available at no charge

Create a Media Services account on the Azure portal.Contact us with your Azure Subscription ID for enabling the Content Moderator in your region

Page 12: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

• Structured Implementation

• Supports parallelization across both multiple machines and multiple GPUs(without regard to where GPUs are located)

• Memory Reuse

• 4 times better in speed over other similar libraries like Tensorflow

• Enables creation of existing & novel models by combining simple functions

Page 13: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

2.0

• Production Ready: State-of-the-art accuracy, efficient and scales to multi-GPU/multi-server• CNTK as a library

• C++, Python and .NET bindings • Allows creation of new nodes as well as new network types

• Supporting the latest versions of GPU architectures such as NVIDIA Volta, leveraging multiple GPUs for Advanced Optimization

• Full support for Keras, a user-friendly open-source neural network library that is popular with developers working on deep learning applications

• Includes Java language bindings (in addition to C# and Python) as well as a set of new tools that enable the optimization of models to run on smartphones and IOT devices.

• Block wise Model Update Filtering (BMUF) • Supports feed-forward, convolutional, recurrent networks, and reinforcement learning for speech, vision, and text

data, also in combination

Set up on your machineUsing CNTK with Keras

Page 14: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

• Microsoft’s open-source deep-learning toolkit

• Modularized with a separation of:

➢ computational networks

➢ execution engine ➢ learning

algorithms ➢ model description ➢ data readers

• Easily Extensible

Page 15: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 16: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 17: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 18: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 19: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Cognitive Services

Page 20: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 21: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Why Microsoft AI Platform

With more than 25 years of experience in AI research with focus on product development, we’ve produced record-breaking advances in AI algorithms that we offer to our customers and partners in a platform-based approach.

Microsoft offers a unique combination of a productive and powerful platform that empowers any organization and developer to embrace AI everywhere.

Keep your data safe on a trusted and secure cloud platform with encrypted communications, threat management, mitigation practices and regular penetration testing. Ensure infrastructure compliance with your industry through our broad set of compliance standards.

By leveraging Cortana Intelligence Suite, Microsoft Cognitive Services, Microsoft Bot Framework and Cortana organizations can interact with customers and stakeholders in new ways and infer intent with vision, face, speech, text and sentiment analysis to customize responses and drive appropriate actions.

Microsoft is democratizing its AI innovations used in products like Bing, Xbox, and Office Graph, via the Bot Framework, Azure Bot services and Cognitive Services APIs, so you can bring your applications to life, from understanding natural language and speech, to facial recognition. With these tools at your fingertips, you can build intelligent, personal bots that will transform your business.

for the Enterprise

Leading InnovationUnparalleled

ProductivityTrusted Partner

Transform your data

into intelligent actionFor everyone

Page 22: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Why Microsoft AI Platform

The Cognitive Services APIs are easy to implement because they are based on simple REST calls.

Our new QnA Maker

Service is a free, easy-to-

use service that trains AI

to respond to users’

questions in a more

natural an conversational

way using semi-

structured data like the

those found in website

FAQs.

We’ve got a breadth of intelligence and knowledge APIs so developers will be able to find what intelligence feature they need; and importantly, they all work on whatever language, framework, or platform developers choose. So, devs can integrated into their apps—iOS, Android, Windows—using their own tools they know and love (such as python or node.js, etc.).

Developers can trust the quality and expertise build into each API by experts in their field from Microsoft’s Research organization, Bing, and Azure machine learning and these capabilities are used across many Microsoft first party products such as Cortana, Bing and Skype.

Your users talk in many places; your bot should too. The Bot Connector will have your bot talking in full fidelity on the most popular conversation experiences without coding (e.g. Skype, FB Messenger, Office 365 Mail, SMS, Kik, Slack, Telegram, GroupMe, …). You can also bring the conversation to your app or website using our Direct Line customizable Web Chat control or roll with your own.

Cortana connects users to your services, across platforms and devices. By registering your bots, services, mobile apps, and websites as Cortana skills, over 145 million active monthly users will be connected to these capabilities.

for Developers

Easy to implement FlexibleTested, powerful and

award winningMulti-channel Cortana

Page 23: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Why Microsoftfor Advanced Analytics

Microsoft brings

advanced analytics to

wherever your data

lives. From ingestion

of data to analytics

and visualization,

Cortana Intelligence

Suite offers an end-

to-end solution for

Advanced Analytics.

Microsoft has analytics tools for everyone: business users, data scientists, IT, and developers. Microsoft’s tools are easy to use with capabilities ranging from simple statistics to advanced artificial intelligence and machine learning.

Microsoft has a strong community of partners, resellers and individuals. This community extends the product with prebuilt apps, visualizations and video tutorials, in addition to the content provided directly by Microsoft.

Microsoft is democratizing its AI innovations used in products like Bing, Xbox, Kinect and Office Graph, via cognitive services so you can bring your applications to life, from understanding natural language and speech, to facial recognition. With these tools at your fingertips, you can build intelligent applications, services and bots that will transform your business.

Microsoft allows you to use popular open source languages like R, with enterprise level support, whether your data is on-prem, in the cloud, or both. The integration with SQL Server allows you to leverage your existing infrastructure with the power of Azure in a powerful Hybrid model. Extend your database to Azure when you need it and run analytics directly from SQL Server with the power of HD Insight.

End-to-End

SolutionEasy to use

Broad and skilled

community

available in the

marketplace

AI driven

innovation

R support and

performance

Make the most of

your existing

investments,

preferred tools and

data assets. Whether

you’re taking

advantage of

integration with SQL

Server, or looking to

maximize value of

your data across

other investments like

Hadoop/Spark,

Teradata, Windows or

Linux, Microsoft can

help you analyse your

data at scale with

greater confidence,

both today and in the

future.

Microsoft supports

Big Data analytics in

the cloud. Azure Data

Lake is the solution

for your Big Data

Storage and

Analytics. Easily store

data in any format

with any file size and

run your analytics

with the power of HD

Insight.

Works with

what you have

Big Data made

easy

Page 24: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 25: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Vision

Page 26: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

SpeechVision

Page 27: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

SpeechVision

QnA Maker

Distill information into conversational,

easy-to-navigate answers

Page 28: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

SpeechVision

Page 29: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

Microsoft’s newspeech breakthrough

• Microsoft 2016 research system for

conversational speech recognition

• 6.2% word-error rate

• all experiments were run on CNTK

[W. Xiong, J. Droppo, X. Huang, F. Seide, M. Seltzer, A. Stolcke,

D. Yu, G. Zweig: “The Microsoft 2016 Conversational Speech

Recognition System,” http://arxiv.org/abs/1609.03528]

Page 30: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 31: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure
Page 32: Vinnie Saini - WordPress.com · help you analyse your data at scale with greater confidence, both today and in the future. Microsoft supports Big Data analytics in the cloud. Azure

https://azure.microsoft.com/en-us/services/cognitive-services/

https://www.microsoft.com/en-us/cognitive-toolkit/features/model-gallery/?filter=Tutorial

https://github.com/Microsoft/CNTK

https://docs.microsoft.com/en-us/cognitive-toolkit/reasons-to-switch-from-tensorflow-to-cntk