and Why AI will Revoluntionise our Everyday Lifemwmak/papers/STEM-Lecture2018.pdf · How and Why AI will Revoluntionise our ... Marvin Lee Minsky, 88, passed away January 24,

How and Why AI will Revoluntionise our Everyday Life

Dr. Man‐Wai MAKAssociate Professor

Department of Electronic and Information EngineeringThe Hong Kong Polytechnic Universityhttp://www.eie.polyu.edu.hk/~mwmak

STEM Lecture, 9 Feb. 2018http://www.eie.polyu.edu.hk/~mwmak/papers/STEM‐Lecture2018.pdf

2

Contents1. What is AI and Deep Learning?2. Why are They Important?3. Applications of Deep Learning and AI4. How Deep Neural Networks Work5. Impact of AI and How will it Affect our Life6. How to Prepare for the AI Age

2

3

What is Artificial Intelligence (AI)• AI is a rigorous science focusing on designing intelligent systems using algorithms inspired by what we know about the brain.

• Intelligent systems are capable of performing tasks that normally require human intelligence, such as visual perception, speech recognition, autonomous driving, etc.

• These systems use machine learning algorithms to learn the tasks from massive amount of data

• The more data they learn, the smarter they become

4

AI Algorithms

Artificial Intelligence人工智能

Machine Learning機器學習

Deep Learning深度學習

5


2

6

Why AI is Important

http://fortune.com/2016/10/05/ai-artificial-intelligence-deep-learning-employers/

Economic TimesJune 17

7

Why AI is Important

信報財經月刊 484期 2017年7月號

8

Why AI is Important

9

Why AI is Important

10


2

11

Applications of Deep Learning

• Google Neural Machine Translation:LSTM‐RNN w/ Attention &

Transfer Learning

https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html

12


• Handwritten Digit Synthesis:

http://dpkingma.com/sgvb_mnist_demo/demo.html

13

Applications of Deep Learning• Morphing Faces:

http://vdumoulin.github.io/morphing_faces/online_demo.html

14


http://www.vision.caltech.edu/anelia/publications/Tokyo_DeepNets_Anelia.pdf

15

Applications of Deep Learning• Speech Recognition:

DNN Speech Recognition and Translation by Microsoft Research in Beijing

https://www.youtube.com/watch?v=Nu-nlQqFCKg&feature=youtu.be

16http://spectrum.ieee.org/consumer-electronics/audiovideo/deep-learning-reinvents-the-hearing-aid

Applications of Deep Learning• Hearing Aids:

17

Applications of Deep Learning• Emotion Recognition:

https://azure.microsoft.com/en-us/services/cognitive-services/emotion/

Chance of “Anger” = 0.8

18Elgammal et al. https://arxiv.org/abs/1706.07068 (2017)

Applications of Deep Learning• Generating Arts: Creative Adversarial

Network

19

Applications of Deep Learning• Generating speech and music: Generative

Adversarial Network (GAN)

https://deepmind.com/blog/wavenet‐generative‐model‐raw‐audio/

Text‐to‐speech synthesis

Same speech different speakers

Piano music produced by the GAN

20

Music Generation and Composition• DeepBach: A symphony could be in the style of composer Johann Sebastian Bach

21

Applications of Deep Learning• Editing photos:

Generative Adversarial Network

https://www.youtube.com/watch?v=FDELBFSeqQs

22

Applications of Deep Learning• Synthesize photos:

Generative Adversarial Network

https://www.youtube.com/watch?v=u7kQ5lNfUfg

23

Automatic Article/Report Generation• AI programs have been used to compile information and turn them into financial summaries and sports score recaps.

• The Associated Press uses Wordsmith to transform raw earnings data into thousands of publishable stories, covering hundreds more quarterly earnings stories than previous manual efforts.

• These AI programs use technologies known as “Natural Language Processing 自然語言處理”

24

Automatic Article/Report Generation

25

Automatic Article/Report GenerationMarvin Lee Minsky, 88, passed away January 24, 2016 in Boston, Massachusetts of cerebral hemorrhaging.

Born August 9, 1927 in New York City, New York, to parents Fannie Reiser and Henry Minsky, Marvin Minsky was known for his pioneer contribution to the field of artificial intelligence (AI). After graduating from Phillips Academy, Minskyattended Harvard University, graduating with a BA in Mathematics in 1950. He continued his education at Princeton University, ultimately graduating with a a PhD in Mathematics in 1954.

…

Minsky is survived by his wife Gloria Minsky; three children, Margaret Minsky, Julie Minsky, and Henry Minsky.

Minsky’s name and age, the cause of death, and names of family members

26

AI Playing Video Games

https://www.youtube.com/watch?v=V1eYniJ0Rnk

27


2

28

Geometric Interpretation• Slope‐intercept form of a straight line:

y = mx+ b

Slope = m b

x

y

y = f (x)

Slope = m b

x

z= mx+ b

z

z = f (x)

1b

29

Geometric Interpretation• Slopes‐intercept form of a plane:

b

1b

30

Geometric Interpretation• A linear equation cannot solve complex problems• So, we apply a non‐linear function to z

z

x

y

b

31

A Neural Network with One Neuron

1

b

Artificial Neuron

Biological Neuron

Our brain has about 80 billion neurons, 100 trillion connections

Connection Weights

32

• Neural network can be used as a classifier, e.g., classifying cats and dogs

A Neural Network with One Neuron

x

b

zy

mx

my z0= σ(z)

33

A Neural Network with One Neuron• One neuron cannot do much, not even for the following problem:

34

A Neural Network with Multiple Neurons• To solve more complex problems, we may use multiple neurons and combine the outputs of these neurons

• Then, we have an artificial neural network (ANN) with one hidden layer.

11

Hidden Layer

35

A Neural Network with Multiple Layers• To solve real‐world problems, we need multiple layers• Then, we have deep neural networks (DNN)

Input stimulus (human) that leads to max activation of this node

Input stimulus (cat) that leads to max activation of this node

CatNot Cat

36

A Neural Network with Multiple Layers

Identifying light and dark

Identifying edge and

simple shapesIdentifying

complex shapes and objects

Identifying objects that can be used for recognizing

faces

周潤發

http://www.nature.com/news/computer-science-the-learning-machines-1.14481

37

A Neural Network with Multiple Layers• GoogleNet for image classification

• We use deep learning algorithms to find the weights of this network.

38

How Deep Learning Find the Weights• A DNN could have millions of weights• How to find these weights has been a problem for computer scientists and engineers for many years.

• The basic idea is to start from randomized weights.• Then, we tell the network what went wrong and adjust the weights to reduce the number of mistakes.

• By repeating this process hundreds of times, we obtain a DNN with a proper set of weights that can solve our problem.

• This is called supervised learning, which is similar to how we learn things when a teacher tells us what is right and what is wrong.

• Instead of write computer programs to define the rules, we let the DNN to learn the rules from the data.

39

Deep Learning Software Stack

TensorFlow(Google)

Theano(U. of Montreal)

BLAS cuBLAS, cuDNN, cuRAND

NumPy Gpuarray

Eigen::Tensor

Keras

CPU GPU

Torch(Facebook)

Caffe/Caffe2(Berkeley AI Researcy)

pyTorch

CNTK(Microsoft)

They are all free!

40

Cloud Computing Platforms for AI

AI Software

41

Cloud Computing Platforms for AI

Google Cloud Platform

Amazon EC2

Microsoft Azure

42

The Next Frontier of AI

• Affective Computing: Teaching computers to understand human emotions and to express emotions.

• Neuroscience: Understand how the brain works• Consciousness: Making computers to become self‐aware• Quantum Computing: 100 million times faster than today’s computers

43

Contents1. What is AI and Deep Learning?2. Why are They Important?3. Applications of Deep Learning and AI4. How Deep Neural Networks Work5. Impact of AI and How will it Affect our Life6. How to Prepare for the AI Age7. Tools and Platform for Development AI Applications

2

44

Impact of AI

45

Impact of AI

信報財經月刊 484期, 2017年7月號

46

www.hkej.com, 20/9/17 Impact of AI

Impact of AI

47Hong Kong Economic Journal, 2017

Impact of AI

48Hong Kong Economic Journal, 2017

Impact of AI

49

https://www.youtube.com/watch?v=wlz6XDQooUI

https://www.youtube.com/watch?v=mQO2PcEW9BY

The AI Race ‐ Documentary ABC TV

A.I. is Progressing Faster Than You Think!

50


2

51

How to Prepare for the AI Age• A number of reports predict that about 50% of the current jobs will gone in the next two decades.

• History tells us that automation replaces jobs but will also create new opportunities.

• Almost all industries will be benefit from AI.• People with tech skills will have more opportunities in the future, because even the most intelligent of machines cannot function without humans.

52

How to Prepare for the AI Age• Microsoft co‐founder, Bill Gates, said people with three backgrounds will be the most in‐demand in the future: – science, – engineering and – economics.

53

How to Prepare for the AI Age• Schools need to do a better job of teaching computer skills to build up the new generation of knowledge workers

• Instead of showing students how to type Microsoft Word documents, they should be teaching how to write code

• We need to stop preparing kids for specific jobs; instead, we should give them the opportunity to build up their intuition and creativity

• Our next generation should be guided toward careers that can’t be substituted by technology

• We should stop asking kids what they want to be when they grow up; instead, we need to give them the tools and the ability to innovate in whichever direction they want to go in

• AI and Robotics• Big Data• Genomics• FinTech

How to Prepare for the AI Age

55https://code.facebook.com/posts/384869298519962/artificial-intelligence,-revealed/

Message from Yann LeCun, Head of AI Research in Facebook

“Math and physics classes are where one learns the basic methods for AI, machine learning, data science, and many of the jobs of the future. Take all the math class you can possibly take, including Calc I, Calc II, Calc III, Linear Algebra, Probability, and Statistics.”

How to Prepare for the AI Age

56

Take Home Messages for Students• Learn math and physics in high schools• Learn how to write computer programs• Get a degree in engineering, information technology, or computer science

• Be creative and like to learn new things

57

To Probe Further1. Domingos, Pedro. The master algorithm: How the quest for the ultimate learning

machine will remake our world. Basic Books, 2015.2. Ford, Martin. Rise of the Robots: Technology and the Threat of a Jobless Future.

Basic Books, 2015. 3. 李开复, 人工智能：李开复谈AI如何重塑个人、商业与社会的未来图谱,

Cultural Development Press, 2017.4. Alex Ross, The Industries of the Future, Simon & Schuster, 20165. Pistono, Federico. Robots will steal your job, but that's ok: How to survive the

economic collapse and be happy. Federico Pistono, 2014.6. 信報財經月刊 484期, 2017年7月號

58

Thanks

Documents

and Why AI will Revoluntionise our Everyday Lifemwmak/papers/STEM-Lecture2018.pdf · How and Why AI will Revoluntionise our ... Marvin Lee Minsky, 88, passed away January 24,