Machine Learning VMLW01

What are we covering today ? • What is Machine Learning ? • Types of Machine Learning• Supervised Learning Algorithms• Unsupervised Learning Algorithms• Neural Networks – Deep Learning• Feature Scaling• Model Selection

What is Machine learning ?

Definition: A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E.

Examples:Database mining – Large Datasets, Medical records, Web click data etc Applications - Autonomous Helicopter, handwriting recognition, NLPRecommendation Systems – Amazon , Netflix Replicating Human Learning

Real world examples

IBM Watson – AI

Self Driving Cars

Satellite Imaging Agriculture

License Plate

Types Of Machine learning Algorithms

• Supervised Learning• Unsupervised Learning• Others – Reinforcement learning, Recommender systems

Definition & ExamplesMixed set of FruitsRegression and Classification ProblemsGoogle News, Market Segmentation

Supervised Learning• Linear Regression - Model Representation

• m = No of Training examples• x = input variables or features• y = output variable or target variable• (x^i,y^i) – ith training example• Hypothesis • Cost Function

Supervised Learning• Linear Regression Gradient Decent Algorithm

• Start with one random theta and keep changing it till the cost is minimum

Supervised Learning• Classification – Logistic Regression

• (Sigmoid or Logistic function of z)

• ( y = 0 or 1 h(x) is probability of y being 1 )

Feature Scaling & Learning Rate

(max – min, range or SD etc for normalizing)

How to pick right alpha (learning rate)Very large vs Very small , (take multiples of 3 , 10 etc)

Unsupervised Learning• Cluster Analysis - K-Means Algorithm

Unsupervised Learning• Neural Networks

Model selection Supervised or Unsupervised Classification or Regression No of Training sets Feature types

• Linear Regression• Normal equation

• Logistic Regression • Naive bayes

• K-mean• Neural Networks• SVM

TensorFlow – Deep Learning• What is Deep Learning ?

• MNIST Example - Mixed National Institute of Standards and Technology database

• Theano , Tensorflow , Scikit learn, Caffe, Keras

Important links & Contact• TensorFlow: • https://www.tensorflow.org/install/• https://www.continuum.io/downloads • https://github.com/1228337123/tensorflow-seq2seq-chatbot•

If your python is on 3.6 • Update below statement • pip install --ignore-installed --upgrade

https://storage.googleapis.com/tensorflow/windows/cpu/tensorflow-1.0.0-cp35-cp35m-win_x86_64.whl• to• pip install --ignore-installed --upgrade

https://storage.googleapis.com/tensorflow/windows/cpu/tensorflow-1.0.0-cp36-cp36m-win_x86_64.whl• Similarly for GPU command

• https://www.youtube.com/watch?v=IpGxLWOIZy4