Upload
others
View
9
Download
0
Embed Size (px)
Citation preview
Review
CS540 Introduction to Artificial IntelligenceLecture 14
Young WuBased on lecture slides by Jerry Zhu and Yingyu Liang
July 2, 2019
Review
PerceptronReview
Perceptron update rule.
Perceptron termination condition.
Review
Logistic RegressionReview
Logistic update rule.
Logistic cost function.
Convexity.
Hessian, Laplacian, eigenvalue.
Review
Neural NetworkReview
Activation.
Backpropogation.
L1 and L2 regularization.
Cross validation.
Multi class classification.
Review
Multi Layer Neural Network ExampleReview
Review
LTU Activation ExampleReview
Review
Support Vector MachineReview
Hard margin support vector.
Soft margin maximization.
Subgradient descent.
Kernel trick.
Review
Support Vector Margin ExampleReview
Review
Feature Vector to Kernel ExampleReview
Review
Decision TreeReview
Entropy.
Information gain.
Bagging and boosting.
Review
Decision Tree ExampleReview
Review
K Nearest NeighborReview
Distance functions.
Review
K Nearest Neighbor Cross Validation ExampleReview
Review
Convolutional Neural NetworkReview
Convolution.
Pooling.
Trained weights.
Review
Convolutional Weights Count ExampleReview
Review
Computer VisionReview
Histogram of Gradients Features.
Scale Invariant Feature Transform.
Block normalization.
Dominant orientation.
Harr Features.
Review
Histogram of Gradient ExampleReview
Review
Natural Language ProcessingReview
Bigram and trigram model.
Transition matrix.
Random word generation.
Bayes rule.
Review
Document Bayes Rule ExampleReview
Review
Bayesian NetworkReview
Conditional probability table.
Maximum likelihood estimation.
Training vs inference.
Chow Liu algorithm.
Review
Common Cause Network ExampleReview