Decision Surfaces. Support Vector Machines Lecture

Abstract

This lecture overviews Decision Surfaces and, in particular, Support Vector Machines that have many applications in Machine Learning and Pattern Recognition. It covers the following topics in detail: Decision surfaces. Hyperplanes. Non-linear Decision Surfaces. Quadratic (2^nd degree polynomial) surfaces, Hyperellipsoid/Hyperparaboloid.  Support Vector Machines, Margin Maximization, Lagrangian Primal/Dual Problem, Kernel SVM.

SVM margin.

Decision-Surfaces.-Support-Vector-Machines-v4.2

Understanding Questionnaire

https://docs.google.com/forms/decision-surfaces-svm

Tutorial Exercises

1. Decision Surfaces Tutorial Exercises
   1. 2D Decision function Tutorial Exercise
   2. Perceptron Classification Tutorial Exercise
   3. Type-1 Decision Functions Tutorial Exercise
   4. Type-2 Decision Functions Tutorial Exercise
   5. Type-3 Decision Functions Tutorial Exercise