Trending Technology Machine Learning, Artificial Intelligent, Block Chain, IoT, DevOps, Data Science

Recent Post


Monday, 20 August 2018

SVM: Maximum Margin with Noise in Machine Learning

Linear SVM Formulation
Limitations of previous SVM formulation

  • What if the data is not linearly separable?
  • Or noisy data points?

Extend the definition of maximum margin to allow no-separating planes.

Objective to be minimized

- Minimize
   + C (distance of error points to their correct zones)
- Add slack variable เฉฌi

Maximum Margin with Noise


 ๐›ผi's and ๐›ฝi's are Lagrange multipliers (≥ 0).

Dual Formulation

Find ๐›ผ1,๐›ผ2,.....,๐›ผm   s.t

Solution to Soft Margin Classification

  • xi with non-zero ๐›ผi will be support vectors.
  • Solution to the dual problem is:
(no need to compute w explicitly)

No comments:

Post a Comment