Trending Technology Machine Learning, Artificial Intelligent, Block Chain, IoT, DevOps, Data Science

Recent Post

Codecademy Code Foundations

Search This Blog

SVM: Maximum Margin with Noise in Machine Learning

Linear SVM Formulation
 
Limitations of previous SVM formulation


  • What if the data is not linearly separable?
  • Or noisy data points?

Extend the definition of maximum margin to allow no-separating planes.

Objective to be minimized

- Minimize
   w.w
   + C (distance of error points to their correct zones)
- Add slack variable ੬i

Maximum Margin with Noise


Lagrangian

 𝛼i's and 𝛽i's are Lagrange multipliers (≥ 0).

Dual Formulation

Find 𝛼1,𝛼2,.....,𝛼m   s.t




Solution to Soft Margin Classification

  • xi with non-zero 𝛼i will be support vectors.
  • Solution to the dual problem is:
(no need to compute w explicitly)

3 comments:

  1. Going to graduate school was a positive decision for me. I enjoyed the coursework, the presentations, the fellow students, and the professors. And since my company reimbursed 100% of the tuition, the only cost that I had to pay on my own was for books and supplies. Otherwise, I received a free master’s degree. All that I had to invest was my time. Innosilicon A11 Pro

    ReplyDelete
  2. Thanks for your insight for your fantastic posting. I’m exhilarated I have taken the time to see this. It is not enough; I will visit your site every day. Body sculpting machine

    ReplyDelete
  3. There are many kinds of commercial ice machines for sale on the market, and sometimes it is difficult to decide which is best for your business. tube ice machine

    ReplyDelete

John Academy