Implement linear SVM

Introduction

日本語 ver

Today, I implement liner SVM (support vector machine).
SVM is one of the most strong algorithm of machine learning before becoming popular Deep learning.
I will write detail of Logic of liner SVM in other posts.

# I finished writing theorem of SVM.
Theorem of SVM part1

My computer is windows. OS is windows. Program is written by Python3.
This program is used Interrior point method in Oputimization.

Dataset

I used two dataset.
First, I used data separated by hyper plane.
Second, I used data mixed \(C_1\) and \(C_2\).
First data is distributed such as the following.

I can write separate line of distribution.
Second data is distributed such as the following.

I can not write separate line of distribution.
I will try liner SVM about these data.

Implementation

• data1
  

This line is hyper plane.
It is written like copperplate.

• data2
  I tried to estimate hyper plane by variable C.

C value cause this line.
The smoller C value is the easier permitting miss classification.
It is difficult for our to confime effect of C.
It is easy to confime effect of C when I use non liner SVM.
I will write non liner SVM another post.

CODE

My code of liner SVM is opend to the github.
My SVM code is here
File used this time is git_SVM_check.py and git_SVM_def.py .
git_SVM_check.py is main file had following code.

if __name__ == '__main__':

git_SVM_def have class of SVM and code of interror point method.
I will write post of nonliner SVM.
If you see next post also ,I am very glad.