P.S: I am beginner also I am not asking help in exam problem I have that problem in exam: Suppose you have 10 data points :(8,6),(9,2),(7,4),(2,0) ∈ x C1 (+ve) and (0,2),(-2,0),(3,5),(1,3.5) ∈ C2(-ve):
plot these training points and construct by inspection the weight vector for the optimal hyperplane ,and the optimal margin
what are the support vectors\
Construct the solution by finding the Lagrange multiplier
my answer: 1,2- svm-margin graph
3- After solve this optimization problem: min (1/2)w(transpose)w s.t : 2w1+w0 >=1, 6w1+4w2+w0>=1, 2*w2+w0<=-1.
I get one of the Lagrange multipliers is negative is it possible? if yes ,why? or it is just miscalculation from me.
The Lagrange multipliers $\mathbf{a}$ are found by solving the constrained minimization problem $$ \phi(\mathbf{a})= -\mathbf{1}_N^T \mathbf{a} +\frac{1}{2} \mathbf{a}^T \mathbf{H} \mathbf{a}, s.t. \mathbf{a} \ge \mathbf{0} $$ where $H_{ij}= y_i y_j \mathbf{x}_i^T \mathbf{x}_j$
The multipliers are either null (for non supporting vectors) or strictly positive otherwise.