I am working on a statistics project in which I analyze 4 different classification methods (mostly for binary classification and with quantitative input variables).
On the one hand I'm studying logistic regression with a lineal model or in combination with generalized additive models (piecewise polynomial, p-splines, natural splines...).
On the other hand, I also deal with de kNN algorithm (k-nearest neighbor) and the SVM.
I would like to include a section in my project where I explain which method to choose but I do not know how to approach that based on the different natures of the data.
Any help/hint?