Manuscript illustration of William of Ockham.
Occam‘s razor (also Ockham‘s razor or Ocham‘s razor (Latin: novacula Occami); further known as the law of parsimony (Latin: lex parsimoniae)) is the problem-solving principle that essentially states that simpler solutions are more likely to be correct than complex ones. When presented with competing hypotheses to solve a problem, one should select the solution with the fewest assumptions
decision tress id3----iterative dichotomiser
https://blog.csdn.net/acdreamers/article/details/44661149
svm/loss /cost function, outliner/slack variables/ =====maximum marginal hyperplane classification.
https://blog.csdn.net/u012581541/article/details/51181041
loss fuction= loss term + regualarization term
losss term :
Gold Standard (ideal case) (0-1 loss)
Hinge (SVM,soft margin)
Log (logsitic regression,cross entropy error)
Squared loss(linear regression)
Exponential loss (boosting)
