Machine Learning Basics

Which of the following describes a support vector machine (SVM)?

  1. AIt draws the boundary so that the average distance from all points to the boundary is maximized, using all the training points as evenly as possible
  2. BAmong the boundaries that separate two classes, it chooses the one that maximizes the distance (margin) to the data closest to the boundary (the support vectors)
  3. CIt assumes that each feature is mutually independent within each class and classifies by computing the probability of each class with Bayes' theorem
Show answer and explanation

Answer: B. Among the boundaries that separate two classes, it chooses the one that maximizes the distance (margin) to the data closest to the boundary (the support vectors)

An SVM is a classification method that chooses, among the boundaries (hyperplanes) separating two classes, the one with the largest margin. The boundary is determined only by the few data points closest to it (the support vectors) and does not change if other data points move slightly. A boundary with a large margin is considered less likely to make mistakes on new data as well. For data that cannot be separated by a straight line, the kernel method gives the same effect as separating the data in a higher-dimensional space.

  • A. Only the support vectors closest to the boundary determine the boundary.
  • B. Correct. It chooses the boundary that maximizes the margin.
  • C. This describes naive Bayes classification.
Practice this topic Back to topic

Related calculators

Books on Machine Learning Basics Ad

As an Amazon Associate I earn from qualifying purchases.

More Machine Learning Basics questions

  1. 20% of all emails are spam. A certain word appears in 50% of spam emails and in 5% of non-spam emails. Which is closest to the probability that an email containing this word is spam?
  2. Which logic function cannot be represented by a simple perceptron consisting only of input and output layers (a single neuron that outputs 0 or 1 with a threshold)?
  3. In a three-class classification, the values input to the softmax function (logits) are 3, 1 and 0. About how many times the second class's output (probability) is the first class's output? Which is closest?
  4. A small neural network with inputs x₁ = 1 and x₂ = 2 has two hidden neurons h₁ = ReLU(x₁ + x₂ − 1) and h₂ = ReLU(x₁ − 2x₂ + 1), and output y = 2h₁ + 3h₂ + 1. What is the value of y?
  5. Let p be the probability that a model outputs for the correct class. Which of the following describes the cross-entropy loss −log p used to train classifiers?