English
Menu

Machine Learning Basics

Which of the following is seen when overfitting is occurring?

  1. AThe error on the training data is small, but the error on the validation data is large
  2. BThe error stays large and does not fall on either the training data or the validation data
  3. CAs training proceeds, the errors on the training data and on the validation data both keep falling in the same way
Show answer and explanation

Answer: A. The error on the training data is small, but the error on the validation data is large

Overfitting is a state in which the model memorizes fine details and noise in the training data, so its performance on new data (generalization performance) drops. A small error on the training data together with a large error on the validation data is the telltale sign. A large error even on the training data indicates underfitting, in which the model fails to capture the trend, for example because it is too simple. Remedies include adding data, simplifying the model, regularization, dropout, and early stopping, which ends training when the validation error starts to rise.

  • A. Correct. The model fits the training data too closely, and its error on new data becomes large.
  • B. This is underfitting.
  • C. This shows training progressing well. With overfitting, the validation error starts to rise partway through.
Practice this topic Back to topic

Related calculators

Confusion matrix calculatorCompute accuracy, precision, recall, F1, specificity, MCC and other metrics from TP, FN, FP and TNCNN output size calculatorStack convolution, pooling and fully connected layers and get each layer's output size, parameter count and multiply-accumulate count

Books on Machine Learning Basics Ad

As an Amazon Associate I earn from qualifying purchases.

More Machine Learning Basics questions

  1. Which of the following is correct when a model's error is considered in terms of bias and variance?
  2. Which of the following correctly describes regularization and related methods for reducing overfitting?
  3. Which of the following steps in building a machine learning model causes data leakage (information from the evaluation data slipping into training)?
  4. A two-class classification model was evaluated on 200 test samples, and its confusion matrix shows 45 true positives (TP), 5 false positives (FP), 45 false negatives (FN) and 105 true negatives (TN). Which pair of precision and recall is correct?
  5. A two-class classification model was evaluated on 200 test samples, giving TP = 20, FP = 5, FN = 30 and TN = 145. Which is closest to the F1 score?