Machine Learning Basics

When data is split into training, validation and test sets, which of the following is the main use of the validation set?

  1. ATuning hyperparameters and comparing several models
  2. BComputing the error used to update the model's weights
  3. CBeing used only once at the end of development to estimate the performance of the finished model
Show answer and explanation

Answer: A. Tuning hyperparameters and comparing several models

The training set is used to determine the model's weights, and the validation set is used to tune hyperparameters such as the learning rate and the number of layers, and to compare which model to adopt. The test set is used only once, after all such tuning is finished, to estimate performance on unseen data. Tuning repeatedly while watching validation results gradually fits the model to the validation set as well, so a separately reserved test set is needed for the final evaluation.

  • A. Correct. It is used for tuning hyperparameters and selecting models.
  • B. The training set is what is used to update the weights.
  • C. This is how the test set is used.
Practice this topic Back to topic

Related calculators

Books on Machine Learning Basics Ad

As an Amazon Associate I earn from qualifying purchases.

More Machine Learning Basics questions

  1. When 5-fold cross-validation (k-fold cross-validation with k = 5) is performed on 1000 data points, how many data points are used for each round of training?
  2. Which of the following is seen when overfitting is occurring?
  3. Which of the following is correct when a model's error is considered in terms of bias and variance?
  4. Which of the following correctly describes regularization and related methods for reducing overfitting?
  5. Which of the following steps in building a machine learning model causes data leakage (information from the evaluation data slipping into training)?