Machine Learning Basics
When data is split into training, validation and test sets, which of the following is the main use of the validation set?
- ATuning hyperparameters and comparing several models
- BComputing the error used to update the model's weights
- CBeing used only once at the end of development to estimate the performance of the finished model
Show answer and explanation
Answer: A. Tuning hyperparameters and comparing several models
The training set is used to determine the model's weights, and the validation set is used to tune hyperparameters such as the learning rate and the number of layers, and to compare which model to adopt. The test set is used only once, after all such tuning is finished, to estimate performance on unseen data. Tuning repeatedly while watching validation results gradually fits the model to the validation set as well, so a separately reserved test set is needed for the final evaluation.
- A. Correct. It is used for tuning hyperparameters and selecting models.
- B. The training set is what is used to update the weights.
- C. This is how the test set is used.