AE 06: Tune your workflows

Note

This application exercise is completed in class and submitted via a worksheet.

Discussion questions

1. Identify if the following are tuning parameters

   ______ Learning rate in a boosted tree model

   ______ Coefficients in a linear regression model

   ______ Number of neighbors in a K-nearest neighbor model

   ______ Number of knots in a spline basis expansion

   ______ Weights in a neural network

   ______ The random seed used to initialize the model fitting

2. Identify for each scenario which type of grid is more appropriate

   Scenario	Potential values	Regular	Space-filling
   Number of tuning parameters	Low/high
   Prior knowledge of tuning parameters	Unknown/known ranges
   Computational budget	Limited/ample
   Interpretability needs	Low/high