In machine learning, a common task is attempting to find good hyperparameters for a learning algorithm. PEDL provides support for hyperparameter search as a first-class workflow. Several hyperparameter search algorithms are supported:
Here we give a brief introduction to the search methods. The fields mentioned in the descriptions below are specified under the
searcher field in the experiment configuration file.
In addition to the parameters that are specific to individual search algorithms, the following parameters may be provided for any algorithm.
metric: The name of the validation metric to use when comparing trials.
smaller_is_better: Whether a smaller value of
metricis considered better performance (e.g., this would be
truefor a loss metric and
falsefor an accuracy metric). Defaults to
source_checkpoint_uuid: Only one of these can be specified at a time. Initializes weights of all trials to some prior checkpoint. If not specified, model weights are initialized randomly.