Skip to content

Populate default hyperparameter ranges in the model metadata. #322

@ablaom

Description

@ablaom

When optimizing the hyperparematers of some model, the user needs to choose a reasonable range of values over which to search (using a Grid or RandomSearch, say). We should like to include in the model metadata default choices for these ranges. R’s caret package already has this information for over 200 models, and one idea is to scrape the data from there (assuming there is no IP issue preventing this). However, there need not be a precise one-to-one correspondence between hyperparameter names, and so forth, so you would take your time sorting out the correspondence. Even if we did this for a dozen of the most popular models, this would be a nice enhancement.

julia> some_model = models()[1];

julia> some_model.hyperparameters
(:n_iter, :tol, :alpha_1, :alpha_2, :lambda_1, :lambda_2, :compute_score, :threshold_lambda, :fit_intercept, :normalize, :copy_X, :verbose)

julia> some_model.hyperparameter_ranges
(nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)

So nothing means "none defined yet".

The manual explains how to set these traits for a model: search for hyperparameter_ranges in this section.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions