Skip to content

Ability to make hyperparameters constant #115

Closed
@ravinkohli

Description

@ravinkohli

For some experiments, we may want to set certain hyperparameters to be constant. This currently can be done if we want to include components for ex, include={'trainer': ['StandardTrainer']} or for categorical hyperparameters by simply sending a single value into the value_range parameter of an update, for ex, HyperparameterSearchSpaceUpdate(node_name="network_backbone", hyperparameter="ShapedResNetBackbone:resnet_shape", value_range=['brick'], default_value='brick').

However, for integer or float hyperparameter, ConfigSpace gives an error if we want to set the lower and upper to the same value. This can be done either via another parameter such as 'make_constant' in the HyperparameterSearchSpaceUpdate or as decided earlier we can encapsulate ConfigSpace by introducing a search_space module that can handle such an update elegently

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions