Skip to content

Support for additional hyperparameters #416

@qychen2001

Description

@qychen2001

Very good work!
But when I wanted to use hyperparameter search for thesis result reproduction, I realized that the implementation of this repository ignores a lot of hyperparameters. For example dropout etc. The absence of these parameters will hinder the further use of this work in scientific comparisons.
So is it considered to add additional hyperparameters?
Below is an example of FT-Transformer showing the hyperparameter space in the original paper and the version implemented in this repository.

image
image

For a more detailed comparison check out the original repository implementation.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions