Skip to content

Explain the configurations of the Transformer decoder please! #28

@sy-vann

Description

@sy-vann

Firstly, thank you for the awesome project. I am a bit confused about why you configured the Transformer decoder like this:

  d_model: 128
  dim_feedforward: 256
  nhead: 4
  dropout: 0.3
  num_decoder_layers: 3
  max_output_len: 150

How can I configure these parameters correctly?
Thank you for reading, and I hope you will respond to me soon.
@kingyiusuen

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions