Skip to content

Not able to reproduce the experimental results #2

@Salomeeeee

Description

@Salomeeeee

Hi @rktamplayo , thank you for your great work!
I followed the README.md to reproduce the experimental results on Amazon dataset but encountered a few problems.

  1. While running train_abstract.py in TRAIN mode, my program always exited in epoch 7-8, with loss around 3.9. The Dev ACC fluctuated between 0.2 to 0.23 within the process. Is this normal?
  2. While running train_abstract.py in EVAL mode, the output seemed illogical, and quite different from the output in output/amazon/plansum.sol:
    1645791478(1)
    As above, some irrelevant words (like tv, computer) appeared in the review summary (about cloth).
    I'd appreciate it a lot if you can help :-)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions