Skip to content

Add regression testing #1

@justinlubin

Description

@justinlubin

Add a suite of regression tests that checks each of the benchmarks against the previous version of Smyth to see if the synthesis outputs change.

It would be useful to have modes for this feature that allow for:

  • Checking to see if the synthesis output is the exact same string as before
  • Checking to see if the synthesis output is the exact same AST as before
  • Checking to see if the synthesis output is in the same ranked order as before

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature for the command-line tool

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions