Skip to content

idea: New testing paradigm: micro scale full collection test/verification #3774

@MoralCode

Description

@MoralCode

In addition to our smoke tests, I wonder if we could incorporate a new kind of test that either replaces, or adds onto it.

This test would:

  1. start up augur/initialize a DB very much like the smoke tests.
  2. somehow sneak in and mark the augur/augur repo as IGNORE (its too big to and takes too long to collect, would waste github resources)
  3. run for a few mintues - enough for comfortably finishing a full collection on some of our smaller default repos. (this may require introducing a special command line flag or something into augur to have it stop and shut itself down once it hits full collection and all tasks go idle)
  4. run some queries to validate the results, such as:
    • checking that chaoss/whitepaper was automatically ignored
    • checking that all commits in the commits table have proper author names etc (regression test)
    • checking that an appropriate number of contributors got resolved
    • run the self test?
    • anything else?

Metadata

Metadata

Assignees

No one assigned

    Labels

    containersRelated to augur in containers, container images, or the compose file, either in podman or in dockertestingRelated to Augur's testing suite

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions