Skip to content

Regression pipeline #23

Description

@woodruffw

Now that we have CI configured and automated submodule updates via Dependabot, it'd be interesting to hack together some kind of basic regression testing for our implemented workers. Something like this:

  1. We run the mishegos for a few hours to generate a decently sized corpus
  2. We run that corpus through our analysis passes to filter out true positives and negatives
  3. We save the filtered corpus somewhere (cloud storage?)
  4. On each Dependabot PR, we perform additional CI jobs to see if any of our results have changed

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions