Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add framework support to regenerate all snapshot files #277

Open
2 tasks
nickbattam-tessella opened this issue Jan 8, 2021 · 0 comments
Open
2 tasks

Add framework support to regenerate all snapshot files #277

nickbattam-tessella opened this issue Jan 8, 2021 · 0 comments
Labels
Testing Related to testing

Comments

@nickbattam-tessella
Copy link
Member

The ISIS extension to the MATLAB testing framework adds a "TestCaseWithSave" class that performs a snapshot test against results cached in a .mat file.

These files can be (re)generated by instantiating the class with a '-save' argument. This must be done on a test-by-test basis, there is no way to perform this via the runtests(...)

Note: running all tests with the '--updateSnapshot' flag should be considered carefully, any tests failures resulting from bugs could potentially update the snapshots to contain incorrect data.

Whether "all" snapshots or only snapshots for failing tests are updated is considered an implementation detail as it has no material impact on the resulting test behaviour.

Output:

  • new '-updateSnapshot' argument support in runtest(...) method
  • instances of TestCaseWithSave that are executed will regenerate the snapshot files
@nickbattam-tessella nickbattam-tessella added the Testing Related to testing label Jan 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Testing Related to testing
Projects
None yet
Development

No branches or pull requests

1 participant