Better interactive tests #509
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
michael-schwarz
approved these changes
Dec 21, 2021
Member
|
Maybe we should document somewhere, how these new patches have to be created to have the exact multiple-file format. |
Member
Author
|
That is probably a good idea. I could write a paragraph about the incremental tests in the Developer Guide -> Testing chapter of Goblint's documentation? |
Member
That would be a good place indeed. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR extends the regression test script for incremental tests to also handle patch files that contain changes in multiple files. This can be used to encode changes in the configuration for the incremental run. An instance for which this is needed is the implemented test case that targets the forceful re-evaluation of functions with an increased precision.
Due to the mentioned test case we noticed that the precision refinement is not compatible with the reluctant destabilization yet. Therefore I deactivated this option in the test case and created a new issue for this (#508).