You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
The Regression tests at this point only compare new results to old results and it is checked whether the results are bit 4 bit reproducible. However, this is not enough. The regression tests need to be extended in terms of:
Performance, e.g. if a pull request results in performance penalties this needs to be explained or rejected.
Accuracy, e.g. laboratory experiments or field cases needs to be elaborated in terms of changes in the accuracy. Pull requests resulting in penalties in accuracy needs to be addressed or rejected.
Parallel scalability needs to be tested as well, e.g. if the scalability is degraded it needs to be addressed or rejected.
Memory usage, if the memory usage is increased, it needs to be addressed or rejected as well.
Describe the solution you'd like
Add performance, accuracy, scalability and memory usage to the metrics.
Describe alternatives you've considered
no alternative
Additional context
none
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
The Regression tests at this point only compare new results to old results and it is checked whether the results are bit 4 bit reproducible. However, this is not enough. The regression tests need to be extended in terms of:
Describe the solution you'd like
Add performance, accuracy, scalability and memory usage to the metrics.
Describe alternatives you've considered
no alternative
Additional context
none
The text was updated successfully, but these errors were encountered: