-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Crossprop tests for bitwise and blockinfo #309
Conversation
Codecov ReportAttention:
Additional details and impacted files@@ Coverage Diff @@
## main #309 +/- ##
==========================================
+ Coverage 91.38% 91.45% +0.06%
==========================================
Files 40 40
Lines 13803 13936 +133
Branches 13803 13936 +133
==========================================
+ Hits 12614 12745 +131
+ Misses 558 545 -13
- Partials 631 646 +15 ☔ View full report in Codecov by Sentry. |
ba81a5a
to
1c7687a
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't really have anything else to add. The other issue with crosscheck
with env is already noted.
1c7687a
to
8978e13
Compare
Tests are failing randomly when checking the expression Any take on that @Acaccia @obycode ?
|
@csgui I don't know why this test gives you this result, but it would be nice to get the explanation before merging this PR. Because for now, I have no idea if it's the test that is wrong, or if there is a bug in the code. |
@Acaccia Yep, that is the reason I have opened this discussion. Maybe more pair of 👀 can bring some light to this issue. |
In the simulation, when the datastore is created, the time is saved, then each block is assigned a time that is this genesis time plus height * some constant. This means that if the creation times of the two datastores (one for the interpreter and one for clarity-wasm) are different, then this value will be different, in this case by 1 second. |
That seems like a serious bug to me. Not for the code concerned by this PR but for all the crosscheck tests in general. I'm not sure we can rely on the compared results if both have different initial values for the datastore. Can't we create only one at the beginning and clone it? |
🤔 ... fair point @Acaccia . We are relying on different TestEnvironment instances for both Seems that we should tackle that. |
17f3f26
to
1a4a4ed
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since this is supposed to be the introduction to crossprop, would it be possible to add documentation to each crosscheck functions?
That would be helpful for newcomers.
4d35643
to
f2b2c93
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @csgui!
Initial pull request with some
crossprop
tests:I would like to validate the approach in this PR to make it the base for other implementations.