Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refund feature spec fails sporadically on CI #242

Open
forkata opened this issue Jul 20, 2023 · 1 comment
Open

Refund feature spec fails sporadically on CI #242

forkata opened this issue Jul 20, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@forkata
Copy link
Collaborator

forkata commented Jul 20, 2023

What

A feature spec we recently introduced has started failing sporadically on CI. In order to get the build passing and unblock us from merging PRs we've marked this test as pending.

Why

Some initial investigation showed that on some runs on CI, the order we create through the factory is not getting tax adjustments for it's line items, which means when we create the return the reimbursement does not include that amount. The strange thing is that this is the only feature spec we have that fails this way.

Passing Run

screenshot_2023-07-19-22-21-44 796

Failing Run

screenshot_2023-07-19-22-50-30 460

@forkata forkata added the bug Something isn't working label Jul 20, 2023
@benjaminwil
Copy link
Member

We've been unable to reproduce this locally but have SSHed into CI runners and run rspec --bisect to reveal that some seeds fail consistently--but only in CI.

But each consistently-failing bisect with seed gives us just two tests, the second test always being this refund spec. But the first test always being different (so far).

We think there is a test-order dependency somewhere we just don't have enough information to find out what exactly it could be.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants