Skip to content

ci: add nightly backward compatibility testing with e2e tests #2063

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Oct 30, 2024

Conversation

dlachaume
Copy link
Collaborator

@dlachaume dlachaume commented Oct 30, 2024

Content

This PR includes a script and workflow setup to run daily backward compatibility tests at 2:00 UTC (and temporarily at 14:00 UTC) between the latest unstable version and previous stable distributions.

Pre-submit checklist

  • Branch
    • Tests are provided (if possible)
    • Crates versions are updated (if relevant)
    • CHANGELOG file is updated (if relevant)
    • Commit sequence broadly makes sense
    • Key commits have useful messages
  • PR
    • No clippy warnings in the CI
    • Self-reviewed the diff
    • Useful pull request description
    • Reviewer requested
  • Documentation
    • Update README file (if relevant)
    • Update documentation website (if relevant)
    • Add dev blog post (if relevant)

Issue(s)

Relates to #2027

@dlachaume dlachaume self-assigned this Oct 30, 2024
@dlachaume dlachaume changed the title ci: create script to download distribution binaries and new workflow … ci: add nightly backward compatibility testing with e2e tests Oct 30, 2024
…to run the nightly backward compatibility testing with e2e tests.

Co-authored-by: Jean-Philippe Raynaud <jpraynaud@users.noreply.github.com>
@dlachaume dlachaume force-pushed the ensemble/2027/nightly-backward-compatibility-testing branch from 26f111c to 28f2427 Compare October 30, 2024 12:02
Copy link
Member

@jpraynaud jpraynaud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

Copy link

github-actions bot commented Oct 30, 2024

Test Results

    4 files  ±0     51 suites  ±0   10m 28s ⏱️ +3s
1 400 tests ±0  1 400 ✅ ±0  0 💤 ±0  0 ❌ ±0 
1 611 runs  ±0  1 611 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit f5b1a3b. ± Comparison against base commit ff9b5a3.

♻️ This comment has been updated with latest results.

@dlachaume dlachaume requested a review from sfauvel October 30, 2024 13:25
@dlachaume dlachaume temporarily deployed to testing-sanchonet October 30, 2024 13:34 — with GitHub Actions Inactive
@dlachaume dlachaume merged commit bd9b7be into main Oct 30, 2024
50 of 51 checks passed
@dlachaume dlachaume deleted the ensemble/2027/nightly-backward-compatibility-testing branch October 30, 2024 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants