Skip to content

Conversation

@chongshenng
Copy link
Member

@chongshenng chongshenng commented Aug 20, 2025

In our e2e tests, the dependency resolution of some frameworks can take very long and time-out after 10 minutes, for example in e2e-tensorflow. Caching can help overall, but it still relies on the dependencies to be resolved in the first place.

This PR introduces uv into our CI to resolve any dependencies in our e2e tests, with the long term view of:

  1. Enabling Flower to officially support Python 3.13 (as in feat(framework): Add Python 3.13 to matrix CI #5249)
  2. Adopting uv in our workflows.

Note that the Python caching is commented out and left in the CI script to facilitate switching to uv caching later.

Merge before

@github-actions github-actions bot added the Maintainer Used to determine what PRs (mainly) come from Flower maintainers. label Aug 20, 2025
@chongshenng chongshenng changed the title ci(framework): Use uv to run e2e tests ci(framework): Use uv to run e2e tests with Python 3.10 Aug 20, 2025
Comment on lines +218 to +224
# - name: Cache Python location
# if: ${{ needs.changes.outputs.framework == 'true' }}
# id: cache-restore-python
# uses: actions/cache/restore@v4
# with:
# path: ${{ env.pythonLocation }}
# key: pythonloc-${{ runner.os }}-${{ matrix.directory }}-${{ env.pythonLocation }}-${{ hashFiles(format('./framework/e2e/{0}/pyproject.toml', matrix.directory)) }}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this commented out? We tend to delete thing instead of commenting them out

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for highlighting. I mentioned this in the comment of this PR - the idea was to remind us to swap it out to uv caching later. But we can remove it to maintain cleanliness.

Comment on lines 261 to 263
# - name: Run reconnection test with SQLite database (Temporarily disabled due to in-memory ObjectStore)
# if: ${{ needs.changes.outputs.framework == 'true' && matrix.directory == 'e2e-bare' }}
# run: ./../test_reconnection.sh sqlite
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@danieljanes Based on your comment, should we delete these lines too?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Maintainer Used to determine what PRs (mainly) come from Flower maintainers.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants