Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Measure coverage for integration tests in CI #1893

Merged
merged 49 commits into from
Sep 15, 2023
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
99de732
Add a build step that builds with HPC enabled
Jul 12, 2023
8e59c10
Enable HPC via environmental variable
Jul 12, 2023
f8c4c20
Add missing `hpc` config on old LTS build
Jul 12, 2023
afb2f7e
Consistent order
Jul 12, 2023
fc0fcf7
Upload hpc artifacts
Jul 12, 2023
aac344c
Fix typo
Jul 12, 2023
25742ac
Force Windows 9.2.7 cache rebuild
Jul 12, 2023
481bb13
" -> '
Jul 12, 2023
740486a
Fix typo in artifact upload conditionals
Jul 13, 2023
9a8e287
Run linux intTests with HPC bins
Jul 13, 2023
1af0efa
Compute coverage from HPC files
Jul 14, 2023
ae23bdc
Fix missing '$'
Jul 14, 2023
0d7d80f
Upload .mix files as artifact
Jul 17, 2023
d3ff0a3
Generate HTML
Jul 17, 2023
0585c54
Capture autogenerated .hs files
Jul 17, 2023
89a4a19
Download hpc artifacts without creating new folder
Jul 18, 2023
aee9d31
Another stab at unpacking the HPC build files
Jul 18, 2023
ecb7f20
Cleanup some TODOs
Jul 20, 2023
41a524c
Pull coverage computation into separate script
Jul 20, 2023
356f6b3
Consistency in naming
Jul 20, 2023
0e6ce01
Merge remote-tracking branch 'origin/master' into bb/ci-coverage
Aug 10, 2023
62e831a
Upload html tagged with PR number
Aug 10, 2023
7e5ddc3
Attempt to serve with gh-pages
Aug 10, 2023
29c999f
Only upload to gh-pages if hpc is set
Aug 10, 2023
c93efc1
Set GH_TOKEN for collecting html
Aug 10, 2023
92cf702
Merge remote-tracking branch 'origin/master' into bb/ci-coverage
Aug 25, 2023
d45d96c
Generate simple HTML index for PRs
Aug 25, 2023
b4cd1a3
Initial cleanup + docs
Aug 25, 2023
3f05edf
Cleanup
Aug 25, 2023
58e4548
Only upload PR HTML
Aug 28, 2023
e7fa27a
Fix syntax error
Aug 28, 2023
63fb418
Split running tests with coverage into separate job
Sep 8, 2023
a6cba8e
Address comments in shell scripts
Sep 8, 2023
6325cc0
Add matrix to get more specific os string
Sep 8, 2023
b9400d4
Fix file permissions
Sep 8, 2023
0c07f87
Fix missing download of hpc.tar.gz
Sep 8, 2023
8519b88
Merge remote-tracking branch 'origin/master' into bb/ci-coverage
Sep 8, 2023
40166bf
Download artifact hpc.tar.gz to correct place
Sep 8, 2023
9d76d62
Remove checkout step
Sep 8, 2023
4a6a507
Bring dist/bin into hpc.tar.gz
Sep 8, 2023
e1be4bf
Remove unnecessary run-tests checks
Sep 8, 2023
2c5063c
Better documentation for `ci.yml`
Sep 8, 2023
fcf9c93
Package up necessary scripts and add gh-pages permissions
Sep 9, 2023
334ea75
Package up tests
Sep 9, 2023
f589a55
Package up supporting test files
Sep 11, 2023
8f9d070
Checkout repo
Sep 12, 2023
c36e85e
Merge remote-tracking branch 'origin/master' into bb/ci-coverage
Sep 14, 2023
2f2b267
Use solver caching
Sep 14, 2023
4ced21f
Re-enable accidentally disabled ubuntu integration tests
Sep 14, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions .github/ci.sh
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,14 @@ collect_hpc_files() {
tar cvf hpc.tar.gz ${MIX_FILES} ${GENERATED_HS_FILES}
}

collect_all_html() {
local HTML_DIR=all-html
mkdir ${HTML_DIR}
bboston7 marked this conversation as resolved.
Show resolved Hide resolved
(cd ${HTML_DIR} && gh run download -p "coverage-html-*")
ls
bboston7 marked this conversation as resolved.
Show resolved Hide resolved
ls ${HTML_DIR}
}

install_system_deps() {
(cd $BIN && curl -o bins.zip -sL "https://github.com/GaloisInc/what4-solvers/releases/download/$SOLVER_PKG_VERSION/$BUILD_TARGET_OS-bin.zip" && unzip -o bins.zip && rm bins.zip)
chmod +x $BIN/*
Expand Down
16 changes: 16 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -391,6 +391,9 @@ jobs:

cabal-test:
runs-on: ${{ matrix.os }}
permissions:
pages: write
id-token: write
needs: [build]
strategy:
fail-fast: false
Expand Down Expand Up @@ -498,6 +501,19 @@ jobs:
path: hpc-html
name: coverage-html-${{ github.event.number }}

- shell: bash
bboston7 marked this conversation as resolved.
Show resolved Hide resolved
if: matrix.hpc == true
run: .github/ci.sh collect_all_html

- name: Upload pages artifact
uses: actions/upload-pages-artifact@v1
with:
path: all-html

- name: Deploy to github pages
id: deployment
uses: actions/deploy-pages@v2

build-push-image:
runs-on: ubuntu-22.04
needs: [config]
Expand Down
Loading