Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added podman local system tests #1009

Merged
merged 2 commits into from
Jun 30, 2022
Merged

Added podman local system tests #1009

merged 2 commits into from
Jun 30, 2022

Conversation

stefins
Copy link
Contributor

@stefins stefins commented Jun 25, 2022

Hi,

This PR adds podman's local system tests to the CI and produces the summary like this.

As of now 134 tests out of 360 fails to run as of using youki as the runtime opposed to crun

Related to #902
Thanks :)

Signed-off-by: Stefin <stefin@pm.me>
@codecov-commenter
Copy link

codecov-commenter commented Jun 25, 2022

Codecov Report

Merging #1009 (f4bb573) into main (77d8ecf) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1009   +/-   ##
=======================================
  Coverage   69.22%   69.23%           
=======================================
  Files         118      118           
  Lines       12440    12439    -1     
=======================================
  Hits         8612     8612           
+ Misses       3828     3827    -1     

@utam0k
Copy link
Member

utam0k commented Jun 26, 2022

@stefins Thanks for your PR. How can I see the test result?

run: sudo OCI_RUNTIME=/usr/local/bin/youki ./hack/bats 2>&1 | tee build.log
- name: Adding Summary
run: |
echo "Total tests: 360 Failed tests: $(cat build.log | grep " ok " | wc -l)" >> $GITHUB_STEP_SUMMARY
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The expression is currently not evaluated. The test just prints
"Total tests: 360 Failed tests: $(cat build.log | grep " ok " | wc -l)" >> $GITHUB_STEP_SUMMARY

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't wanted to add a RED status to the CI.

@Furisto
Copy link
Collaborator

Furisto commented Jun 26, 2022

Maybe we should run this nightly? Running tests for 31 minutes on every pull request is quite long.

@stefins
Copy link
Contributor Author

stefins commented Jun 27, 2022

Maybe we should run this nightly? Running tests for 31 minutes on every pull request is quite long.

Yeah that what I also thought.

@stefins stefins requested a review from Furisto June 30, 2022 07:11
@Furisto Furisto merged commit d118b22 into youki-dev:main Jun 30, 2022
@Furisto
Copy link
Collaborator

Furisto commented Jun 30, 2022

Thank you @stefins

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants