Skip to content

Switched to pytest style output #103

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 4, 2024
Merged

Switched to pytest style output #103

merged 1 commit into from
Dec 4, 2024

Conversation

wenting-zhao
Copy link
Collaborator

# commit0 test HumanEval/0 outputs --backend local
============================= test session starts ==============================
platform linux -- Python 3.12.7, pytest-8.3.4, pluggy-1.5.0
rootdir: /testbed
plugins: cov-6.0.0, metadata-3.1.1, json-report-1.5.0
collected 7 items

test.py .F.F..F                                                          [100%]

=================================== FAILURES ===================================
____________________________________ test2 _____________________________________

    def test2():
>       assert candidate([1.0, 2.0, 3.9, 4.0, 5.0, 2.2], 0.05) == False
E       assert True == False
E        +  where True = candidate([1.0, 2.0, 3.9, 4.0, 5.0, 2.2], 0.05)

test.py:30: AssertionError
____________________________________ test4 _____________________________________

    def test4():
>       assert candidate([1.0, 2.0, 5.9, 4.0, 5.0], 0.8) == False
E       assert True == False
E        +  where True = candidate([1.0, 2.0, 5.9, 4.0, 5.0], 0.8)

test.py:36: AssertionError
____________________________________ test7 _____________________________________

    def test7():
>       assert candidate([1.1, 2.2, 3.1, 4.1, 5.1], 0.5) == False
E       assert True == False
E        +  where True = candidate([1.1, 2.2, 3.1, 4.1, 5.1], 0.5)

test.py:45: AssertionError
=========================== short test summary info ============================
FAILED test.py::test2 - assert True == False
FAILED test.py::test4 - assert True == False
FAILED test.py::test7 - assert True == False
========================= 3 failed, 4 passed in 0.04s ==========================

# commit0 test HumanEval/0 outputs --backend local --reference
============================= test session starts ==============================
platform linux -- Python 3.12.7, pytest-8.3.4, pluggy-1.5.0
rootdir: /testbed
plugins: cov-6.0.0, metadata-3.1.1, json-report-1.5.0
collected 7 items

test.py .......                                                          [100%]

============================== 7 passed in 0.02s ===============================

@wenting-zhao wenting-zhao merged commit 08617ff into main Dec 4, 2024
2 checks passed
@wenting-zhao wenting-zhao deleted the integration2 branch December 4, 2024 15:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant