Skip to content

Commit

Permalink
Merge pull request #9668 from gilles-peskine-arm/analyze_outcome-spli…
Browse files Browse the repository at this point in the history
…t-dev

Split check_test_cases.py and outcome_analysis.py
  • Loading branch information
gilles-peskine-arm authored Oct 10, 2024
2 parents e21e9c3 + 8fa4964 commit 80352ac
Show file tree
Hide file tree
Showing 6 changed files with 28 additions and 609 deletions.
2 changes: 1 addition & 1 deletion docs/architecture/testing/test-framework.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ Each test case has a description which succinctly describes for a human audience
* Make the description descriptive. “foo: x=2, y=4” is more descriptive than “foo #2”. “foo: 0<x<y, both even” is even better if these inequalities and parities are why this particular test data was chosen.
* Avoid changing the description of an existing test case without a good reason. This breaks the tracking of failures across CI runs, since this tracking is based on the descriptions.

`tests/scripts/check_test_cases.py` enforces some rules and warns if some guidelines are violated.
`framework/scripts/check_test_cases.py` enforces some rules and warns if some guidelines are violated.

## TLS tests

Expand Down
10 changes: 7 additions & 3 deletions scripts/ci.requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -7,9 +7,13 @@
# 2.4.4 is the version in Ubuntu 20.04. It supports Python >=3.5.
pylint == 2.4.4

# Use the earliest version of mypy that works with our code base.
# See https://github.com/Mbed-TLS/mbedtls/pull/3953 .
mypy >= 0.780
# Use a version of mypy that is compatible with our code base.
# mypy <0.940 is known not to work: see commit
# :/Upgrade mypy to the last version supporting Python 3.6
# mypy >=0.960 is known not to work:
# https://github.com/Mbed-TLS/mbedtls-framework/issues/50
# mypy 0.942 is the version in Ubuntu 22.04.
mypy == 0.942

# At the time of writing, only needed for tests/scripts/audit-validity-dates.py.
# It needs >=35.0.0 for correct operation, and that requires Python >=3.6,
Expand Down
Loading

0 comments on commit 80352ac

Please sign in to comment.