This is a collection of trivial functions to facilitate generating and exploring test coverage information for Julia packages locally, without using any remote/cloud services.
Pkg.add("LocalCoverage")
or ]add LocalCoverage
from the Julia REPL.
The package has several optional features which require additional dependencies.
lcov
is required for generating HTML
output. You can install it via
- Debian/Ubuntu:
sudo apt install lcov
- Arch/Manjaro:
yay -S lcov
Note that the code in this package assumes a reasonably recent lcov
version when calling genhtml
, ideally 1.13
, but 1.12
should work too. This does not prevent installation, only emits a warning.
LocalCoverage
also provides an option to generate a
Cobertura XML, which is used by JVM-related test
suites such as Jenkins. Using this requires the Python module
lcov_cobertura
(>= v2.0.1).
With Python installed, you can install this module via pip install lcov_cobertura
.
When generating test coverage, Julia places annotated *.cov
source code files in the same directory as the source code itself. Those files are processed to evaluate coverage data, represented by the PackageCoverage
struct, and are automatically removed by the package. An coverage/lcov.info
file is also created in the package dir. We recommend using this package
with packages added with the Pkg.dev
installation option (which allows for easy
manipulation of the package directory).
To generate test coverage data do
using LocalCoverage
# pkg is the package name as a string, e.g. "LocalCoverage"
generate_coverage(pkg = nothing; run_test = true) # defaults shown
You can then navigate to the coverage
subdirectory of the package directory (e.g.
~/.julia/dev/PackageName/coverage
) and see the generated coverage summaries. Note that the test execution step may be skipped if *.cov
files were already generated (possibly by some external package).
To generate, and optionally open, the coverage report HTML do
html_coverage(coverage::PackageCoverage; open = false, dir = tempdir()) # defaults shown
A utility method is also provided to easily print coverage statistics and exit with a status reflecting if some given target coverage was met. It can be used from a shell by doing
julia --project -e'using LocalCoverage; report_coverage_and_exit(target_coverage=90)'