The integration tests are exposed as cabal test suite
integration_tests. The default tests can be run with:
cabal test --enable-tests integration_tests
For each test_* directory that is not listed in the DISABLED_TESTS
environment variable or the disabled_tests.txt if the environment variable
isn't set, invoke the test.sh in that directory with some supporting
environment variables set. The test.sh should complete with a return code of 0
on no error or non-zero on error.
If the DISABLED_TESTS environment variable is set, the disabled_tests.txt
file is ignored. Both may specify tests separated by spaces and/or newlines, and
the # character starts a comment to the end of the current line.
The ENABLED_TESTS environment variable, if set, overrides the set of
discovered tests to include only those in the ENABLED_TESTS list. This
environment variable is commonly used during development to run specific tests
(which cabal test does not easily support).
A test is defined by a directory which contains a shell script called "test.sh";
the test succeeds when the shell script does. When run as part of the suite,
these "test.sh" scripts are interpreted by bash.
Tests generally consist of a SAW script that is expected to succeed together with the artifacts that are needed. The test suite defines the environment variable "SAW", pointing to the corresponding executable, and with appropriate Java classpaths included. It's a good idea to include a README in each test directory.
If the test directory name starts with "test", and the directory name is not
included in the disabled_tests.txt file or DISABLED_TESTS environment
variable, then the test is run by default. Only default tests are run on the
build slaves. When disabling a test by default, explain why in that test's
README.