Skip to content

Conversation

@AhmedNusayer
Copy link

No description provided.

@darko-marinov
Copy link
Contributor

Why do you think that these tests deterministically fail? Do you have some logs of your results?

@AhmedNusayer
Copy link
Author

For each of the projects, I executed a script that runs NonDex using the following command.

# Run NonDex, NUMROUNDS rounds
timeout 3600s mvn edu.illinois:nondex-maven-plugin:2.1.1:nondex -DnondexRuns=${NUMROUNDS} > nondex_log.txt 2>&1 

The script then parses the nondex_log.txt file to identify the deterministically failed tests by reporting the tests listed under 'The following tests failed in the clean run:'.

[INFO] The following tests failed in the clean run: [WARNING] eu.fayder.restcountries.v2.CountryServiceTest#getByRegionalBloc

[INFO] The following tests failed in the clean run: [WARNING] cn.myperf4j.base.test.ILoggerTest#test [WARNING] cn.myperf4j.base.influxdb.InfluxDbV2ClientTest#testWrite

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants