Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Noting which tests fail in feature/survival branch (mostly frailtymod) #584

Open
jburos opened this issue Feb 8, 2023 · 0 comments
Open

Comments

@jburos
Copy link
Contributor

jburos commented Feb 8, 2023

Summary:

There are a dozen of failing tests in the feature/survival branch, specific to the test_stan_surv.R function. All appear to be related to the frailty model.

These are run against a WIP branch at https://github.com/jburos/rstanarm/tree/review-failing-tests, which is a fork of feature/survival branch in this repo that:

  1. removes a few of the JM or mvmer-specific changes in the feature/survival branch, and
  2. updates the syntax for tests to be consistent with current conventions.

Note: Some of these may be addressed by the sparse matrix fixes -- analogous to 22d6053 but for the survival model -- which I have in a separate branch. Reporting this here for the sake of transparency.

Description:

These are the failures:

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 0.521 - -2.3 == 2.82

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 0.487 - 0.3 == 0.187

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] -1.01 - -2.3 == 1.29

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 0.765 - 1 == -0.235

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 0.486 - 0.3 == 0.186

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 0.698 - -2.3 == 3

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 0.797 - 1 == -0.203

── Failure (test_stan_surv.R:776:3): (code run outside of `test_that()`) ───────
get_ests(modfrail)[[i]] not equal to true[[i]].
1/1 mismatches
[1] 1.25 - -2.3 == 3.55

[ FAIL 12 | WARN 649 | SKIP 0 | PASS 381 ]

Reproducible Steps:

After cloning the fork mentioned above:

git clone https://github.com/jburos/rstanarm/tree/review-failing-tests
cd rstanarm
git checkout review-failing-tests

Run the survival-model related tests.

> devtools::load_all()
> testthat::test_file('tests/testthat/test_stan_surv.R')

RStanARM Version:

> packageVersion("rstanarm")
[1] ‘2.21.2

R Version:

> getRversion()
[1] ‘4.2.0

Operating System:

Session info ───────────────────────────────────────────────────────────────
 setting  value
 version  R version 4.2.0 (2022-04-22)
 os       macOS 13.1
 system   x86_64, darwin17.0
 ui       RStudio
 language (EN)
 collate  en_US.UTF-8
 ctype    en_US.UTF-8
 tz       America/New_York
 date     2023-02-07
 rstudio  2022.12.0+353 Elsbeth Geranium (desktop)
 pandoc   2.19.2 @ /Applications/RStudio.app/Contents/Resources/app/quarto/bin/tools/ (via rmarkdown)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant