Skip to content

Integration with sparklyr is failing, starting with parsnip 2.0 #671

Closed
@edgararuiz

Description

@edgararuiz

Recent sparklyr GHA R checks are failing on parsnip tests. These tests are new, and dev-version package testing is not yet working in GHA for sparklyr, so we didn't catch it until now.

reprex:

library(sparklyr)
library(parsnip)

sc <- spark_connect("local")
iris_tbl <- sdf_copy_to(sc, iris)

decision_tree(engine = "spark") %>%
  set_mode("classification") %>%
  fit(Species ~ Sepal_Length + Petal_Length, iris_tbl)
#> Error in eval_tidy(env$formula[[2]], env$data): object 'Species' not found

spark_disconnect(sc)

It looks like this is the check in which it happens:

check_outcome(eval_tidy(env$formula[[2]], env$data), object)

Also confirmed here: https://github.com/sparklyr/sparklyr/runs/5483357141?check_suite_focus=true#step:19:1469

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugan unexpected problem or unintended behaviornext release 🚀

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions