-
Notifications
You must be signed in to change notification settings - Fork 903
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[KED-2315] Versioning datasets fails with NotADirectoryError #625
Comments
The cause seems to be that previously the dataset was unversioned and a file already existed. After clearing the output folders manually it works. I still leave the ticket, because being able to switch a dataset from versioned to unversioned and back by just editing the catalog file could be something Kedro wants to support. |
Given the way versioning is implemented, this isn't possible (in a straightforward, intuitive manner, at least). That being said, this is a common issue users face, and it could be nice to check for an unversioned dataset and return a more meaningful error message in that case. |
@deepyaman Is right on this one. We do recognise that this is a poor user experience though. We'll look into it. I'll create a ticket for our backlog to try revisit this one again. |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Description
Adding the
versioned: true
attribute to a dataset results in pipeline failure.Context
The dataset versioning feature is not usable.
Steps to Reproduce
add
versioned: true
to a dataset in the catalogExpected Result
A directory named like the dataset should have been created, containing versions of the dataset.
Actual Result
fails with
NotADirectoryError
Your Environment
Include as many relevant details about the environment in which you experienced the bug:
python -V
): Python 3.7.8The text was updated successfully, but these errors were encountered: