Make KedroPipelineModel compatible with a broader range of kedro version #483
Labels
enhancement
New feature or request
waiting-for-kedro
The implementation of this feature is blocked by a ticket in kedro
Description
KedroPipelineModel
stores several kedro objects (Datacatalog
,Pipeline
,Runner
). Since this object is pickled, any slight change in one of the underlying kedro objects (e.g. a private attribute) prevents loading with the model if you don't have the exact kedro version used for training.Context
This forces users to retrain model almost every time they upgrade their kedro version, which is painful when training is slow.
Possible Implementation
Store the configuration of the object (e.g. convert back DataCatalog config to a dict, and the pipeline to a json file).
The text was updated successfully, but these errors were encountered: