You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have Kedro pipeline where sometime I see pipeline fails to load dataset due to some problem and I get error - "kedro.io.core.DatasetError: Failed while loading data". Is there any plan to provide on_dataset_load_error kind a hook just like we have on_node_error or on_pipeline_error so that I can do my desired things after a particular dataset load fails.
The text was updated successfully, but these errors were encountered:
thedevd
changed the title
on dataset load error hook just like before_dataset_loaded or after_dataset_loaded
support of on_dataset_load_error hook just like before_dataset_loaded or after_dataset_loaded
Aug 16, 2023
Actually in my pipeline few nodes are failing before execution while loading some datasets, and I want to handle any DataSetError via hook (Where I want to keep track of which dataset has failed to load and for which node, consider this kind case of making report of dataset failure) however there is no hook such as on_dataset_load_error in Kedro documentation for this scenario.
I have Kedro pipeline where sometime I see pipeline fails to load dataset due to some problem and I get error - "kedro.io.core.DatasetError: Failed while loading data". Is there any plan to provide on_dataset_load_error kind a hook just like we have on_node_error or on_pipeline_error so that I can do my desired things after a particular dataset load fails.
The text was updated successfully, but these errors were encountered: