Open
Description
From prototype milestones document
- Data provenance cataloging
- Data lifecycle management
- Intermediate product management
- Policy for purging of intermediate data
Data Provenance and Metadata Models
https://lucid.app/lucidchart/35db775a-2e6b-4260-b85d-657b032708f3/edit?invitationId=inv_66826eda-b7b7-42ee-bb52-319c626de866&page=0_0# might be a useful item for some of the Data Product domain Model work.
what provenance is needed, where does it come from, how will that be ingested as part of the 'ingestion workflow'. Note: the implementation of that ingestion doesn't need to be complete, but we should have an idea of it w.r.t. the model. Is it a part of the request? (e.g. in the CNM? is it a sidecar file?)
Lifecycle Management
Not all data products should be kept forever...
User data vs generated data?
Data without a specified "collection" ?