[schema] Ensuring that the slice datasource fields are non-nullable #7114
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
We've noticed a number of anomalies in our database caused by ill-defined forms and/or table schema definitions. This PR resolves a number of issues related to the
slices
table including:datasource_id
column is not-NULL.datasource_name
column is not-NULL.datasource_type
column is non-NULL.Long terms we should look at trying to deprecate the denormalized
datasource_name
column which can (and should) be inferred from the (datasource_id
,datasource_type
) tuple. I believe the reason for its existence is mostly legacy however it may be required for importing/exporting of slices where one must identify entities by name rather than ID.Note this migration will fail if the
slices.datasource_id
,slices.datasource_name
, orslices.datasource_type
column is NULL. One must manually fix these records as programmatically trying to remedy these invalid records is difficult as it may not be apparent what the corresponding datasource should be given the possibly lack of information. The following query determines which records are problematic:Note this PR is gated by #5445 and #7084 which ensure that empty strings associated with form-data wont persist in the database and is necessary for ensuring that the relevant entries are non-NULL.
to: @graceguo-supercat @michellethomas @mistercrunch