DQ: Deleted columns can result in empty data quality rules

[axelstudios]

Expected Behavior

Deleting a column (currently only via API) should delete associated data quality rules

Actual Behavior

It does not. Impact is low because data quality checks appear to still function, the broken rules are ignored

Steps to Reproduce

1. Create a data quality rule for an extra-data field
2. Send a DELETE request to /api/v2/columns/COLUMNID/?organization_id=ORGID for that column
3. Refresh the data quality page

Proposed Fix

Data quality rules are associated with a column using the tableName and columnName (no foreign keys). Create a migration to update all rules to using column ids, and remove rules that refer to columns that don't exist

Screenshot

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity within 60 days. It will be closed if no further activity occurs. Thank you for your contributions.

[isalanglois]

@axelstudios Is this still relevant? Should it be moved to FY23 board?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity within 60 days. It will be closed if no further activity occurs. Thank you for your contributions.