This repository was archived by the owner on May 17, 2024. It is now read-only.
This repository was archived by the owner on May 17, 2024. It is now read-only.
Missing data type for mysql #701
Closed
Description
Describe the bug
We are using data-diff for consistency checking in our mysql -> bigquery pipeline.
We have noticed that there are false positive errors on mediumint type columns in MySQL, continuously.
Like the log below
[2023-09-14, 16:01:24 KST] {pod_manager.py:197} INFO - [MySQL] Column 'MASKED_COLUMN_NAME' of type 'UnknownColType(text='mediumint')' has no compatibility handling. If encoding/formatting differs between databases, it may result in false positives.
and false positive result was output.
Describe the environment
python 3.10
data-diff = {extras = ["mysql"], version = "^0.6.0"}
About PR
Fortunately, I've found a similar issue #361 and I think it's not a difficult problem.
I will open PR.
Let me know if there are any problem I haven't identified.