-
Notifications
You must be signed in to change notification settings - Fork 14.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add new SQLCheckOperators #23915
Closed
denimalpaca
wants to merge
16
commits into
apache:main
from
denimalpaca:add_sql_column_table_check_operators
Closed
Add new SQLCheckOperators #23915
denimalpaca
wants to merge
16
commits into
apache:main
from
denimalpaca:add_sql_column_table_check_operators
Commits on May 25, 2022
-
This commit adds two new SQL Check Operators to the core sql.py file, one called SQLColumnCheckOperator and one called SQLTableCheckOperator. Corresponding tests are added as well. The current functionality of these operators is minimal, but expected to grow over time. These operators, unlike current ones, save information about the results of the check queries that is then parseable by third party libraries.
Configuration menu - View commit details
-
Copy full SHA for f9d3d3e - Browse repository at this point
Copy the full SHA f9d3d3eView commit details -
Use list comprehension in _get_failed_tests()
Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for a58a3c5 - Browse repository at this point
Copy the full SHA a58a3c5View commit details -
Accidentally copied the last line of the file several times, this commit remedies that change.
Configuration menu - View commit details
-
Copy full SHA for c6950de - Browse repository at this point
Copy the full SHA c6950deView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1818691 - Browse repository at this point
Copy the full SHA 1818691View commit details
Commits on Jun 3, 2022
-
Improved the column check operator to include support for greater than, geq, less than, and leq functions. Updated logic and tests to reflect this change.
Configuration menu - View commit details
-
Copy full SHA for fc8380e - Browse repository at this point
Copy the full SHA fc8380eView commit details -
Improved the table check operator by refactoring how checks are performed; this makes it much more customizeable at the expense of knowing the specific result of checks, as the results are now all just 0 or 1.
Configuration menu - View commit details
-
Copy full SHA for 0f56b08 - Browse repository at this point
Copy the full SHA 0f56b08View commit details
Commits on Jun 6, 2022
-
New docstrings were using example dictionaries in the param list, and the way they were written before caused doc build errors. The fix was to update the formatting and add missing words to the word list.
Configuration menu - View commit details
-
Copy full SHA for 14afffb - Browse repository at this point
Copy the full SHA 14afffbView commit details -
Moves record logging below the AirflowException for no records, and makes the Exception message more clear.
Configuration menu - View commit details
-
Copy full SHA for eba96f3 - Browse repository at this point
Copy the full SHA eba96f3View commit details -
Apply suggestions from code review
Co-authored-by: Josh Fell <48934154+josh-fell@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2388dd8 - Browse repository at this point
Copy the full SHA 2388dd8View commit details -
Configuration menu - View commit details
-
Copy full SHA for cf89bf5 - Browse repository at this point
Copy the full SHA cf89bf5View commit details -
Configuration menu - View commit details
-
Copy full SHA for c83c79e - Browse repository at this point
Copy the full SHA c83c79eView commit details
Commits on Jun 8, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 7136397 - Browse repository at this point
Copy the full SHA 7136397View commit details
Commits on Jun 9, 2022
-
Fix SQL rendering bug in SQLTableCheckOperator
SQLTableCheckOperator was rendering an invalid SQL query, this fix changes the way the query template is built from the passed in strings.
Configuration menu - View commit details
-
Copy full SHA for cbc76c1 - Browse repository at this point
Copy the full SHA cbc76c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for fa083ea - Browse repository at this point
Copy the full SHA fa083eaView commit details -
Remove quotes around column in null_check
After some research, it seems the null_check query does *not* need quotes around the column name.
Configuration menu - View commit details
-
Copy full SHA for 7439986 - Browse repository at this point
Copy the full SHA 7439986View commit details
Commits on Jun 13, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 99158b9 - Browse repository at this point
Copy the full SHA 99158b9View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.