Add DdlOperator to execute Data Definition Language (DDL) statements on Teradata databases using TTU tbuild utility #56675
Conversation
providers/teradata/src/airflow/providers/teradata/utils/tpt_util.py
Outdated
Show resolved
Hide resolved
providers/teradata/src/airflow/providers/teradata/utils/tpt_util.py
Outdated
Show resolved
Hide resolved
potiuk
left a comment
potiuk
left a comment
There was a problem hiding this comment.
Generally fine, but you shoul rewrite the AirflowException behaviour following our latest discussions - https://lists.apache.org/thread/5rv4tz0oc27bgr4khx0on0jz8fpxvh55
We rewritten the airflow exception with specific exception in this PR code. Could you please review and let us know if any further updates are needed?. |
@potiuk we have rewritten the airflow exception with specific exception. Could you please review |
…on Teradata databases using TTU tbuild utility (apache#56675) * override sqlalchemy_url and get_uri for SQLAlchemy * IDE-24617 TPT DDL Operator implementation * refactor: Replace AirflowException with built-in exceptions * Fix provider.yaml * Add match parameter to pytest.raises for PT011 compliance * Replace preexec_fn with start_new_session for thread-safe subprocess execution --------- Co-authored-by: Satya Gopu <satyanarayanareddy.gopu@teradata.com> Co-authored-by: Satya Gopu <151805211+snreddygopu@users.noreply.github.com>
…on Teradata databases using TTU tbuild utility (apache#56675) * override sqlalchemy_url and get_uri for SQLAlchemy * IDE-24617 TPT DDL Operator implementation * refactor: Replace AirflowException with built-in exceptions * Fix provider.yaml * Add match parameter to pytest.raises for PT011 compliance * Replace preexec_fn with start_new_session for thread-safe subprocess execution --------- Co-authored-by: Satya Gopu <satyanarayanareddy.gopu@teradata.com> Co-authored-by: Satya Gopu <151805211+snreddygopu@users.noreply.github.com>
3 participants
This PR introduces a new feature in the Airflow Teradata provider to support execution of Teradata DDL scripts as part of Airflow DAGs. The new operator enhances integration with Teradata by enabling flexible orchestration of DDL workloads both locally and remotely via SSH.
Key Features:
🛠️ Additional Enhancements:
Includes utility functions for:
File validation and encoding checks
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in airflow-core/newsfragments.